-- Logs begin at Mon 2022-04-11 15:35:21 UTC, end at Mon 2022-04-11 17:16:43 UTC. -- Apr 11 16:21:02.123943 dv-cinder-837163-2-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Apr 11 16:21:02.131362 dv-cinder-837163-2-iscsi devstack@keystone.service[80233]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Apr 11 16:21:02.135542 dv-cinder-837163-2-iscsi devstack@keystone.service[80233]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Apr 11 16:21:02 2022] *** Apr 11 16:21:02.135542 dv-cinder-837163-2-iscsi devstack@keystone.service[80233]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Apr 11 16:21:02.135542 dv-cinder-837163-2-iscsi devstack@keystone.service[80233]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Apr 11 16:21:02.135542 dv-cinder-837163-2-iscsi devstack@keystone.service[80233]: nodename: dv-cinder-837163-2-iscsi Apr 11 16:21:02.135542 dv-cinder-837163-2-iscsi devstack@keystone.service[80233]: machine: x86_64 Apr 11 16:21:02.135542 dv-cinder-837163-2-iscsi devstack@keystone.service[80233]: clock source: unix Apr 11 16:21:02.135542 dv-cinder-837163-2-iscsi devstack@keystone.service[80233]: pcre jit disabled Apr 11 16:21:02.135542 dv-cinder-837163-2-iscsi devstack@keystone.service[80233]: detected number of CPU cores: 4 Apr 11 16:21:02.135542 dv-cinder-837163-2-iscsi devstack@keystone.service[80233]: current working directory: / Apr 11 16:21:02.135542 dv-cinder-837163-2-iscsi devstack@keystone.service[80233]: detected binary path: /usr/bin/uwsgi-core Apr 11 16:21:02.135542 dv-cinder-837163-2-iscsi devstack@keystone.service[80233]: your processes number limit is 47680 Apr 11 16:21:02.135542 dv-cinder-837163-2-iscsi devstack@keystone.service[80233]: your memory page size is 4096 bytes Apr 11 16:21:02.135542 dv-cinder-837163-2-iscsi devstack@keystone.service[80233]: detected max file descriptor number: 2048 Apr 11 16:21:02.135542 dv-cinder-837163-2-iscsi devstack@keystone.service[80233]: lock engine: pthread robust mutexes Apr 11 16:21:02.135542 dv-cinder-837163-2-iscsi devstack@keystone.service[80233]: thunder lock: enabled Apr 11 16:21:02.135542 dv-cinder-837163-2-iscsi devstack@keystone.service[80233]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Apr 11 16:21:02.135542 dv-cinder-837163-2-iscsi devstack@keystone.service[80233]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Apr 11 16:21:02.187237 dv-cinder-837163-2-iscsi devstack@keystone.service[80233]: Python main interpreter initialized at 0x56184d95e9c0 Apr 11 16:21:02.187237 dv-cinder-837163-2-iscsi devstack@keystone.service[80233]: python threads support enabled Apr 11 16:21:02.187237 dv-cinder-837163-2-iscsi devstack@keystone.service[80233]: your server socket listen backlog is limited to 100 connections Apr 11 16:21:02.187237 dv-cinder-837163-2-iscsi devstack@keystone.service[80233]: your mercy for graceful operations on workers is 90 seconds Apr 11 16:21:02.187666 dv-cinder-837163-2-iscsi devstack@keystone.service[80233]: mapped 403077 bytes (393 KB) for 2 cores Apr 11 16:21:02.187666 dv-cinder-837163-2-iscsi devstack@keystone.service[80233]: *** Operational MODE: preforking *** Apr 11 16:21:02.187966 dv-cinder-837163-2-iscsi devstack@keystone.service[80233]: *** uWSGI is running in multiple interpreter mode *** Apr 11 16:21:02.187966 dv-cinder-837163-2-iscsi devstack@keystone.service[80233]: spawned uWSGI master process (pid: 80233) Apr 11 16:21:02.188177 dv-cinder-837163-2-iscsi systemd[1]: Started Devstack devstack@keystone.service. Apr 11 16:21:02.191300 dv-cinder-837163-2-iscsi devstack@keystone.service[80233]: spawned uWSGI worker 1 (pid: 80240, cores: 1) Apr 11 16:21:02.191300 dv-cinder-837163-2-iscsi devstack@keystone.service[80233]: spawned uWSGI worker 2 (pid: 80241, cores: 1) Apr 11 16:21:02.191300 dv-cinder-837163-2-iscsi devstack@keystone.service[80233]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 11 16:21:08.106907 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 11 16:21:08.106907 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: from cryptography.utils import int_from_bytes Apr 11 16:21:08.107743 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 11 16:21:08.107743 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: from cryptography.utils import int_from_bytes Apr 11 16:21:08.107924 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 11 16:21:08.107924 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: from cryptography.utils import int_from_bytes Apr 11 16:21:08.108395 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 11 16:21:08.108395 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: from cryptography.utils import int_from_bytes Apr 11 16:21:08.158250 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 11 16:21:08.158440 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 11 16:21:08.158618 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] command line args: [] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 11 16:21:08.158884 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 11 16:21:08.159060 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ================================================================================ {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 11 16:21:08.159310 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] admin_token = **** {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.159387 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 11 16:21:08.159552 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 11 16:21:08.159645 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] config_dir = [] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.159752 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.159838 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] command line args: [] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 11 16:21:08.159922 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] config_source = [] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.160021 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 11 16:21:08.160106 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] debug = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.160267 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ================================================================================ {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 11 16:21:08.160361 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.161535 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] admin_token = **** {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.161608 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.161673 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] config_dir = [] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.161731 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.161795 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.161855 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.161918 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] config_source = [] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.161918 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] debug = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.162030 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.162096 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.162178 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] list_limit = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.162178 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] log_config_append = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.162292 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.162355 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.162418 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.162487 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] log_dir = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.162551 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.162614 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] log_file = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.162677 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.162740 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.162904 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] list_limit = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.162990 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.163051 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] log_config_append = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.163107 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.163164 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.163164 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] log_dir = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.163276 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.163347 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] log_file = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.163406 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.163406 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.163544 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.163609 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.163725 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.163835 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.163951 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.164067 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.164162 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.164289 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.164402 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.164477 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.164556 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.164677 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.164772 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.164936 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.165031 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.165153 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.165229 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.165387 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.165471 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.165619 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.165862 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.165943 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.43/identity {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.166073 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] publish_errors = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.166162 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.166301 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.166378 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.166527 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.166610 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.166753 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.166929 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.167083 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.43/identity {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.167209 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.167340 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] publish_errors = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.167429 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] standard_threads = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.167508 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.167698 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.167773 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.167849 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.167935 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.168008 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.168083 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.168168 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] use_journal = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.168294 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.168373 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] use_json = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.168525 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] use_stderr = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.168605 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] standard_threads = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.168731 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] use_syslog = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.168813 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.168918 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.169163 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.169163 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.169314 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.169385 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] use_journal = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.169455 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.169523 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] use_json = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.169632 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.169719 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] use_stderr = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.169792 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] use_syslog = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.169861 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.170019 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:21:08.170103 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.170274 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.170361 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.170512 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.170596 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.170772 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.170856 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.171011 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.171096 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.171255 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.171373 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.171629 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.171838 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.172044 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.172125 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.172195 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.172265 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.172334 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.172458 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.172546 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.172620 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.172690 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.172818 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.172903 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.173052 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.173139 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.173357 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.173435 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.173602 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.173689 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.173846 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.173935 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.174087 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.174166 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.174335 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.174413 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.174585 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.174671 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.174829 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.174908 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.175064 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.175142 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.175289 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.175377 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.175546 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.175638 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.175769 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.175847 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.176002 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.176088 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.176249 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.176334 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.176494 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.176598 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.176719 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.176835 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.176941 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.177044 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.177174 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.177284 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.177416 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.177529 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.177638 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.177715 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.177869 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.177949 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.178094 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.178200 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.178329 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.178409 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.178561 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.178639 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.178790 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.178876 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.179018 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.179126 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.179246 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.179333 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.179473 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.180022 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.180022 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.180229 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.180309 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.180430 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.180506 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.180622 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.180622 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.180765 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.180881 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.180956 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.181028 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.181143 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.181230 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.181304 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.181426 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.181503 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.181575 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.181691 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.181774 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.181848 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.181969 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.182051 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.182156 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.182252 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.182388 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.182473 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.182620 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.182747 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.182849 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.182988 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.183094 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.183224 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.183325 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.183460 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.183604 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.183724 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.183812 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.183959 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.184142 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.184314 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.184391 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.184471 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.184611 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.184693 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.184858 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.184936 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.185093 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.185173 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.185359 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.185439 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.185588 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.185666 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.185862 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.185961 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.186048 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.186170 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.186287 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.186366 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.186521 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.186609 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.186755 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.186844 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.186999 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.187078 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.187232 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.187312 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.187464 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.187583 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.187724 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.187805 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.187956 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.188034 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.188189 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.188277 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.188421 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.188500 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.188762 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.188854 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.188928 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.189008 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.189111 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.189190 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.189346 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.189424 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.189581 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.189669 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.189814 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.189892 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.190054 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.190133 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.190287 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.190379 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.190526 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.190605 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.190757 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.190836 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.190985 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.191072 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.191213 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.191292 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.191440 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.191545 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.191697 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.191790 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.191925 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.192005 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.192151 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.192230 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.192381 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.192474 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.192615 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.192694 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.192844 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.192923 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.193082 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.193170 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.193318 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.193398 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.193559 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.193638 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.193788 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] auth.external = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.193886 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.194015 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.194095 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.194285 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.194371 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.194523 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.194610 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.194751 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] auth.external = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.194855 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] auth.password = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.194975 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] auth.token = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.195055 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.195211 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.195291 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.195444 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.195550 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.195712 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.195793 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] auth.password = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.195943 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] auth.token = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.196021 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.196184 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.196277 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.196421 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.196514 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.196644 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.196723 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.196872 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] credential.caching = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.196948 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.197103 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.197183 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.197346 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.197432 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.197575 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.197655 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.197804 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.197883 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] credential.caching = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.198043 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.198122 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.198274 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.198355 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.198518 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.198603 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.198753 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.198834 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.198996 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.199076 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.199229 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.199309 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.199480 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.199593 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.200392 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.200491 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.200567 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.200754 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.200835 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.201011 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.201101 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.201254 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] federation.caching = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.201333 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.201489 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.201576 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.201733 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.201822 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.201975 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.202055 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.202204 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.202348 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.202447 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.202538 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] federation.caching = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.202679 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.202760 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.202927 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.203009 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.203160 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.203253 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.203390 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.203469 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.203654 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.203736 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.203890 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.203978 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.204121 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] identity.caching = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.204200 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.204366 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.204446 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.204610 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.204699 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.204845 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.204930 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.205075 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.205155 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.205313 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity.caching = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.205401 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.205539 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.205662 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.205774 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.205859 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.206017 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.206121 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.206255 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.206335 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.206479 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.206559 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.206706 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.206795 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.206922 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.207003 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.207159 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.207239 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.207400 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.207487 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.207655 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.207736 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.207887 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.208008 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.208107 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.208184 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.208351 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.208431 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.208594 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.208674 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.208824 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.208904 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.209051 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.209130 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.209282 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.209361 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.209508 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.209588 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.209738 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.209828 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.209975 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.210055 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.210210 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.210291 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.210445 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.210523 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.210668 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.210746 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.210900 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.210979 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.211167 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.211255 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.211369 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.211456 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.214371 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.214498 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.214577 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.214649 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.214721 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.214786 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.214865 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.214938 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.215010 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.215081 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.215152 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.215223 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.215328 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.215428 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.216077 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.216155 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.216227 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.216306 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.216388 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.216460 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.216532 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.216714 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.216810 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.216882 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.216963 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.217036 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.217108 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.217177 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.217248 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.217319 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.217399 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.217473 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.217545 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.217615 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.217687 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.217759 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.217838 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.217912 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.217984 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.user = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.218054 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.218125 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.218196 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.218275 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.218349 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.218421 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.218491 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.218551 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.218619 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.218698 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.218772 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.218843 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.218914 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.218992 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.219065 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.219145 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.219219 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.219290 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.219360 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.219432 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.219526 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.219603 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.219674 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.219745 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.219815 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.219890 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.219970 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.220049 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.220122 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.220193 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.220263 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.220334 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.220476 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.220552 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.220623 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.220694 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.220764 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.220834 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.220913 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.220986 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.221057 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.221134 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.221281 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.221363 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.221523 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.221602 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.221766 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.221847 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.222008 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.222088 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.222242 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.222329 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.222492 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.222573 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.222719 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.222798 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.222950 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.223030 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.223178 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.223256 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.223407 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.223488 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.223661 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.223745 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.223904 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.223991 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.224140 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.224219 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.224364 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.224444 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.224596 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.224676 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.224826 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.224905 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] resource.caching = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.225062 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.225145 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.225298 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.225377 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.225530 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.225610 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.225757 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.225837 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.225993 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.226073 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.226222 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.226300 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] resource.caching = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.226464 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.226545 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.226696 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.226775 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.226927 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.227005 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.227155 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] role.caching = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.227234 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.227395 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] role.driver = sql {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.227475 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.227644 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.227726 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.227889 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.227969 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.228130 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.228237 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.228374 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.228454 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.228617 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] role.caching = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.228697 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.228854 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.228933 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] role.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.229082 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.229160 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.229322 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.229402 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.229563 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.229642 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.229791 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.229870 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.230033 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.230114 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.230274 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.230353 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.230514 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.230601 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.230756 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.230835 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.231025 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.231258 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.231337 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.231501 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.231679 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.231756 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.231828 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.232002 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.232084 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.232242 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.232324 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.232489 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.232631 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.232711 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.232868 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.232958 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.233118 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.233201 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.233364 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.233444 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.233608 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.233697 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.233845 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.233923 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.234073 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.234216 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.234318 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.234408 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.234566 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.234646 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.234804 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.234923 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.235055 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.235197 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.235332 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.235464 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.235667 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.235795 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.235920 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] token.caching = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.236071 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.236180 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.236255 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.236255 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.236428 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.236508 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.236663 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.236893 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.237132 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] token.caching = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.237217 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.237367 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.237475 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.237613 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.237693 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.237848 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.237927 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.238102 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.238191 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.238347 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.238427 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.238583 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.238662 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.238813 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.238901 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.239050 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.239131 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.239282 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.239361 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.239574 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.239704 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.239825 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.239924 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.240006 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.240068 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.240223 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.240313 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.240483 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.240562 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.240713 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.240792 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] database.connection = **** {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.240955 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.241044 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.241218 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.241373 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.241450 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.241522 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.connection = **** {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.241685 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.241779 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.241918 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.241998 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.242153 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.242234 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.242387 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.242468 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.242619 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.242705 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.242854 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.242933 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.243086 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.243164 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.243320 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.243399 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.243575 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.243659 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.243815 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.243905 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.244049 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.244128 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.244285 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.244366 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.244510 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.244590 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.244745 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.244827 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.244977 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.245059 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.245132 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 11 16:21:08.245203 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.245438 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.245668 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:21:08.245852 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 11 16:21:08.276388 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:21:08.276612 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:21:08.276830 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:21:08.277113 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:21:08.277348 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:21:08.277573 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:21:08.285599 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:21:08.286678 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:21:08.314579 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:21:08.314800 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:21:08.316267 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:21:08.316504 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:21:08.379448 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:21:08.379798 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:21:08.433814 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:21:08.434813 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:21:08.434954 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:21:08.435190 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:21:08.511527 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:21:08.511820 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:21:08.511920 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:21:08.512004 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:21:08.512177 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:21:08.512819 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:21:08.512965 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:21:08.513088 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:21:08.513171 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:21:08.513246 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:21:08.513319 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:21:08.513482 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:21:08.536596 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:21:08.536827 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:21:08.536918 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:21:08.537052 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:21:08.537138 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:21:08.537269 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:21:08.537355 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:21:08.537479 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:21:08.537561 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:21:08.537685 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:21:08.537782 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:21:08.537892 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:21:08.537975 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:21:08.538101 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:21:08.549525 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:21:08.549857 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:21:08.562702 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:21:08.562972 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:21:08.563057 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:21:08.563197 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:21:08.563279 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:21:08.563409 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:21:08.563493 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:21:08.563643 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:21:08.563725 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:21:08.563851 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:21:08.563945 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:21:08.564059 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:21:08.564141 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:21:08.564276 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:21:08.581691 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.581896 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 11 16:21:08.581982 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.582157 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 11 16:21:08.582239 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.582407 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 11 16:21:08.582489 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.582668 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.582752 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 11 16:21:08.582923 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.583005 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.583171 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.583252 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.583419 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.583501 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.583691 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.594576 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.594746 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.594846 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.595016 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.595099 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.595277 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.595359 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.595578 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.603441 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80241) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 16:21:08.603672 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 16:21:08.607431 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80241) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 16:21:08.607552 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 16:21:08.607825 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.607923 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.608102 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.608193 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.608380 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.608462 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.608656 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.608739 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.608907 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.608987 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.609167 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.609256 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.609430 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.609510 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.609691 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.609771 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.609953 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.610040 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.610210 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.610290 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.637595 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.638516 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.639149 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80241) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 16:21:08.639423 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.640151 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 16:21:08.640427 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.644732 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80241) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 16:21:08.645007 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.645281 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.645664 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 16:21:08.645939 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.646212 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.652631 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80241) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 16:21:08.653002 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.653618 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 16:21:08.653892 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.657600 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80241) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 16:21:08.657881 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.658158 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.658431 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.658513 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 16:21:08.658696 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.658778 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.658961 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.659044 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.659222 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.659313 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.659480 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.659584 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.659829 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.660093 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.660354 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.678756 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.679022 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.679728 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.680000 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.683600 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80241) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 16:21:08.685159 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 16:21:08.687902 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.688190 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.688823 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.689112 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.693211 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80241) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 16:21:08.694132 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 16:21:08.698310 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80241) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 16:21:08.699301 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 16:21:08.702116 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.702403 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.702691 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.702972 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.703055 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.703242 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.703325 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.703522 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.703608 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.703843 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.704117 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.704398 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.826212 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80241) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 16:21:08.826409 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 16:21:08.826512 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.826587 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.826778 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.826861 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.827039 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.827123 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.834912 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.835009 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.836619 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.836721 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.836889 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.836972 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.839909 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80241) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 16:21:08.840249 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.840933 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 16:21:08.841258 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.841422 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.841537 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.841810 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.841893 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.842146 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.842461 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.855062 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80241) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 16:21:08.855336 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.855640 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.855855 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 16:21:08.856024 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.856298 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.856380 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.856575 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.856665 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.856852 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.856933 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.857156 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.857444 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.857721 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.874973 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80241) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 16:21:08.876153 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 16:21:08.878338 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80241) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 16:21:08.879395 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 16:21:08.881672 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.882754 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.883258 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.884638 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.885304 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80241) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 16:21:08.885579 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.885851 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.886397 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 16:21:08.886687 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.886939 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.894148 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.894769 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.895731 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80241) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 16:21:08.896403 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 16:21:08.898920 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.899202 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.899489 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.899634 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.899798 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.899919 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.900205 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.900494 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.909782 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80241) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 16:21:08.910065 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.910207 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 16:21:08.910351 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.910494 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.910778 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.918277 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80241) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 16:21:08.918557 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.918821 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 16:21:08.918904 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.919088 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.919170 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.919357 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.919470 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.919654 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.919801 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.919922 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.920076 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.920193 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.920361 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.920442 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.920630 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.920810 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.920892 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.921080 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.921161 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.921349 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.921504 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.921611 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.921772 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.921878 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.922037 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.922298 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.922564 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:21:08.959988 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56184d95e9c0 pid: 80241 (default app) Apr 11 16:21:08.960798 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56184d95e9c0 pid: 80240 (default app) Apr 11 16:21:08.963398 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73552003-0ec0-4ec8-9f3b-c8e6c7b9f9bf None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:08.963719 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73552003-0ec0-4ec8-9f3b-c8e6c7b9f9bf None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:08.963998 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73552003-0ec0-4ec8-9f3b-c8e6c7b9f9bf None None] PATH_INFO: `/v3` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:08.968228 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1/1] 10.222.0.43 () {50 vars in 791 bytes} [Mon Apr 11 16:21:08 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:21:18.265689 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc86be8-4d07-48f4-aec5-0edf55f550ec None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:18.266200 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc86be8-4d07-48f4-aec5-0edf55f550ec None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:18.266282 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc86be8-4d07-48f4-aec5-0edf55f550ec None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:18.270553 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1/2] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:21:18 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 16:21:18.275765 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89faeacc-08b6-42c9-976f-3bffe21134d0 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:18.276149 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89faeacc-08b6-42c9-976f-3bffe21134d0 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:18.276858 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89faeacc-08b6-42c9-976f-3bffe21134d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:18.306761 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG oslo_db.sqlalchemy.engines [None req-89faeacc-08b6-42c9-976f-3bffe21134d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80241) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 11 16:21:18.487578 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG passlib.handlers.bcrypt [None req-89faeacc-08b6-42c9-976f-3bffe21134d0 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=80241) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Apr 11 16:21:18.488006 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG passlib.handlers.bcrypt [None req-89faeacc-08b6-42c9-976f-3bffe21134d0 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80241) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Apr 11 16:21:18.544574 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-89faeacc-08b6-42c9-976f-3bffe21134d0 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:21:18.546129 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-89faeacc-08b6-42c9-976f-3bffe21134d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:21:18.670696 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 2/3] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:21:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Apr 11 16:21:18.834687 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc86be8-4d07-48f4-aec5-0edf55f550ec None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:18.867280 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG oslo_db.sqlalchemy.engines [None req-bfc86be8-4d07-48f4-aec5-0edf55f550ec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80240) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 11 16:21:18.998042 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc86be8-4d07-48f4-aec5-0edf55f550ec None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:19.002372 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378372d0-5f09-4fb0-8068-4ec4602c4f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:19.003040 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378372d0-5f09-4fb0-8068-4ec4602c4f6c admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:19.003326 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378372d0-5f09-4fb0-8068-4ec4602c4f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:19.003631 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378372d0-5f09-4fb0-8068-4ec4602c4f6c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:19.013001 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378372d0-5f09-4fb0-8068-4ec4602c4f6c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:19.062999 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.common.rbac_enforcer.enforcer [None req-378372d0-5f09-4fb0-8068-4ec4602c4f6c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Apr 11 16:21:19.063334 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378372d0-5f09-4fb0-8068-4ec4602c4f6c admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:19.072570 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 2/4] 10.222.0.43 () {58 vars in 1324 bytes} [Mon Apr 11 16:21:18 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 11 16:21:19.080470 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89faeacc-08b6-42c9-976f-3bffe21134d0 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:19.094871 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89faeacc-08b6-42c9-976f-3bffe21134d0 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:19.099952 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8847b906-3c2e-4eaf-91da-f2cf63158e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:19.101268 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8847b906-3c2e-4eaf-91da-f2cf63158e95 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:19.101553 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8847b906-3c2e-4eaf-91da-f2cf63158e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:19.101827 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8847b906-3c2e-4eaf-91da-f2cf63158e95 admin admin] PATH_INFO: `/v3/projects/33d6863ead1548128e611dffc8b01410` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:19.103325 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8847b906-3c2e-4eaf-91da-f2cf63158e95 admin admin] RBAC: Authorizing `identity:get_project(project_id=33d6863ead1548128e611dffc8b01410)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:19.157240 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.common.rbac_enforcer.enforcer [None req-8847b906-3c2e-4eaf-91da-f2cf63158e95 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Apr 11 16:21:19.157581 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8847b906-3c2e-4eaf-91da-f2cf63158e95 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:19.162196 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 3/5] 10.222.0.43 () {56 vars in 1207 bytes} [Mon Apr 11 16:21:19 2022] GET /identity/v3/projects/33d6863ead1548128e611dffc8b01410 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:21:21.434760 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56884bb-730e-4059-a2d2-e4a8dabe482a None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:21.435275 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56884bb-730e-4059-a2d2-e4a8dabe482a None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:21.435364 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56884bb-730e-4059-a2d2-e4a8dabe482a None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:21.439405 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 3/6] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:21:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 16:21:21.444831 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0608f726-d82b-4717-ad95-844c3b34ab6f None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:21.445233 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0608f726-d82b-4717-ad95-844c3b34ab6f None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:21.445397 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0608f726-d82b-4717-ad95-844c3b34ab6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:21.463698 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-0608f726-d82b-4717-ad95-844c3b34ab6f None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:21:21.465225 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-0608f726-d82b-4717-ad95-844c3b34ab6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:21:21.473107 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 4/7] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:21:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Apr 11 16:21:21.496224 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56884bb-730e-4059-a2d2-e4a8dabe482a None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:21.508436 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56884bb-730e-4059-a2d2-e4a8dabe482a None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:21.512651 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c56af6-a98c-4f5f-84e2-3959eb509fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:21.513329 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c56af6-a98c-4f5f-84e2-3959eb509fbd admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:21.513611 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c56af6-a98c-4f5f-84e2-3959eb509fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:21.513888 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c56af6-a98c-4f5f-84e2-3959eb509fbd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:21.521365 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c56af6-a98c-4f5f-84e2-3959eb509fbd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:21.523097 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c56af6-a98c-4f5f-84e2-3959eb509fbd admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:21.531859 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 4/8] 10.222.0.43 () {58 vars in 1324 bytes} [Mon Apr 11 16:21:21 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 11 16:21:21.538866 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0608f726-d82b-4717-ad95-844c3b34ab6f None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:21.548993 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0608f726-d82b-4717-ad95-844c3b34ab6f None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:21.553775 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a49aff-abed-48cb-869c-a331dfcf0bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:21.554756 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a49aff-abed-48cb-869c-a331dfcf0bb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:21.555091 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a49aff-abed-48cb-869c-a331dfcf0bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:21.555422 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a49aff-abed-48cb-869c-a331dfcf0bb6 admin admin] PATH_INFO: `/v3/users/f5967d9641344da186ff23b8711ba0d8` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:21.557612 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a49aff-abed-48cb-869c-a331dfcf0bb6 admin admin] RBAC: Authorizing `identity:get_user(user_id=f5967d9641344da186ff23b8711ba0d8)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:21.559706 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a49aff-abed-48cb-869c-a331dfcf0bb6 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:21.561257 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 5/9] 10.222.0.43 () {56 vars in 1198 bytes} [Mon Apr 11 16:21:21 2022] GET /identity/v3/users/f5967d9641344da186ff23b8711ba0d8 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:21:23.931613 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb2073-4f7b-4de6-a6d8-d68da6b5a449 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:23.932127 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb2073-4f7b-4de6-a6d8-d68da6b5a449 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:23.932210 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb2073-4f7b-4de6-a6d8-d68da6b5a449 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:23.933658 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 5/10] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:21:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:21:23.939673 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b33927f-e78a-4127-8e9d-b93599fb7523 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:23.940083 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b33927f-e78a-4127-8e9d-b93599fb7523 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:23.940235 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b33927f-e78a-4127-8e9d-b93599fb7523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:23.956392 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-2b33927f-e78a-4127-8e9d-b93599fb7523 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:21:23.957552 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-2b33927f-e78a-4127-8e9d-b93599fb7523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:21:24.013730 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c503c42b-1dfe-410c-8962-f409c2a00786 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:24.014067 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c503c42b-1dfe-410c-8962-f409c2a00786 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:24.014383 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c503c42b-1dfe-410c-8962-f409c2a00786 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:24.015755 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 6/11] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:21:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 16:21:24.020605 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed36dbd1-56fb-46c2-a2cd-697131999bc9 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:24.020892 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed36dbd1-56fb-46c2-a2cd-697131999bc9 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:24.021169 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed36dbd1-56fb-46c2-a2cd-697131999bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:24.036070 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 6/12] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:21:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:21:24.064040 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b33927f-e78a-4127-8e9d-b93599fb7523 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:24.066491 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG passlib.handlers.bcrypt [None req-ed36dbd1-56fb-46c2-a2cd-697131999bc9 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=80240) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Apr 11 16:21:24.066919 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG passlib.handlers.bcrypt [None req-ed36dbd1-56fb-46c2-a2cd-697131999bc9 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80240) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Apr 11 16:21:24.114422 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-ed36dbd1-56fb-46c2-a2cd-697131999bc9 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:21:24.116251 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ed36dbd1-56fb-46c2-a2cd-697131999bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:21:24.161886 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b33927f-e78a-4127-8e9d-b93599fb7523 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:24.194249 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a8b7e-074a-4bc5-8911-6f37ab59787e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:24.194985 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a8b7e-074a-4bc5-8911-6f37ab59787e None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:24.195273 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a8b7e-074a-4bc5-8911-6f37ab59787e None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:24.195578 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a8b7e-074a-4bc5-8911-6f37ab59787e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:24.206285 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0a8b7e-074a-4bc5-8911-6f37ab59787e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:21:24.211356 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 7/13] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:21:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 16:21:24.213956 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-db0a8b7e-074a-4bc5-8911-6f37ab59787e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 16:21:24.215150 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 7/14] 10.222.0.43 () {56 vars in 1096 bytes} [Mon Apr 11 16:21:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:21:24.220784 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed36dbd1-56fb-46c2-a2cd-697131999bc9 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:24.233799 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a8b7e-074a-4bc5-8911-6f37ab59787e None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:24.319269 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed36dbd1-56fb-46c2-a2cd-697131999bc9 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:24.330753 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a8b7e-074a-4bc5-8911-6f37ab59787e None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:24.354052 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97069bee-41e0-47db-8a17-3e47a7362ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:24.355089 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97069bee-41e0-47db-8a17-3e47a7362ac7 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:24.355380 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97069bee-41e0-47db-8a17-3e47a7362ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:24.355697 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97069bee-41e0-47db-8a17-3e47a7362ac7 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:24.356622 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97069bee-41e0-47db-8a17-3e47a7362ac7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:21:24.356927 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97069bee-41e0-47db-8a17-3e47a7362ac7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:24.358343 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97069bee-41e0-47db-8a17-3e47a7362ac7 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:24.363738 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f253713d-fee7-4cf0-b489-263667c918ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:24.364389 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f253713d-fee7-4cf0-b489-263667c918ee None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:24.364677 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f253713d-fee7-4cf0-b489-263667c918ee None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:24.364956 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f253713d-fee7-4cf0-b489-263667c918ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:24.369962 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 8/15] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Apr 11 16:21:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:21:24.375401 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97069bee-41e0-47db-8a17-3e47a7362ac7 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:24.429384 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f253713d-fee7-4cf0-b489-263667c918ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:24.430849 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f253713d-fee7-4cf0-b489-263667c918ee None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:24.475609 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97069bee-41e0-47db-8a17-3e47a7362ac7 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:24.512200 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135a0846-f858-45dd-83c5-139cfd7bda84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:24.513093 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a0846-f858-45dd-83c5-139cfd7bda84 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:24.513378 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a0846-f858-45dd-83c5-139cfd7bda84 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:24.513656 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a0846-f858-45dd-83c5-139cfd7bda84 None admin] PATH_INFO: `/v3/users/f5967d9641344da186ff23b8711ba0d8` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:24.515197 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135a0846-f858-45dd-83c5-139cfd7bda84 None admin] RBAC: Authorizing `identity:get_user(user_id=f5967d9641344da186ff23b8711ba0d8)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:24.516698 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135a0846-f858-45dd-83c5-139cfd7bda84 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:24.518320 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 9/16] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Apr 11 16:21:24 2022] GET /identity/v3/users/f5967d9641344da186ff23b8711ba0d8 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:21:24.523615 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135a0846-f858-45dd-83c5-139cfd7bda84 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:24.527995 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 8/17] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Apr 11 16:21:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 11 16:21:24.534516 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f253713d-fee7-4cf0-b489-263667c918ee None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:24.620197 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135a0846-f858-45dd-83c5-139cfd7bda84 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:24.626466 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f253713d-fee7-4cf0-b489-263667c918ee None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:24.653418 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9241e056-8559-4e95-bd5a-2f52893bc67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:24.654214 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9241e056-8559-4e95-bd5a-2f52893bc67d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:24.654495 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9241e056-8559-4e95-bd5a-2f52893bc67d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:24.654766 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9241e056-8559-4e95-bd5a-2f52893bc67d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:24.655979 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9241e056-8559-4e95-bd5a-2f52893bc67d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:24.657432 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9241e056-8559-4e95-bd5a-2f52893bc67d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:24.659026 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 10/18] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:21:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:21:24.660745 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5194a10a-b7c5-4340-b94c-111550d7933c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:24.661544 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5194a10a-b7c5-4340-b94c-111550d7933c None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:24.661831 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5194a10a-b7c5-4340-b94c-111550d7933c None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:24.662111 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5194a10a-b7c5-4340-b94c-111550d7933c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:24.664695 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9241e056-8559-4e95-bd5a-2f52893bc67d None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:24.672061 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5194a10a-b7c5-4340-b94c-111550d7933c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:24.673515 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5194a10a-b7c5-4340-b94c-111550d7933c None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:24.689893 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-5194a10a-b7c5-4340-b94c-111550d7933c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:21:24.691086 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 9/19] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:21:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:21:24.696611 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5194a10a-b7c5-4340-b94c-111550d7933c None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:24.762471 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9241e056-8559-4e95-bd5a-2f52893bc67d None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:24.791502 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5194a10a-b7c5-4340-b94c-111550d7933c None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:24.793641 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e959ce63-5f82-4ff5-81d4-43fe889aa16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:24.794295 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959ce63-5f82-4ff5-81d4-43fe889aa16b None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:24.794581 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959ce63-5f82-4ff5-81d4-43fe889aa16b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:24.794859 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959ce63-5f82-4ff5-81d4-43fe889aa16b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:24.795715 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e959ce63-5f82-4ff5-81d4-43fe889aa16b None admin] RBAC: Adding query filter params (role.id=702e5e78b5d744529384b96a390ae92f, scope.domain.id=default, user.id=f5967d9641344da186ff23b8711ba0d8) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:21:24.796029 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e959ce63-5f82-4ff5-81d4-43fe889aa16b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:24.797656 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e959ce63-5f82-4ff5-81d4-43fe889aa16b None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:24.805783 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 11/20] 10.222.0.43 () {56 vars in 1322 bytes} [Mon Apr 11 16:21:24 2022] GET /identity/v3/role_assignments?user.id=f5967d9641344da186ff23b8711ba0d8&scope.domain.id=default&role.id=702e5e78b5d744529384b96a390ae92f => generated 233 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:21:24.825008 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfcef09-a4bc-46de-820f-cebe4c3a2a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:24.825706 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfcef09-a4bc-46de-820f-cebe4c3a2a2e None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:24.825996 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfcef09-a4bc-46de-820f-cebe4c3a2a2e None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:24.826275 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfcef09-a4bc-46de-820f-cebe4c3a2a2e None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:24.827029 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfcef09-a4bc-46de-820f-cebe4c3a2a2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:21:24.827341 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfcef09-a4bc-46de-820f-cebe4c3a2a2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:24.828802 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfcef09-a4bc-46de-820f-cebe4c3a2a2e None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:24.849214 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 10/21] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Apr 11 16:21:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:21:27.607342 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b3c08-f77d-4b3f-b9ba-be33ae08c4d1 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:27.608808 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b3c08-f77d-4b3f-b9ba-be33ae08c4d1 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:27.609431 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b3c08-f77d-4b3f-b9ba-be33ae08c4d1 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:27.618221 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af30eca6-0715-45d8-86d1-834961eafc69 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:27.619153 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af30eca6-0715-45d8-86d1-834961eafc69 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:27.619668 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af30eca6-0715-45d8-86d1-834961eafc69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:27.621271 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 12/22] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:21:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:21:27.646845 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-af30eca6-0715-45d8-86d1-834961eafc69 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:21:27.648453 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-af30eca6-0715-45d8-86d1-834961eafc69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:21:27.734070 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 11/23] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:21:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:21:27.768590 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431b3c08-f77d-4b3f-b9ba-be33ae08c4d1 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:27.783146 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1032c888-bcec-4784-9362-ff86b114f16f None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:27.783796 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1032c888-bcec-4784-9362-ff86b114f16f None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:27.784301 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1032c888-bcec-4784-9362-ff86b114f16f None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:27.785873 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 12/24] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:21:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:21:27.791301 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2a9e2-e60b-4cdb-9e51-e3f8c0a052a9 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:27.791616 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2a9e2-e60b-4cdb-9e51-e3f8c0a052a9 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:27.791897 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2a9e2-e60b-4cdb-9e51-e3f8c0a052a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:27.819811 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-2ef2a9e2-e60b-4cdb-9e51-e3f8c0a052a9 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:21:27.821343 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-2ef2a9e2-e60b-4cdb-9e51-e3f8c0a052a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:21:27.894835 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 13/25] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:21:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Apr 11 16:21:27.941276 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431b3c08-f77d-4b3f-b9ba-be33ae08c4d1 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:27.942423 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef2a9e2-e60b-4cdb-9e51-e3f8c0a052a9 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:28.000445 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d22391-f07c-45de-b3cf-692b95da8df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:28.001178 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d22391-f07c-45de-b3cf-692b95da8df3 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:28.001465 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d22391-f07c-45de-b3cf-692b95da8df3 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:28.001742 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d22391-f07c-45de-b3cf-692b95da8df3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:28.032476 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d22391-f07c-45de-b3cf-692b95da8df3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:21:28.046209 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-a7d22391-f07c-45de-b3cf-692b95da8df3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 16:21:28.047830 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 13/26] 10.222.0.43 () {56 vars in 1096 bytes} [Mon Apr 11 16:21:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:21:28.049420 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab572d-c11b-43fe-a55c-f24d4ac64dbb None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:28.049867 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab572d-c11b-43fe-a55c-f24d4ac64dbb None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:28.050292 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab572d-c11b-43fe-a55c-f24d4ac64dbb None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:28.056058 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef2a9e2-e60b-4cdb-9e51-e3f8c0a052a9 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:28.059980 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 14/27] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:21:28 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:21:28.060910 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab572d-c11b-43fe-a55c-f24d4ac64dbb None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:28.113740 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cbb9b6-5cb3-4148-be03-d23e7df8dfc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:28.114934 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cbb9b6-5cb3-4148-be03-d23e7df8dfc8 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:28.117026 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cbb9b6-5cb3-4148-be03-d23e7df8dfc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:28.117543 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cbb9b6-5cb3-4148-be03-d23e7df8dfc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:28.143488 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cbb9b6-5cb3-4148-be03-d23e7df8dfc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:28.145339 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cbb9b6-5cb3-4148-be03-d23e7df8dfc8 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:28.179353 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-49cbb9b6-5cb3-4148-be03-d23e7df8dfc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:21:28.188227 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 14/28] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:21:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:21:28.189746 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a7ba2-18cb-4e60-a9b3-3e106323340c None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:28.191792 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a7ba2-18cb-4e60-a9b3-3e106323340c None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:28.192490 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a7ba2-18cb-4e60-a9b3-3e106323340c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:28.224418 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-788a7ba2-18cb-4e60-a9b3-3e106323340c None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:21:28.226766 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-788a7ba2-18cb-4e60-a9b3-3e106323340c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:21:28.268057 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab572d-c11b-43fe-a55c-f24d4ac64dbb None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:28.331820 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b209e51e-9793-4d60-93ab-f334d2703103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:28.332898 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209e51e-9793-4d60-93ab-f334d2703103 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:28.333400 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209e51e-9793-4d60-93ab-f334d2703103 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:28.333877 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209e51e-9793-4d60-93ab-f334d2703103 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:28.336092 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b209e51e-9793-4d60-93ab-f334d2703103 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:21:28.336636 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b209e51e-9793-4d60-93ab-f334d2703103 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:28.340303 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b209e51e-9793-4d60-93ab-f334d2703103 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:28.354295 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 15/29] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Apr 11 16:21:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:21:28.357197 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b209e51e-9793-4d60-93ab-f334d2703103 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:28.359508 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 15/30] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:21:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:21:28.361058 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788a7ba2-18cb-4e60-a9b3-3e106323340c None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:28.531329 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b209e51e-9793-4d60-93ab-f334d2703103 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:28.538287 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788a7ba2-18cb-4e60-a9b3-3e106323340c None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:28.572606 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d7330a-43ad-456c-bc15-382fef8440ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:28.573494 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d7330a-43ad-456c-bc15-382fef8440ae None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:28.573777 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d7330a-43ad-456c-bc15-382fef8440ae None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:28.574052 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d7330a-43ad-456c-bc15-382fef8440ae None admin] PATH_INFO: `/v3/users/f5967d9641344da186ff23b8711ba0d8` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:28.574442 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31e0d08-e773-4562-87d3-39fd6571ebba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:28.575121 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e0d08-e773-4562-87d3-39fd6571ebba None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:28.575395 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d7330a-43ad-456c-bc15-382fef8440ae None admin] RBAC: Authorizing `identity:get_user(user_id=f5967d9641344da186ff23b8711ba0d8)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:28.575494 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e0d08-e773-4562-87d3-39fd6571ebba None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:28.575730 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e0d08-e773-4562-87d3-39fd6571ebba None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:28.576476 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31e0d08-e773-4562-87d3-39fd6571ebba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:21:28.576794 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31e0d08-e773-4562-87d3-39fd6571ebba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:28.577158 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d7330a-43ad-456c-bc15-382fef8440ae None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:28.578172 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31e0d08-e773-4562-87d3-39fd6571ebba None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:28.578934 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 16/31] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Apr 11 16:21:28 2022] GET /identity/v3/users/f5967d9641344da186ff23b8711ba0d8 => generated 247 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:21:28.584151 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d7330a-43ad-456c-bc15-382fef8440ae None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:28.603420 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 16/32] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Apr 11 16:21:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:21:28.604911 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea17beb-97ab-4f5e-bf7e-b2451f2babfb None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:28.605208 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea17beb-97ab-4f5e-bf7e-b2451f2babfb None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:28.605999 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea17beb-97ab-4f5e-bf7e-b2451f2babfb None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:28.608213 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 17/33] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:21:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:21:28.608945 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea17beb-97ab-4f5e-bf7e-b2451f2babfb None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:28.689709 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d7330a-43ad-456c-bc15-382fef8440ae None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:28.717188 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea17beb-97ab-4f5e-bf7e-b2451f2babfb None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:28.724106 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c7fc38-db42-4b55-bd2a-6b08d160c8b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:28.724783 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7fc38-db42-4b55-bd2a-6b08d160c8b0 None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:28.725064 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7fc38-db42-4b55-bd2a-6b08d160c8b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:28.725335 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7fc38-db42-4b55-bd2a-6b08d160c8b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:28.726150 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c7fc38-db42-4b55-bd2a-6b08d160c8b0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:28.727604 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c7fc38-db42-4b55-bd2a-6b08d160c8b0 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:28.752471 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a7572-bacd-4d17-911b-ce6d20d84f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:28.753307 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a7572-bacd-4d17-911b-ce6d20d84f00 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:28.753601 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a7572-bacd-4d17-911b-ce6d20d84f00 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:28.753884 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a7572-bacd-4d17-911b-ce6d20d84f00 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:28.755138 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7a7572-bacd-4d17-911b-ce6d20d84f00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:28.756998 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7a7572-bacd-4d17-911b-ce6d20d84f00 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:28.763646 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 18/34] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:21:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:21:28.763646 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a7572-bacd-4d17-911b-ce6d20d84f00 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:28.875109 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a7572-bacd-4d17-911b-ce6d20d84f00 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:28.912493 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521b9f97-3432-455d-9425-21a9cbb39de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:28.913241 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521b9f97-3432-455d-9425-21a9cbb39de0 None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:28.913536 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521b9f97-3432-455d-9425-21a9cbb39de0 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:28.913933 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521b9f97-3432-455d-9425-21a9cbb39de0 None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:28.914662 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521b9f97-3432-455d-9425-21a9cbb39de0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:28.916712 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521b9f97-3432-455d-9425-21a9cbb39de0 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:28.955853 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 17/35] 10.222.0.43 () {60 vars in 1131 bytes} [Mon Apr 11 16:21:28 2022] POST /identity/v3/roles => generated 219 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:21:28.957737 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d2357d-81d1-4df8-92c8-f194736d6cc5 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:28.958167 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d2357d-81d1-4df8-92c8-f194736d6cc5 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:28.958588 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d2357d-81d1-4df8-92c8-f194736d6cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:28.978980 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-34d2357d-81d1-4df8-92c8-f194736d6cc5 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:21:28.981076 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-34d2357d-81d1-4df8-92c8-f194736d6cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:21:29.079452 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 18/36] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:21:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:21:29.080520 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d2357d-81d1-4df8-92c8-f194736d6cc5 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:29.221615 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 19/37] 10.222.0.43 () {60 vars in 1141 bytes} [Mon Apr 11 16:21:28 2022] POST /identity/v3/projects => generated 301 bytes in 462 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:21:29.223035 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521b9f97-3432-455d-9425-21a9cbb39de0 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:29.267746 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d2357d-81d1-4df8-92c8-f194736d6cc5 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:29.325075 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899e042e-3b47-43af-a173-e43c3464cc74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:29.326858 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e042e-3b47-43af-a173-e43c3464cc74 None admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:29.327746 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e042e-3b47-43af-a173-e43c3464cc74 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:29.328402 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e042e-3b47-43af-a173-e43c3464cc74 None admin] PATH_INFO: `/v3/domains/default/users/f5967d9641344da186ff23b8711ba0d8/roles/702e5e78b5d744529384b96a390ae92f` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:29.331616 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899e042e-3b47-43af-a173-e43c3464cc74 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=f5967d9641344da186ff23b8711ba0d8, role_id=702e5e78b5d744529384b96a390ae92f)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:29.333972 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899e042e-3b47-43af-a173-e43c3464cc74 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:29.355581 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521b9f97-3432-455d-9425-21a9cbb39de0 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:29.402424 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b359a764-c7b4-467f-95db-0a304fef6776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:29.403133 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359a764-c7b4-467f-95db-0a304fef6776 None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:29.403421 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359a764-c7b4-467f-95db-0a304fef6776 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:29.403740 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359a764-c7b4-467f-95db-0a304fef6776 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:29.404514 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b359a764-c7b4-467f-95db-0a304fef6776 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:29.406071 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b359a764-c7b4-467f-95db-0a304fef6776 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:29.479740 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 19/38] 10.222.0.43 () {58 vars in 1361 bytes} [Mon Apr 11 16:21:29 2022] PUT /identity/v3/domains/default/users/f5967d9641344da186ff23b8711ba0d8/roles/702e5e78b5d744529384b96a390ae92f => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:21:29.481077 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225eb6e7-610f-4a5f-8af3-46b6e2fa7ab1 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:29.481365 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225eb6e7-610f-4a5f-8af3-46b6e2fa7ab1 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:29.481642 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225eb6e7-610f-4a5f-8af3-46b6e2fa7ab1 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:29.482876 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 20/39] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:21:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:21:29.483977 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe50e28-e6f5-4ee9-955a-b7154b252ada None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:29.494355 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe50e28-e6f5-4ee9-955a-b7154b252ada None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:29.494355 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe50e28-e6f5-4ee9-955a-b7154b252ada None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:29.494355 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 21/40] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:21:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:21:29.494355 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc0a7a-4376-4994-b958-0d8eab92bf2a None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:29.494355 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc0a7a-4376-4994-b958-0d8eab92bf2a None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:29.494355 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc0a7a-4376-4994-b958-0d8eab92bf2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:29.508627 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-01bc0a7a-4376-4994-b958-0d8eab92bf2a None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:21:29.510478 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-01bc0a7a-4376-4994-b958-0d8eab92bf2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:21:29.532015 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 20/41] 10.222.0.43 () {60 vars in 1131 bytes} [Mon Apr 11 16:21:29 2022] POST /identity/v3/roles => generated 225 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:21:29.533456 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9680fbda-9cc0-4bd4-874a-1c1961a7db44 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:29.533938 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9680fbda-9cc0-4bd4-874a-1c1961a7db44 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:29.534099 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9680fbda-9cc0-4bd4-874a-1c1961a7db44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:29.553126 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-9680fbda-9cc0-4bd4-874a-1c1961a7db44 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:21:29.555192 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-9680fbda-9cc0-4bd4-874a-1c1961a7db44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:21:29.600074 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 22/42] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:21:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 16:21:29.632399 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bc0a7a-4376-4994-b958-0d8eab92bf2a None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:29.645040 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 21/43] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:21:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:21:29.679649 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9680fbda-9cc0-4bd4-874a-1c1961a7db44 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:29.772486 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bc0a7a-4376-4994-b958-0d8eab92bf2a None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:29.789059 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9680fbda-9cc0-4bd4-874a-1c1961a7db44 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:29.814584 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d62e753-7db3-4041-a039-46e0e66fb7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:29.815406 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62e753-7db3-4041-a039-46e0e66fb7fe None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:29.815786 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62e753-7db3-4041-a039-46e0e66fb7fe None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:29.816089 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62e753-7db3-4041-a039-46e0e66fb7fe None admin] PATH_INFO: `/v3/domains/default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:29.817947 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d62e753-7db3-4041-a039-46e0e66fb7fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:29.819462 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d62e753-7db3-4041-a039-46e0e66fb7fe None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:29.821877 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 23/44] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:21:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:21:29.827550 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d62e753-7db3-4041-a039-46e0e66fb7fe None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:29.835567 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a180b8b-6511-4266-a409-0a196bb03860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:29.836264 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a180b8b-6511-4266-a409-0a196bb03860 None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:29.836552 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a180b8b-6511-4266-a409-0a196bb03860 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:29.836831 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a180b8b-6511-4266-a409-0a196bb03860 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:29.838170 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a180b8b-6511-4266-a409-0a196bb03860 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:29.839584 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a180b8b-6511-4266-a409-0a196bb03860 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:29.925022 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 22/45] 10.222.0.43 () {60 vars in 1131 bytes} [Mon Apr 11 16:21:29 2022] POST /identity/v3/roles => generated 223 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:21:29.927158 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d62e753-7db3-4041-a039-46e0e66fb7fe None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:29.967848 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a7b04-f111-4684-963c-638a3709dd81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:29.968553 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a7b04-f111-4684-963c-638a3709dd81 None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:29.968844 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a7b04-f111-4684-963c-638a3709dd81 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:29.969127 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a7b04-f111-4684-963c-638a3709dd81 None admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:29.969863 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2a7b04-f111-4684-963c-638a3709dd81 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:29.971403 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2a7b04-f111-4684-963c-638a3709dd81 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:30.072041 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 24/46] 10.222.0.43 () {60 vars in 1141 bytes} [Mon Apr 11 16:21:29 2022] POST /identity/v3/projects => generated 312 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:21:31.863209 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2880a56-7dee-48e9-94d3-8d70807004c2 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:31.863802 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2880a56-7dee-48e9-94d3-8d70807004c2 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:31.863881 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2880a56-7dee-48e9-94d3-8d70807004c2 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:31.865215 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 23/47] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:21:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:21:31.870576 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93804e-1aed-4093-a177-34da581e1a89 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:31.871020 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93804e-1aed-4093-a177-34da581e1a89 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:31.871121 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93804e-1aed-4093-a177-34da581e1a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:31.888314 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-9b93804e-1aed-4093-a177-34da581e1a89 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:21:31.889484 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-9b93804e-1aed-4093-a177-34da581e1a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:21:31.952182 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 25/48] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:21:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:21:31.976459 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2880a56-7dee-48e9-94d3-8d70807004c2 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:32.078375 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2880a56-7dee-48e9-94d3-8d70807004c2 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:32.110496 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919d95eb-977b-48af-98fd-e70116c2e458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:32.111294 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d95eb-977b-48af-98fd-e70116c2e458 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:32.111611 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d95eb-977b-48af-98fd-e70116c2e458 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:32.111898 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d95eb-977b-48af-98fd-e70116c2e458 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:32.129979 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919d95eb-977b-48af-98fd-e70116c2e458 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:21:32.137257 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-919d95eb-977b-48af-98fd-e70116c2e458 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 16:21:32.138481 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 24/49] 10.222.0.43 () {56 vars in 1096 bytes} [Mon Apr 11 16:21:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:21:32.150022 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b93804e-1aed-4093-a177-34da581e1a89 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:32.250391 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b93804e-1aed-4093-a177-34da581e1a89 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:32.283541 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26335934-5fdf-40d3-ac72-dc349cb3fcb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:32.284219 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26335934-5fdf-40d3-ac72-dc349cb3fcb0 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:32.284515 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26335934-5fdf-40d3-ac72-dc349cb3fcb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:32.284796 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26335934-5fdf-40d3-ac72-dc349cb3fcb0 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:32.285549 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26335934-5fdf-40d3-ac72-dc349cb3fcb0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:21:32.285859 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26335934-5fdf-40d3-ac72-dc349cb3fcb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:32.287245 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26335934-5fdf-40d3-ac72-dc349cb3fcb0 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:32.299663 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 26/50] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Apr 11 16:21:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:21:32.305285 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919d95eb-977b-48af-98fd-e70116c2e458 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:32.400261 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919d95eb-977b-48af-98fd-e70116c2e458 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:32.422188 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69941cd4-7506-4b8d-8ee4-5ab2b729a876 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:32.422587 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69941cd4-7506-4b8d-8ee4-5ab2b729a876 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:32.422936 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69941cd4-7506-4b8d-8ee4-5ab2b729a876 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:32.424397 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 27/51] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:21:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 16:21:32.429723 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15184d1e-ca80-4ddc-a437-0198e4baef49 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:32.430015 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15184d1e-ca80-4ddc-a437-0198e4baef49 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:32.430332 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15184d1e-ca80-4ddc-a437-0198e4baef49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:32.433932 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc38072-338b-4821-8e57-8341db19d68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:32.434817 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc38072-338b-4821-8e57-8341db19d68f None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:32.435107 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc38072-338b-4821-8e57-8341db19d68f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:32.435388 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc38072-338b-4821-8e57-8341db19d68f None admin] PATH_INFO: `/v3/users/f5967d9641344da186ff23b8711ba0d8` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:32.436624 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc38072-338b-4821-8e57-8341db19d68f None admin] RBAC: Authorizing `identity:get_user(user_id=f5967d9641344da186ff23b8711ba0d8)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:32.438088 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc38072-338b-4821-8e57-8341db19d68f None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:32.439747 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 25/52] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Apr 11 16:21:32 2022] GET /identity/v3/users/f5967d9641344da186ff23b8711ba0d8 => generated 247 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:21:32.444924 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc38072-338b-4821-8e57-8341db19d68f None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:32.446636 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-15184d1e-ca80-4ddc-a437-0198e4baef49 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:21:32.447924 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-15184d1e-ca80-4ddc-a437-0198e4baef49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:21:32.530155 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 28/53] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:21:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 16:21:32.545384 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc38072-338b-4821-8e57-8341db19d68f None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:32.553963 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15184d1e-ca80-4ddc-a437-0198e4baef49 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:32.578149 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac25a0a3-eb42-42b0-87af-f3e7cdd0e313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:32.578950 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25a0a3-eb42-42b0-87af-f3e7cdd0e313 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:32.579237 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25a0a3-eb42-42b0-87af-f3e7cdd0e313 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:32.579529 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25a0a3-eb42-42b0-87af-f3e7cdd0e313 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:32.580724 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac25a0a3-eb42-42b0-87af-f3e7cdd0e313 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:32.582200 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac25a0a3-eb42-42b0-87af-f3e7cdd0e313 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:32.583857 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 26/54] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:21:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:21:32.589708 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac25a0a3-eb42-42b0-87af-f3e7cdd0e313 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:32.648794 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15184d1e-ca80-4ddc-a437-0198e4baef49 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:32.681894 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50557403-0cf7-452c-94a4-05c624afad0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:32.682627 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50557403-0cf7-452c-94a4-05c624afad0a None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:32.682912 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50557403-0cf7-452c-94a4-05c624afad0a None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:32.683190 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50557403-0cf7-452c-94a4-05c624afad0a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:32.684274 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac25a0a3-eb42-42b0-87af-f3e7cdd0e313 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:32.684396 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50557403-0cf7-452c-94a4-05c624afad0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:32.685859 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50557403-0cf7-452c-94a4-05c624afad0a None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:32.687464 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 29/55] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:21:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:21:32.692893 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50557403-0cf7-452c-94a4-05c624afad0a None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:32.716633 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d7778d-c9c4-46a3-a60a-5dffd92fe125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:32.717292 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d7778d-c9c4-46a3-a60a-5dffd92fe125 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:32.717584 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d7778d-c9c4-46a3-a60a-5dffd92fe125 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:32.717897 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d7778d-c9c4-46a3-a60a-5dffd92fe125 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:32.718696 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d7778d-c9c4-46a3-a60a-5dffd92fe125 None admin] RBAC: Adding query filter params (role.id=702e5e78b5d744529384b96a390ae92f, scope.domain.id=default, user.id=f5967d9641344da186ff23b8711ba0d8) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:21:32.719010 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d7778d-c9c4-46a3-a60a-5dffd92fe125 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:32.721391 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d7778d-c9c4-46a3-a60a-5dffd92fe125 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:32.727067 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 27/56] 10.222.0.43 () {56 vars in 1322 bytes} [Mon Apr 11 16:21:32 2022] GET /identity/v3/role_assignments?user.id=f5967d9641344da186ff23b8711ba0d8&scope.domain.id=default&role.id=702e5e78b5d744529384b96a390ae92f => generated 530 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:21:32.804526 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50557403-0cf7-452c-94a4-05c624afad0a None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:32.847657 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f42dd6-4521-414b-a8e5-86f55ef5aedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:32.848355 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f42dd6-4521-414b-a8e5-86f55ef5aedc None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:32.848646 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f42dd6-4521-414b-a8e5-86f55ef5aedc None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:32.848926 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f42dd6-4521-414b-a8e5-86f55ef5aedc None admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:32.849658 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f42dd6-4521-414b-a8e5-86f55ef5aedc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:32.851145 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f42dd6-4521-414b-a8e5-86f55ef5aedc None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:32.941187 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 30/57] 10.222.0.43 () {60 vars in 1140 bytes} [Mon Apr 11 16:21:32 2022] POST /identity/v3/projects => generated 298 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:21:35.267852 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c24ef-0a44-4ee1-8775-a4b52fcfd9cb None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:35.268357 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c24ef-0a44-4ee1-8775-a4b52fcfd9cb None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:35.268442 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c24ef-0a44-4ee1-8775-a4b52fcfd9cb None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:35.269775 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 28/58] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:21:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:21:35.275641 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f9f97-eec8-4581-b48c-37da5bcb8b3c None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:35.276064 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f9f97-eec8-4581-b48c-37da5bcb8b3c None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:35.276204 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f9f97-eec8-4581-b48c-37da5bcb8b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:35.293755 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-2c6f9f97-eec8-4581-b48c-37da5bcb8b3c None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:21:35.294934 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-2c6f9f97-eec8-4581-b48c-37da5bcb8b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:21:35.356704 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 31/59] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:21:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:21:35.382093 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0c24ef-0a44-4ee1-8775-a4b52fcfd9cb None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:35.478417 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0c24ef-0a44-4ee1-8775-a4b52fcfd9cb None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:35.511368 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8360a888-2ff0-41e4-8fb2-db4013dc4844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:35.514935 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8360a888-2ff0-41e4-8fb2-db4013dc4844 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:35.514935 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8360a888-2ff0-41e4-8fb2-db4013dc4844 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:35.514935 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8360a888-2ff0-41e4-8fb2-db4013dc4844 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:35.514935 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8360a888-2ff0-41e4-8fb2-db4013dc4844 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:35.515327 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8360a888-2ff0-41e4-8fb2-db4013dc4844 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:35.516984 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 29/60] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:21:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:21:35.522483 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6f9f97-eec8-4581-b48c-37da5bcb8b3c None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:35.617135 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6f9f97-eec8-4581-b48c-37da5bcb8b3c None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:35.649317 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c913c-5fd5-43e5-b19a-e4b72505d909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:35.650152 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c913c-5fd5-43e5-b19a-e4b72505d909 None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:35.650443 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c913c-5fd5-43e5-b19a-e4b72505d909 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:35.650724 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c913c-5fd5-43e5-b19a-e4b72505d909 None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:35.651446 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743c913c-5fd5-43e5-b19a-e4b72505d909 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:35.652917 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743c913c-5fd5-43e5-b19a-e4b72505d909 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:35.745976 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 32/61] 10.222.0.43 () {60 vars in 1132 bytes} [Mon Apr 11 16:21:35 2022] POST /identity/v3/users => generated 275 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:21:39.366218 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68163575-ce78-474d-a99d-62f95b68366c None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:39.367783 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68163575-ce78-474d-a99d-62f95b68366c None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:39.368312 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68163575-ce78-474d-a99d-62f95b68366c None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:39.369898 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 30/62] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:21:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:21:39.375319 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab6cc1-35a8-4d0a-9944-1c5bb6e9788e None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:39.375866 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab6cc1-35a8-4d0a-9944-1c5bb6e9788e None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:39.376114 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab6cc1-35a8-4d0a-9944-1c5bb6e9788e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:39.396165 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc778a-948b-4f86-b433-0b4b1e0faf2f None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:39.396802 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc778a-948b-4f86-b433-0b4b1e0faf2f None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:39.397288 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc778a-948b-4f86-b433-0b4b1e0faf2f None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:39.398561 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-e7ab6cc1-35a8-4d0a-9944-1c5bb6e9788e None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:21:39.399834 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 31/63] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:21:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:21:39.399953 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-e7ab6cc1-35a8-4d0a-9944-1c5bb6e9788e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:21:39.408635 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2926fe2a-b378-4723-8832-12cc6ca8ecb5 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:39.409274 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2926fe2a-b378-4723-8832-12cc6ca8ecb5 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:39.409777 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2926fe2a-b378-4723-8832-12cc6ca8ecb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:39.433690 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-2926fe2a-b378-4723-8832-12cc6ca8ecb5 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:21:39.435237 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-2926fe2a-b378-4723-8832-12cc6ca8ecb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:21:39.480106 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 33/64] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:21:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:21:39.487538 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc09593-6c0d-47b6-bf31-7c81ff6c9d6f None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:39.488381 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc09593-6c0d-47b6-bf31-7c81ff6c9d6f None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:39.488812 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc09593-6c0d-47b6-bf31-7c81ff6c9d6f None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:39.490647 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 34/65] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:21:39 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:21:39.505330 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd586a-7d7b-4461-a466-941ea6984bda None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:39.506110 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd586a-7d7b-4461-a466-941ea6984bda None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:39.506658 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd586a-7d7b-4461-a466-941ea6984bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:39.509085 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 32/66] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:21:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 16:21:39.522597 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2926fe2a-b378-4723-8832-12cc6ca8ecb5 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:39.538288 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-e7cd586a-7d7b-4461-a466-941ea6984bda None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:21:39.539786 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-e7cd586a-7d7b-4461-a466-941ea6984bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:21:39.608294 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 35/67] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:21:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 16:21:39.615537 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd586a-7d7b-4461-a466-941ea6984bda None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:39.652773 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2926fe2a-b378-4723-8832-12cc6ca8ecb5 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:39.696389 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103322cd-9062-4b25-9eb7-271431490e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:39.697249 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103322cd-9062-4b25-9eb7-271431490e57 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:39.697690 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103322cd-9062-4b25-9eb7-271431490e57 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:39.697978 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103322cd-9062-4b25-9eb7-271431490e57 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:39.711655 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103322cd-9062-4b25-9eb7-271431490e57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:21:39.731957 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-103322cd-9062-4b25-9eb7-271431490e57 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 11 16:21:39.739065 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 33/68] 10.222.0.43 () {56 vars in 1114 bytes} [Mon Apr 11 16:21:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:21:39.740199 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103322cd-9062-4b25-9eb7-271431490e57 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:39.743605 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd586a-7d7b-4461-a466-941ea6984bda None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:39.787177 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa60f9b-d802-44d4-a5e6-c07093fc064d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:39.788299 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa60f9b-d802-44d4-a5e6-c07093fc064d None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:39.788626 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa60f9b-d802-44d4-a5e6-c07093fc064d None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:39.788921 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa60f9b-d802-44d4-a5e6-c07093fc064d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:39.802280 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa60f9b-d802-44d4-a5e6-c07093fc064d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:21:39.812978 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-8fa60f9b-d802-44d4-a5e6-c07093fc064d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 16:21:39.818760 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 36/69] 10.222.0.43 () {56 vars in 1096 bytes} [Mon Apr 11 16:21:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:21:39.818760 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa60f9b-d802-44d4-a5e6-c07093fc064d None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:39.849938 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103322cd-9062-4b25-9eb7-271431490e57 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:39.883167 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582de8a3-22e7-4084-bb60-5a7895415fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:39.884002 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582de8a3-22e7-4084-bb60-5a7895415fdf None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:39.884297 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582de8a3-22e7-4084-bb60-5a7895415fdf None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:39.884579 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582de8a3-22e7-4084-bb60-5a7895415fdf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:39.894191 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582de8a3-22e7-4084-bb60-5a7895415fdf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:21:39.902019 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-582de8a3-22e7-4084-bb60-5a7895415fdf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 16:21:39.903270 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 34/70] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Apr 11 16:21:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:21:39.904512 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f4ec2-9216-455e-aef9-ef0d3e39a1ad None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:39.904810 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f4ec2-9216-455e-aef9-ef0d3e39a1ad None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:39.905102 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f4ec2-9216-455e-aef9-ef0d3e39a1ad None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:39.906376 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 35/71] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:21:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:21:39.907259 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f4ec2-9216-455e-aef9-ef0d3e39a1ad None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:39.918732 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa60f9b-d802-44d4-a5e6-c07093fc064d None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:39.950743 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff9e2d-b320-4c40-a1ed-dbb5fb88a61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:39.951416 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff9e2d-b320-4c40-a1ed-dbb5fb88a61c None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:39.951732 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff9e2d-b320-4c40-a1ed-dbb5fb88a61c None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:39.952015 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff9e2d-b320-4c40-a1ed-dbb5fb88a61c None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:39.952762 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cff9e2d-b320-4c40-a1ed-dbb5fb88a61c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:21:39.953074 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cff9e2d-b320-4c40-a1ed-dbb5fb88a61c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:39.954462 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cff9e2d-b320-4c40-a1ed-dbb5fb88a61c None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:39.962787 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 37/72] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Apr 11 16:21:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:21:39.963972 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecff29a-667d-4a6e-b80b-6c481f9ed808 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:39.964264 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecff29a-667d-4a6e-b80b-6c481f9ed808 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:39.964552 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecff29a-667d-4a6e-b80b-6c481f9ed808 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:39.966055 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 38/73] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:21:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:21:39.966902 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecff29a-667d-4a6e-b80b-6c481f9ed808 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:40.003981 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f4ec2-9216-455e-aef9-ef0d3e39a1ad None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:40.036450 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b76c88f-c125-468d-8da6-eb4f278a740d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:40.037121 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76c88f-c125-468d-8da6-eb4f278a740d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:40.037410 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76c88f-c125-468d-8da6-eb4f278a740d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:40.037692 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76c88f-c125-468d-8da6-eb4f278a740d None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:40.038442 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b76c88f-c125-468d-8da6-eb4f278a740d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:21:40.038798 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b76c88f-c125-468d-8da6-eb4f278a740d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:40.040222 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b76c88f-c125-468d-8da6-eb4f278a740d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:40.048035 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 36/74] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Apr 11 16:21:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:21:40.050751 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e984750-3fd7-4eb9-8c23-cbe1334e1bad None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:40.050751 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e984750-3fd7-4eb9-8c23-cbe1334e1bad None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:40.050751 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e984750-3fd7-4eb9-8c23-cbe1334e1bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:40.063343 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecff29a-667d-4a6e-b80b-6c481f9ed808 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:40.065233 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-3e984750-3fd7-4eb9-8c23-cbe1334e1bad None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:21:40.066433 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-3e984750-3fd7-4eb9-8c23-cbe1334e1bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:21:40.096109 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f50af9-abed-437e-9a1f-ccbdc328cb7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:40.096780 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f50af9-abed-437e-9a1f-ccbdc328cb7a None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:40.097067 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f50af9-abed-437e-9a1f-ccbdc328cb7a None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:40.097344 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f50af9-abed-437e-9a1f-ccbdc328cb7a None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:40.098092 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f50af9-abed-437e-9a1f-ccbdc328cb7a None admin] RBAC: Adding query filter params (name=member) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:21:40.098403 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f50af9-abed-437e-9a1f-ccbdc328cb7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:40.099803 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f50af9-abed-437e-9a1f-ccbdc328cb7a None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:40.108013 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 39/75] 10.222.0.43 () {56 vars in 1101 bytes} [Mon Apr 11 16:21:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:21:40.108830 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f50af9-abed-437e-9a1f-ccbdc328cb7a None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:40.129759 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 37/76] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:21:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:21:40.130873 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7bac91-10b9-4598-a222-7987a95ae3be None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:40.131176 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7bac91-10b9-4598-a222-7987a95ae3be None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:40.131464 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7bac91-10b9-4598-a222-7987a95ae3be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:40.147373 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-fa7bac91-10b9-4598-a222-7987a95ae3be None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:21:40.149214 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-fa7bac91-10b9-4598-a222-7987a95ae3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:21:40.205237 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f50af9-abed-437e-9a1f-ccbdc328cb7a None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:40.212285 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 38/77] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:21:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:21:40.213048 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7bac91-10b9-4598-a222-7987a95ae3be None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:40.239309 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de9318-2476-48af-bf5e-3c17c429b005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:40.240227 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de9318-2476-48af-bf5e-3c17c429b005 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:40.240515 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de9318-2476-48af-bf5e-3c17c429b005 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:40.240792 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de9318-2476-48af-bf5e-3c17c429b005 None admin] PATH_INFO: `/v3/users/8017d78c60f04cb48bc6bb22afc32115` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:40.254014 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06de9318-2476-48af-bf5e-3c17c429b005 None admin] RBAC: Authorizing `identity:get_user(user_id=8017d78c60f04cb48bc6bb22afc32115)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:40.255772 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06de9318-2476-48af-bf5e-3c17c429b005 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:40.257628 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 40/78] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Apr 11 16:21:40 2022] GET /identity/v3/users/8017d78c60f04cb48bc6bb22afc32115 => generated 275 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:21:40.258328 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de9318-2476-48af-bf5e-3c17c429b005 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:40.306943 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7bac91-10b9-4598-a222-7987a95ae3be None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:40.338440 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7031b9e-cc43-4935-9b35-b8feae787f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:40.339343 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7031b9e-cc43-4935-9b35-b8feae787f99 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:40.339660 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7031b9e-cc43-4935-9b35-b8feae787f99 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:40.339948 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7031b9e-cc43-4935-9b35-b8feae787f99 None admin] PATH_INFO: `/v3/users/f5967d9641344da186ff23b8711ba0d8` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:40.341158 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7031b9e-cc43-4935-9b35-b8feae787f99 None admin] RBAC: Authorizing `identity:get_user(user_id=f5967d9641344da186ff23b8711ba0d8)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:40.342608 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7031b9e-cc43-4935-9b35-b8feae787f99 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:40.344273 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 39/79] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Apr 11 16:21:40 2022] GET /identity/v3/users/f5967d9641344da186ff23b8711ba0d8 => generated 247 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:21:40.345032 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7031b9e-cc43-4935-9b35-b8feae787f99 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:40.350989 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de9318-2476-48af-bf5e-3c17c429b005 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:40.384013 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa71eb9-8fe4-4a77-b246-cb69cc7a78cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:40.384896 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa71eb9-8fe4-4a77-b246-cb69cc7a78cc None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:40.385178 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa71eb9-8fe4-4a77-b246-cb69cc7a78cc None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:40.385454 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa71eb9-8fe4-4a77-b246-cb69cc7a78cc None admin] PATH_INFO: `/v3/users/8017d78c60f04cb48bc6bb22afc32115` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:40.386641 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa71eb9-8fe4-4a77-b246-cb69cc7a78cc None admin] RBAC: Authorizing `identity:get_user(user_id=8017d78c60f04cb48bc6bb22afc32115)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:40.388129 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa71eb9-8fe4-4a77-b246-cb69cc7a78cc None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:40.389926 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 41/80] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Apr 11 16:21:40 2022] GET /identity/v3/users/8017d78c60f04cb48bc6bb22afc32115 => generated 275 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:21:40.390691 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa71eb9-8fe4-4a77-b246-cb69cc7a78cc None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:40.437746 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7031b9e-cc43-4935-9b35-b8feae787f99 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:40.472341 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd0a491-25a3-465a-859c-a1693a1c25be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:40.473118 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd0a491-25a3-465a-859c-a1693a1c25be None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:40.473431 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd0a491-25a3-465a-859c-a1693a1c25be None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:40.473681 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd0a491-25a3-465a-859c-a1693a1c25be None admin] PATH_INFO: `/v3/domains/default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:40.474922 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd0a491-25a3-465a-859c-a1693a1c25be None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:40.477049 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd0a491-25a3-465a-859c-a1693a1c25be None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:40.478678 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 40/81] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:21:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:21:40.479536 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd0a491-25a3-465a-859c-a1693a1c25be None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:40.485588 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa71eb9-8fe4-4a77-b246-cb69cc7a78cc None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:40.520135 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f54edd3-a499-4cbd-a8f0-aaaf8a83eb6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:40.520934 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f54edd3-a499-4cbd-a8f0-aaaf8a83eb6d None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:40.521220 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f54edd3-a499-4cbd-a8f0-aaaf8a83eb6d None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:40.521494 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f54edd3-a499-4cbd-a8f0-aaaf8a83eb6d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:40.531610 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f54edd3-a499-4cbd-a8f0-aaaf8a83eb6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:21:40.538636 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-4f54edd3-a499-4cbd-a8f0-aaaf8a83eb6d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 16:21:40.539991 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 42/82] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Apr 11 16:21:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:21:40.540595 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f54edd3-a499-4cbd-a8f0-aaaf8a83eb6d None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:40.574675 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd0a491-25a3-465a-859c-a1693a1c25be None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:40.606747 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3088445-9d89-49a3-84f9-5bc78e17d55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:40.607398 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3088445-9d89-49a3-84f9-5bc78e17d55f None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:40.607859 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3088445-9d89-49a3-84f9-5bc78e17d55f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:40.608150 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3088445-9d89-49a3-84f9-5bc78e17d55f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:40.634257 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f54edd3-a499-4cbd-a8f0-aaaf8a83eb6d None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:40.666263 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4203060c-7cfa-4fda-9102-47f52ca8b7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:40.666908 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4203060c-7cfa-4fda-9102-47f52ca8b7ef None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:40.667189 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4203060c-7cfa-4fda-9102-47f52ca8b7ef None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:40.667462 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4203060c-7cfa-4fda-9102-47f52ca8b7ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:40.672203 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3088445-9d89-49a3-84f9-5bc78e17d55f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:40.673667 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3088445-9d89-49a3-84f9-5bc78e17d55f None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:40.730837 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4203060c-7cfa-4fda-9102-47f52ca8b7ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:40.732256 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4203060c-7cfa-4fda-9102-47f52ca8b7ef None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:40.766363 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 41/83] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Apr 11 16:21:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 16:21:40.767208 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3088445-9d89-49a3-84f9-5bc78e17d55f None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:40.831947 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 43/84] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Apr 11 16:21:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 16:21:40.835104 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4203060c-7cfa-4fda-9102-47f52ca8b7ef None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:40.876393 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3088445-9d89-49a3-84f9-5bc78e17d55f None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:40.908431 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc0fff1-efa6-4745-9f99-e1249fc95c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:40.909076 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc0fff1-efa6-4745-9f99-e1249fc95c6a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:40.909363 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc0fff1-efa6-4745-9f99-e1249fc95c6a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:40.909644 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc0fff1-efa6-4745-9f99-e1249fc95c6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:40.934708 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4203060c-7cfa-4fda-9102-47f52ca8b7ef None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:40.967824 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26acd154-627d-44bc-a1dc-25cc49b4758e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:40.968498 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26acd154-627d-44bc-a1dc-25cc49b4758e None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:40.968788 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26acd154-627d-44bc-a1dc-25cc49b4758e None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:40.969070 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26acd154-627d-44bc-a1dc-25cc49b4758e None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:40.969778 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26acd154-627d-44bc-a1dc-25cc49b4758e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:40.971231 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26acd154-627d-44bc-a1dc-25cc49b4758e None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:40.973354 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc0fff1-efa6-4745-9f99-e1249fc95c6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:40.974806 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc0fff1-efa6-4745-9f99-e1249fc95c6a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:41.058865 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 44/85] 10.222.0.43 () {60 vars in 1132 bytes} [Mon Apr 11 16:21:40 2022] POST /identity/v3/users => generated 289 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:21:41.059652 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26acd154-627d-44bc-a1dc-25cc49b4758e None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:41.067078 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 42/86] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Apr 11 16:21:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 16:21:41.067991 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc0fff1-efa6-4745-9f99-e1249fc95c6a None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:41.183394 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc0fff1-efa6-4745-9f99-e1249fc95c6a None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:41.203003 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26acd154-627d-44bc-a1dc-25cc49b4758e None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:41.228450 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa789464-fb56-4e9d-883b-08ae96edeba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:41.229587 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa789464-fb56-4e9d-883b-08ae96edeba8 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:41.229936 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa789464-fb56-4e9d-883b-08ae96edeba8 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:41.230212 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa789464-fb56-4e9d-883b-08ae96edeba8 None admin] PATH_INFO: `/v3/projects/5fcfe56fb9bf4cc7b15db190133a1d28` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:41.231498 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa789464-fb56-4e9d-883b-08ae96edeba8 None admin] RBAC: Authorizing `identity:get_project(project_id=5fcfe56fb9bf4cc7b15db190133a1d28)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:41.233340 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa789464-fb56-4e9d-883b-08ae96edeba8 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:41.240037 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 43/87] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Apr 11 16:21:41 2022] GET /identity/v3/projects/5fcfe56fb9bf4cc7b15db190133a1d28 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:21:41.240037 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa789464-fb56-4e9d-883b-08ae96edeba8 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:41.245929 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad60ab2-3538-41d2-807f-b789a9bee38e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:41.246664 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad60ab2-3538-41d2-807f-b789a9bee38e None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:41.246956 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad60ab2-3538-41d2-807f-b789a9bee38e None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:41.247237 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad60ab2-3538-41d2-807f-b789a9bee38e None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:41.248043 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad60ab2-3538-41d2-807f-b789a9bee38e None admin] RBAC: Adding query filter params (name=member) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:21:41.248362 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad60ab2-3538-41d2-807f-b789a9bee38e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:41.249766 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad60ab2-3538-41d2-807f-b789a9bee38e None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:41.259461 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 45/88] 10.222.0.43 () {56 vars in 1101 bytes} [Mon Apr 11 16:21:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:21:41.260268 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad60ab2-3538-41d2-807f-b789a9bee38e None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:41.356650 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa789464-fb56-4e9d-883b-08ae96edeba8 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:41.361964 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad60ab2-3538-41d2-807f-b789a9bee38e None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:41.394733 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2925a5-4f08-4811-86ff-8b002a0d96fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:41.395640 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2925a5-4f08-4811-86ff-8b002a0d96fb None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:41.395930 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2925a5-4f08-4811-86ff-8b002a0d96fb None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:41.396219 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2925a5-4f08-4811-86ff-8b002a0d96fb None admin] PATH_INFO: `/v3/projects/5fcfe56fb9bf4cc7b15db190133a1d28` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:41.397430 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2925a5-4f08-4811-86ff-8b002a0d96fb None admin] RBAC: Authorizing `identity:get_project(project_id=5fcfe56fb9bf4cc7b15db190133a1d28)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:41.399305 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a1272-1a0a-468b-8a80-4244a657fe27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:41.399806 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2925a5-4f08-4811-86ff-8b002a0d96fb None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:41.400825 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a1272-1a0a-468b-8a80-4244a657fe27 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:41.401268 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 44/89] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Apr 11 16:21:41 2022] GET /identity/v3/projects/5fcfe56fb9bf4cc7b15db190133a1d28 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:21:41.401449 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a1272-1a0a-468b-8a80-4244a657fe27 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:41.401863 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a1272-1a0a-468b-8a80-4244a657fe27 None admin] PATH_INFO: `/v3/projects/5fcfe56fb9bf4cc7b15db190133a1d28` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:41.402042 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2925a5-4f08-4811-86ff-8b002a0d96fb None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:41.403459 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18a1272-1a0a-468b-8a80-4244a657fe27 None admin] RBAC: Authorizing `identity:get_project(project_id=5fcfe56fb9bf4cc7b15db190133a1d28)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:41.405099 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18a1272-1a0a-468b-8a80-4244a657fe27 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:41.407091 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 46/90] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Apr 11 16:21:41 2022] GET /identity/v3/projects/5fcfe56fb9bf4cc7b15db190133a1d28 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:21:41.408085 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a1272-1a0a-468b-8a80-4244a657fe27 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:41.523323 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2925a5-4f08-4811-86ff-8b002a0d96fb None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:41.524516 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a1272-1a0a-468b-8a80-4244a657fe27 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:41.559108 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ef7a95-0f34-405a-b1ff-31943623371c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:41.559341 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bc2e7b-5e13-494e-a8d3-3ac5f53496ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:41.560002 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc2e7b-5e13-494e-a8d3-3ac5f53496ca None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:41.560106 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ef7a95-0f34-405a-b1ff-31943623371c None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:41.560290 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc2e7b-5e13-494e-a8d3-3ac5f53496ca None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:41.560400 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ef7a95-0f34-405a-b1ff-31943623371c None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:41.560563 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc2e7b-5e13-494e-a8d3-3ac5f53496ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:41.560650 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ef7a95-0f34-405a-b1ff-31943623371c None admin] PATH_INFO: `/v3/users/8017d78c60f04cb48bc6bb22afc32115` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:41.561466 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bc2e7b-5e13-494e-a8d3-3ac5f53496ca None admin] RBAC: Adding query filter params (role.id=7d3d5d04ca634b3a9b63e7b05bb5d333, scope.project.id=5fcfe56fb9bf4cc7b15db190133a1d28, user.id=8017d78c60f04cb48bc6bb22afc32115) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:21:41.561789 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bc2e7b-5e13-494e-a8d3-3ac5f53496ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:41.561900 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ef7a95-0f34-405a-b1ff-31943623371c None admin] RBAC: Authorizing `identity:get_user(user_id=8017d78c60f04cb48bc6bb22afc32115)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:41.563220 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bc2e7b-5e13-494e-a8d3-3ac5f53496ca None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:41.563327 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ef7a95-0f34-405a-b1ff-31943623371c None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:41.564928 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 47/91] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Apr 11 16:21:41 2022] GET /identity/v3/users/8017d78c60f04cb48bc6bb22afc32115 => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:21:41.565698 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ef7a95-0f34-405a-b1ff-31943623371c None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:41.570291 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 45/92] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Apr 11 16:21:41 2022] GET /identity/v3/role_assignments?user.id=8017d78c60f04cb48bc6bb22afc32115&scope.project.id=5fcfe56fb9bf4cc7b15db190133a1d28&role.id=7d3d5d04ca634b3a9b63e7b05bb5d333 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:21:41.575856 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bc2e7b-5e13-494e-a8d3-3ac5f53496ca None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:41.718059 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bc2e7b-5e13-494e-a8d3-3ac5f53496ca None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:41.764186 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fa0b5e-0c2c-4502-ba69-41a03ccf8e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:41.764874 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa0b5e-0c2c-4502-ba69-41a03ccf8e45 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:41.765165 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa0b5e-0c2c-4502-ba69-41a03ccf8e45 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:41.765449 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa0b5e-0c2c-4502-ba69-41a03ccf8e45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:41.769082 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fa0b5e-0c2c-4502-ba69-41a03ccf8e45 None admin] RBAC: Adding query filter params (role.id=0d41da7bec094450b5bff4e4831be52c, scope.project.id=5fcfe56fb9bf4cc7b15db190133a1d28, user.id=8017d78c60f04cb48bc6bb22afc32115) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:21:41.769408 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fa0b5e-0c2c-4502-ba69-41a03ccf8e45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:41.776707 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fa0b5e-0c2c-4502-ba69-41a03ccf8e45 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:41.787926 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 46/93] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Apr 11 16:21:41 2022] GET /identity/v3/role_assignments?user.id=8017d78c60f04cb48bc6bb22afc32115&scope.project.id=5fcfe56fb9bf4cc7b15db190133a1d28&role.id=0d41da7bec094450b5bff4e4831be52c => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:21:41.796906 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fa0b5e-0c2c-4502-ba69-41a03ccf8e45 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:41.857778 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ef7a95-0f34-405a-b1ff-31943623371c None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:41.932171 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fa0b5e-0c2c-4502-ba69-41a03ccf8e45 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:41.961471 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0617e7b-96ca-43c2-aed4-4625b013060b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:41.962166 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0617e7b-96ca-43c2-aed4-4625b013060b None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:41.962450 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0617e7b-96ca-43c2-aed4-4625b013060b None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:41.962724 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0617e7b-96ca-43c2-aed4-4625b013060b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:41.963656 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0617e7b-96ca-43c2-aed4-4625b013060b None admin] RBAC: Adding query filter params (role.id=702e5e78b5d744529384b96a390ae92f, scope.project.id=5fcfe56fb9bf4cc7b15db190133a1d28, user.id=f5967d9641344da186ff23b8711ba0d8) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:21:41.963976 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0617e7b-96ca-43c2-aed4-4625b013060b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:41.965459 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0617e7b-96ca-43c2-aed4-4625b013060b None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:41.975057 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258bb614-f1ee-4df1-873d-2fc906172ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:41.975784 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258bb614-f1ee-4df1-873d-2fc906172ed8 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:41.976561 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258bb614-f1ee-4df1-873d-2fc906172ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:41.976841 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258bb614-f1ee-4df1-873d-2fc906172ed8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:41.979268 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 48/94] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Apr 11 16:21:41 2022] GET /identity/v3/role_assignments?user.id=f5967d9641344da186ff23b8711ba0d8&scope.project.id=5fcfe56fb9bf4cc7b15db190133a1d28&role.id=702e5e78b5d744529384b96a390ae92f => generated 259 bytes in 414 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:21:42.053370 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258bb614-f1ee-4df1-873d-2fc906172ed8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:42.055666 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258bb614-f1ee-4df1-873d-2fc906172ed8 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:42.174812 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 47/95] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Apr 11 16:21:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 16:21:42.184720 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0617e7b-96ca-43c2-aed4-4625b013060b None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:42.321684 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0617e7b-96ca-43c2-aed4-4625b013060b None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:42.364294 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485576ba-31e2-47c5-8065-197b02434d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:42.365180 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485576ba-31e2-47c5-8065-197b02434d0b None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:42.365463 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485576ba-31e2-47c5-8065-197b02434d0b None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:42.365741 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485576ba-31e2-47c5-8065-197b02434d0b None admin] PATH_INFO: `/v3/projects/e5b41ef7f603454f9573712ab5b7f00e` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:42.367564 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485576ba-31e2-47c5-8065-197b02434d0b None admin] RBAC: Authorizing `identity:get_project(project_id=e5b41ef7f603454f9573712ab5b7f00e)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:42.369008 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485576ba-31e2-47c5-8065-197b02434d0b None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:42.370722 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 49/96] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Apr 11 16:21:42 2022] GET /identity/v3/projects/e5b41ef7f603454f9573712ab5b7f00e => generated 312 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:21:42.377973 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258bb614-f1ee-4df1-873d-2fc906172ed8 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:42.527466 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258bb614-f1ee-4df1-873d-2fc906172ed8 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:42.564475 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f63bd3-31e3-4afc-aec4-30e416d0ca30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:42.565152 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f63bd3-31e3-4afc-aec4-30e416d0ca30 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:42.565440 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f63bd3-31e3-4afc-aec4-30e416d0ca30 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:42.565724 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f63bd3-31e3-4afc-aec4-30e416d0ca30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:42.566569 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f63bd3-31e3-4afc-aec4-30e416d0ca30 None admin] RBAC: Adding query filter params (role.id=0d41da7bec094450b5bff4e4831be52c, scope.project.id=e5b41ef7f603454f9573712ab5b7f00e, user.id=8017d78c60f04cb48bc6bb22afc32115) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:21:42.566995 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f63bd3-31e3-4afc-aec4-30e416d0ca30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:42.568601 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f63bd3-31e3-4afc-aec4-30e416d0ca30 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:42.575611 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 48/97] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Apr 11 16:21:42 2022] GET /identity/v3/role_assignments?user.id=8017d78c60f04cb48bc6bb22afc32115&scope.project.id=e5b41ef7f603454f9573712ab5b7f00e&role.id=0d41da7bec094450b5bff4e4831be52c => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:21:43.941666 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f64471-1ca3-4619-876d-529eb0842803 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:43.942171 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f64471-1ca3-4619-876d-529eb0842803 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:43.942243 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f64471-1ca3-4619-876d-529eb0842803 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:43.943757 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 50/98] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:21:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:21:43.949742 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed360943-b219-42f1-8606-5e2b6d72399c None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:43.950161 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed360943-b219-42f1-8606-5e2b6d72399c None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:43.950335 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed360943-b219-42f1-8606-5e2b6d72399c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:43.972528 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-ed360943-b219-42f1-8606-5e2b6d72399c None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:21:43.973807 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ed360943-b219-42f1-8606-5e2b6d72399c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:21:44.056344 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 49/99] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:21:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:21:44.098908 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f64471-1ca3-4619-876d-529eb0842803 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:44.137828 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfdc13a-51f6-48eb-98db-70321af71aae None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:44.138144 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfdc13a-51f6-48eb-98db-70321af71aae None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:44.138401 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfdc13a-51f6-48eb-98db-70321af71aae None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:44.140567 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 50/100] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:21:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:21:44.148472 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193575de-4615-4b78-b12f-2344cf445914 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:44.148784 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193575de-4615-4b78-b12f-2344cf445914 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:44.149058 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193575de-4615-4b78-b12f-2344cf445914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:44.176037 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-193575de-4615-4b78-b12f-2344cf445914 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:21:44.180334 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-193575de-4615-4b78-b12f-2344cf445914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:21:44.285249 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f64471-1ca3-4619-876d-529eb0842803 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:44.294099 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 51/101] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:21:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:21:44.318965 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a2f38a-90b0-4338-b4ba-52b0cfbbdfe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:44.320606 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a2f38a-90b0-4338-b4ba-52b0cfbbdfe7 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:44.320895 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a2f38a-90b0-4338-b4ba-52b0cfbbdfe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:44.321171 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a2f38a-90b0-4338-b4ba-52b0cfbbdfe7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:44.322360 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a2f38a-90b0-4338-b4ba-52b0cfbbdfe7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:44.323833 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a2f38a-90b0-4338-b4ba-52b0cfbbdfe7 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:44.325462 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 51/102] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:21:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:21:44.331033 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193575de-4615-4b78-b12f-2344cf445914 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:44.342612 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a2f38a-90b0-4338-b4ba-52b0cfbbdfe7 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:44.483409 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193575de-4615-4b78-b12f-2344cf445914 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:44.522130 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f889efc-67ee-4d86-9342-219812aa0cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:44.522855 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f889efc-67ee-4d86-9342-219812aa0cd5 None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:44.523147 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f889efc-67ee-4d86-9342-219812aa0cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:44.523427 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f889efc-67ee-4d86-9342-219812aa0cd5 None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:44.524350 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f889efc-67ee-4d86-9342-219812aa0cd5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:44.525944 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f889efc-67ee-4d86-9342-219812aa0cd5 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:44.554759 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a2f38a-90b0-4338-b4ba-52b0cfbbdfe7 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:44.592232 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52c47c6-73c7-4ceb-8b1f-d9879df8945b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:44.593046 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52c47c6-73c7-4ceb-8b1f-d9879df8945b None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:44.593338 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52c47c6-73c7-4ceb-8b1f-d9879df8945b None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:44.593616 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52c47c6-73c7-4ceb-8b1f-d9879df8945b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:44.604731 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52c47c6-73c7-4ceb-8b1f-d9879df8945b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:21:44.611886 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-e52c47c6-73c7-4ceb-8b1f-d9879df8945b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 11 16:21:44.613099 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 52/103] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Apr 11 16:21:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:21:44.627937 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 52/104] 10.222.0.43 () {60 vars in 1141 bytes} [Mon Apr 11 16:21:44 2022] POST /identity/v3/projects => generated 302 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:21:44.628257 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52c47c6-73c7-4ceb-8b1f-d9879df8945b None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:44.750302 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52c47c6-73c7-4ceb-8b1f-d9879df8945b None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:44.791804 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b90584-493c-4d6d-916d-ec8c0a51694d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:44.792505 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b90584-493c-4d6d-916d-ec8c0a51694d None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:44.792795 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b90584-493c-4d6d-916d-ec8c0a51694d None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:44.793078 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b90584-493c-4d6d-916d-ec8c0a51694d None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:44.793847 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b90584-493c-4d6d-916d-ec8c0a51694d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:21:44.794160 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b90584-493c-4d6d-916d-ec8c0a51694d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:44.795590 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b90584-493c-4d6d-916d-ec8c0a51694d None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:44.805263 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 53/105] 10.222.0.43 () {56 vars in 1101 bytes} [Mon Apr 11 16:21:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:21:44.811097 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f889efc-67ee-4d86-9342-219812aa0cd5 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:44.933133 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f889efc-67ee-4d86-9342-219812aa0cd5 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:44.974327 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d8df52-6ee5-4c93-9e83-9067acf39188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:44.975221 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8df52-6ee5-4c93-9e83-9067acf39188 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:44.976094 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8df52-6ee5-4c93-9e83-9067acf39188 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:44.976377 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8df52-6ee5-4c93-9e83-9067acf39188 None admin] PATH_INFO: `/v3/users/7b102f3f97764644a5c9439eccea7def` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:45.001147 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d8df52-6ee5-4c93-9e83-9067acf39188 None admin] RBAC: Authorizing `identity:get_user(user_id=7b102f3f97764644a5c9439eccea7def)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:45.002622 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d8df52-6ee5-4c93-9e83-9067acf39188 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:45.004691 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 53/106] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Apr 11 16:21:44 2022] GET /identity/v3/users/7b102f3f97764644a5c9439eccea7def => generated 289 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:21:45.010929 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b90584-493c-4d6d-916d-ec8c0a51694d None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:45.036577 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff32e20-f68d-4b20-a71b-e20bce87aeb2 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:45.036879 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff32e20-f68d-4b20-a71b-e20bce87aeb2 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:45.037153 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff32e20-f68d-4b20-a71b-e20bce87aeb2 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:45.039629 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 54/107] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:21:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 16:21:45.045027 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a71cd13-29c6-4bae-b6ca-914b2b4c9b9c None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:45.045323 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a71cd13-29c6-4bae-b6ca-914b2b4c9b9c None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:45.045615 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a71cd13-29c6-4bae-b6ca-914b2b4c9b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:45.075616 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-8a71cd13-29c6-4bae-b6ca-914b2b4c9b9c None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:21:45.076727 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-8a71cd13-29c6-4bae-b6ca-914b2b4c9b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:21:45.119958 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b90584-493c-4d6d-916d-ec8c0a51694d None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:45.161227 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608509da-c53f-4179-9d22-f244048928c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:45.161894 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608509da-c53f-4179-9d22-f244048928c8 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:45.162180 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608509da-c53f-4179-9d22-f244048928c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:45.162457 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608509da-c53f-4179-9d22-f244048928c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:45.187262 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 55/108] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:21:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 16:21:45.226869 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a71cd13-29c6-4bae-b6ca-914b2b4c9b9c None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:45.266974 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608509da-c53f-4179-9d22-f244048928c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:45.268529 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608509da-c53f-4179-9d22-f244048928c8 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:45.392362 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a71cd13-29c6-4bae-b6ca-914b2b4c9b9c None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:45.451300 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524e9c48-58cf-435f-b265-6fc91ffca314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:45.452150 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e9c48-58cf-435f-b265-6fc91ffca314 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:45.452862 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e9c48-58cf-435f-b265-6fc91ffca314 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:45.453150 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e9c48-58cf-435f-b265-6fc91ffca314 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:45.474544 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524e9c48-58cf-435f-b265-6fc91ffca314 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:21:45.485491 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-524e9c48-58cf-435f-b265-6fc91ffca314 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 16:21:45.486793 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 56/109] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Apr 11 16:21:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:21:45.493240 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524e9c48-58cf-435f-b265-6fc91ffca314 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:45.499000 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 54/110] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Apr 11 16:21:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 16:21:45.511542 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608509da-c53f-4179-9d22-f244048928c8 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:45.665666 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524e9c48-58cf-435f-b265-6fc91ffca314 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:45.720482 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5d35a2-ae3f-43b0-a8ef-fb54a5d749bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:45.721173 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d35a2-ae3f-43b0-a8ef-fb54a5d749bb None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:45.721462 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d35a2-ae3f-43b0-a8ef-fb54a5d749bb None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:45.721744 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d35a2-ae3f-43b0-a8ef-fb54a5d749bb None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:45.721993 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608509da-c53f-4179-9d22-f244048928c8 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:45.722507 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5d35a2-ae3f-43b0-a8ef-fb54a5d749bb None admin] RBAC: Adding query filter params (name=member) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:21:45.722820 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5d35a2-ae3f-43b0-a8ef-fb54a5d749bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:45.724243 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5d35a2-ae3f-43b0-a8ef-fb54a5d749bb None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:45.745707 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 57/111] 10.222.0.43 () {56 vars in 1101 bytes} [Mon Apr 11 16:21:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:21:45.754497 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5d35a2-ae3f-43b0-a8ef-fb54a5d749bb None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:45.793659 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e7b78-6990-4d21-90e6-4203678ec0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:45.794544 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e7b78-6990-4d21-90e6-4203678ec0db None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:45.794948 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e7b78-6990-4d21-90e6-4203678ec0db None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:45.795227 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e7b78-6990-4d21-90e6-4203678ec0db None admin] PATH_INFO: `/v3/projects/5fcfe56fb9bf4cc7b15db190133a1d28` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:45.796726 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2e7b78-6990-4d21-90e6-4203678ec0db None admin] RBAC: Authorizing `identity:get_project(project_id=5fcfe56fb9bf4cc7b15db190133a1d28)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:45.798342 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2e7b78-6990-4d21-90e6-4203678ec0db None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:45.800988 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 55/112] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Apr 11 16:21:45 2022] GET /identity/v3/projects/5fcfe56fb9bf4cc7b15db190133a1d28 => generated 298 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:21:45.802124 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054730c2-47e7-4b95-83f8-6b9bd6136aca None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:45.802558 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054730c2-47e7-4b95-83f8-6b9bd6136aca None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:45.802911 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054730c2-47e7-4b95-83f8-6b9bd6136aca None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:45.805005 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 56/113] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:21:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:21:45.811074 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054730c2-47e7-4b95-83f8-6b9bd6136aca None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:45.932761 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5d35a2-ae3f-43b0-a8ef-fb54a5d749bb None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:45.972230 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9114473-9c08-40ab-bff7-0b45df4b2077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:45.973120 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9114473-9c08-40ab-bff7-0b45df4b2077 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:45.973408 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9114473-9c08-40ab-bff7-0b45df4b2077 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:45.973688 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9114473-9c08-40ab-bff7-0b45df4b2077 None admin] PATH_INFO: `/v3/users/8017d78c60f04cb48bc6bb22afc32115` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:45.975887 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9114473-9c08-40ab-bff7-0b45df4b2077 None admin] RBAC: Authorizing `identity:get_user(user_id=8017d78c60f04cb48bc6bb22afc32115)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:45.977631 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9114473-9c08-40ab-bff7-0b45df4b2077 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:45.984111 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 58/114] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Apr 11 16:21:45 2022] GET /identity/v3/users/8017d78c60f04cb48bc6bb22afc32115 => generated 275 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:21:45.984111 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905d7087-f5c8-46f5-bfad-064a8fa380b7 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:45.984111 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905d7087-f5c8-46f5-bfad-064a8fa380b7 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:45.984111 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905d7087-f5c8-46f5-bfad-064a8fa380b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:45.994714 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054730c2-47e7-4b95-83f8-6b9bd6136aca None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:46.005496 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-905d7087-f5c8-46f5-bfad-064a8fa380b7 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:21:46.007484 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-905d7087-f5c8-46f5-bfad-064a8fa380b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:21:46.034297 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf9fe40-1790-490f-a1a2-f971893f047e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:46.034968 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf9fe40-1790-490f-a1a2-f971893f047e None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:46.035256 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf9fe40-1790-490f-a1a2-f971893f047e None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:46.035579 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf9fe40-1790-490f-a1a2-f971893f047e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:46.036804 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf9fe40-1790-490f-a1a2-f971893f047e None admin] RBAC: Adding query filter params (role.id=282780749a1d4592b823458aecfc5caf, scope.project.id=5fcfe56fb9bf4cc7b15db190133a1d28, user.id=7b102f3f97764644a5c9439eccea7def) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:21:46.037125 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf9fe40-1790-490f-a1a2-f971893f047e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:46.039102 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf9fe40-1790-490f-a1a2-f971893f047e None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:46.044534 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 57/115] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Apr 11 16:21:45 2022] GET /identity/v3/role_assignments?user.id=7b102f3f97764644a5c9439eccea7def&scope.project.id=5fcfe56fb9bf4cc7b15db190133a1d28&role.id=282780749a1d4592b823458aecfc5caf => generated 259 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:21:46.046325 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99600a8b-cc79-4a6e-84ed-f37c8b495495 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:46.046325 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99600a8b-cc79-4a6e-84ed-f37c8b495495 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:46.046325 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99600a8b-cc79-4a6e-84ed-f37c8b495495 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:46.047830 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 58/116] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:21:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:21:46.048575 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99600a8b-cc79-4a6e-84ed-f37c8b495495 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:46.089945 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 59/117] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:21:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:21:46.091629 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e878709-65c9-4742-b421-f9c2ea18d8f7 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:46.092088 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e878709-65c9-4742-b421-f9c2ea18d8f7 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:46.092506 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e878709-65c9-4742-b421-f9c2ea18d8f7 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:46.094319 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 60/118] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:21:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:21:46.095686 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e52b9-89f0-4b27-98e5-d03ae662f461 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:46.096115 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e52b9-89f0-4b27-98e5-d03ae662f461 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:46.096549 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e52b9-89f0-4b27-98e5-d03ae662f461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:46.117516 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-426e52b9-89f0-4b27-98e5-d03ae662f461 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:21:46.119758 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-426e52b9-89f0-4b27-98e5-d03ae662f461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:21:46.187985 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99600a8b-cc79-4a6e-84ed-f37c8b495495 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:46.218561 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 61/119] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:21:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:21:46.220577 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dade51b-10d3-4e42-956f-9b786369150a None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:46.221012 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dade51b-10d3-4e42-956f-9b786369150a None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:46.221746 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dade51b-10d3-4e42-956f-9b786369150a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:46.226935 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5112c5a-3a93-4d96-ab00-0ec0c99c747d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:46.228036 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5112c5a-3a93-4d96-ab00-0ec0c99c747d None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:46.228499 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5112c5a-3a93-4d96-ab00-0ec0c99c747d None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:46.228791 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5112c5a-3a93-4d96-ab00-0ec0c99c747d None admin] PATH_INFO: `/v3/projects/5fcfe56fb9bf4cc7b15db190133a1d28` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:46.230317 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5112c5a-3a93-4d96-ab00-0ec0c99c747d None admin] RBAC: Authorizing `identity:get_project(project_id=5fcfe56fb9bf4cc7b15db190133a1d28)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:46.231896 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5112c5a-3a93-4d96-ab00-0ec0c99c747d None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:46.233994 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 59/120] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Apr 11 16:21:46 2022] GET /identity/v3/projects/5fcfe56fb9bf4cc7b15db190133a1d28 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:21:46.234774 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5112c5a-3a93-4d96-ab00-0ec0c99c747d None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:46.243075 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-2dade51b-10d3-4e42-956f-9b786369150a None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:21:46.245048 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-2dade51b-10d3-4e42-956f-9b786369150a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:21:46.316460 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 62/121] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:21:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:21:46.317630 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dade51b-10d3-4e42-956f-9b786369150a None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:46.356729 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5112c5a-3a93-4d96-ab00-0ec0c99c747d None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:46.397524 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44203190-7953-4c11-aee8-35dc6b0e7e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:46.398613 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44203190-7953-4c11-aee8-35dc6b0e7e73 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:46.399057 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44203190-7953-4c11-aee8-35dc6b0e7e73 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:46.399470 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44203190-7953-4c11-aee8-35dc6b0e7e73 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:46.410137 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44203190-7953-4c11-aee8-35dc6b0e7e73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:21:46.418732 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-44203190-7953-4c11-aee8-35dc6b0e7e73 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 11 16:21:46.420163 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 60/122] 10.222.0.43 () {56 vars in 1114 bytes} [Mon Apr 11 16:21:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:21:46.421066 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44203190-7953-4c11-aee8-35dc6b0e7e73 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:46.428197 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dade51b-10d3-4e42-956f-9b786369150a None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:46.472398 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec1d522-daea-46d9-b038-57605031b572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:46.473543 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec1d522-daea-46d9-b038-57605031b572 None admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:46.473836 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec1d522-daea-46d9-b038-57605031b572 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:46.474177 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec1d522-daea-46d9-b038-57605031b572 None admin] PATH_INFO: `/v3/projects/5fcfe56fb9bf4cc7b15db190133a1d28/users/8017d78c60f04cb48bc6bb22afc32115/roles/0d41da7bec094450b5bff4e4831be52c` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:46.477022 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec1d522-daea-46d9-b038-57605031b572 None admin] RBAC: Authorizing `identity:create_grant(project_id=5fcfe56fb9bf4cc7b15db190133a1d28, user_id=8017d78c60f04cb48bc6bb22afc32115, role_id=0d41da7bec094450b5bff4e4831be52c)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:46.479182 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec1d522-daea-46d9-b038-57605031b572 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:46.529094 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44203190-7953-4c11-aee8-35dc6b0e7e73 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:46.562702 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4cf2bb-aee6-4e50-aebc-8ad3d1a82c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:46.563867 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4cf2bb-aee6-4e50-aebc-8ad3d1a82c63 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:46.564356 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4cf2bb-aee6-4e50-aebc-8ad3d1a82c63 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:46.564820 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4cf2bb-aee6-4e50-aebc-8ad3d1a82c63 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:46.575707 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4cf2bb-aee6-4e50-aebc-8ad3d1a82c63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:21:46.583060 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-3a4cf2bb-aee6-4e50-aebc-8ad3d1a82c63 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 16:21:46.585104 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 61/123] 10.222.0.43 () {56 vars in 1096 bytes} [Mon Apr 11 16:21:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:21:46.586094 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4cf2bb-aee6-4e50-aebc-8ad3d1a82c63 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:46.606392 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 63/124] 10.222.0.43 () {58 vars in 1439 bytes} [Mon Apr 11 16:21:46 2022] PUT /identity/v3/projects/5fcfe56fb9bf4cc7b15db190133a1d28/users/8017d78c60f04cb48bc6bb22afc32115/roles/0d41da7bec094450b5bff4e4831be52c => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:21:46.607929 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec1d522-daea-46d9-b038-57605031b572 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:46.758058 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec1d522-daea-46d9-b038-57605031b572 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:46.791385 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4cf2bb-aee6-4e50-aebc-8ad3d1a82c63 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:46.798411 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0189392d-e6e3-49aa-9ad3-f00e06fe0872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:46.799443 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189392d-e6e3-49aa-9ad3-f00e06fe0872 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:46.799973 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189392d-e6e3-49aa-9ad3-f00e06fe0872 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:46.800442 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189392d-e6e3-49aa-9ad3-f00e06fe0872 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:46.801934 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0189392d-e6e3-49aa-9ad3-f00e06fe0872 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:21:46.802506 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0189392d-e6e3-49aa-9ad3-f00e06fe0872 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:46.804347 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0189392d-e6e3-49aa-9ad3-f00e06fe0872 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:46.814694 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 64/125] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Apr 11 16:21:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:21:46.822637 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0189392d-e6e3-49aa-9ad3-f00e06fe0872 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:46.854158 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb89bd7a-b0fa-4ea8-bbfa-9681e3164bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:46.854971 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89bd7a-b0fa-4ea8-bbfa-9681e3164bc8 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:46.855261 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89bd7a-b0fa-4ea8-bbfa-9681e3164bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:46.856418 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89bd7a-b0fa-4ea8-bbfa-9681e3164bc8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:46.867344 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb89bd7a-b0fa-4ea8-bbfa-9681e3164bc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:21:46.875221 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-bb89bd7a-b0fa-4ea8-bbfa-9681e3164bc8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 16:21:46.876643 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 62/126] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Apr 11 16:21:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:21:46.877348 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb89bd7a-b0fa-4ea8-bbfa-9681e3164bc8 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:46.947972 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0189392d-e6e3-49aa-9ad3-f00e06fe0872 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:46.995997 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a428336-0e57-4b32-9749-2bcacaf43f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:46.997383 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a428336-0e57-4b32-9749-2bcacaf43f11 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:46.997678 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a428336-0e57-4b32-9749-2bcacaf43f11 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:46.997964 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a428336-0e57-4b32-9749-2bcacaf43f11 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:46.998730 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a428336-0e57-4b32-9749-2bcacaf43f11 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:21:46.999044 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a428336-0e57-4b32-9749-2bcacaf43f11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:47.000447 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a428336-0e57-4b32-9749-2bcacaf43f11 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:47.004320 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb89bd7a-b0fa-4ea8-bbfa-9681e3164bc8 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:47.019232 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 65/127] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Apr 11 16:21:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:21:47.019942 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a428336-0e57-4b32-9749-2bcacaf43f11 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:47.046294 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd79fb-9a32-49b1-b382-f2ebc1660067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:47.047983 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd79fb-9a32-49b1-b382-f2ebc1660067 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:47.048480 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd79fb-9a32-49b1-b382-f2ebc1660067 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:47.048956 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd79fb-9a32-49b1-b382-f2ebc1660067 None admin] PATH_INFO: `/v3/users/8017d78c60f04cb48bc6bb22afc32115` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:47.050478 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dd79fb-9a32-49b1-b382-f2ebc1660067 None admin] RBAC: Authorizing `identity:get_user(user_id=8017d78c60f04cb48bc6bb22afc32115)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:47.052245 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dd79fb-9a32-49b1-b382-f2ebc1660067 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:47.054587 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 63/128] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Apr 11 16:21:46 2022] GET /identity/v3/users/8017d78c60f04cb48bc6bb22afc32115 => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:21:47.055617 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd79fb-9a32-49b1-b382-f2ebc1660067 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:47.157423 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd79fb-9a32-49b1-b382-f2ebc1660067 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:47.186972 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a428336-0e57-4b32-9749-2bcacaf43f11 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:47.192709 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f62e94b-11f9-4d7d-b8d5-9ae8625e60ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:47.194479 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62e94b-11f9-4d7d-b8d5-9ae8625e60ce None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:47.195042 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62e94b-11f9-4d7d-b8d5-9ae8625e60ce None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:47.195553 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62e94b-11f9-4d7d-b8d5-9ae8625e60ce None admin] PATH_INFO: `/v3/users/f5967d9641344da186ff23b8711ba0d8` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:47.196973 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f62e94b-11f9-4d7d-b8d5-9ae8625e60ce None admin] RBAC: Authorizing `identity:get_user(user_id=f5967d9641344da186ff23b8711ba0d8)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:47.198624 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f62e94b-11f9-4d7d-b8d5-9ae8625e60ce None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:47.200548 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 64/129] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Apr 11 16:21:47 2022] GET /identity/v3/users/f5967d9641344da186ff23b8711ba0d8 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:21:47.201515 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f62e94b-11f9-4d7d-b8d5-9ae8625e60ce None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:47.253850 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80718cb0-5064-44b1-9c50-0cba22596a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:47.253850 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80718cb0-5064-44b1-9c50-0cba22596a5a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:47.253850 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80718cb0-5064-44b1-9c50-0cba22596a5a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:47.253850 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80718cb0-5064-44b1-9c50-0cba22596a5a None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:47.254693 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80718cb0-5064-44b1-9c50-0cba22596a5a None admin] RBAC: Adding query filter params (name=member) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:21:47.255017 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80718cb0-5064-44b1-9c50-0cba22596a5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:47.256482 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80718cb0-5064-44b1-9c50-0cba22596a5a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:47.275140 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 66/130] 10.222.0.43 () {56 vars in 1101 bytes} [Mon Apr 11 16:21:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:21:47.275839 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80718cb0-5064-44b1-9c50-0cba22596a5a None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:47.313764 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f62e94b-11f9-4d7d-b8d5-9ae8625e60ce None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:47.347994 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77963cc-468b-481b-9559-845582cfc582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:47.349244 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77963cc-468b-481b-9559-845582cfc582 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:47.349730 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77963cc-468b-481b-9559-845582cfc582 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:47.350762 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77963cc-468b-481b-9559-845582cfc582 None admin] PATH_INFO: `/v3/projects/5fcfe56fb9bf4cc7b15db190133a1d28` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:47.352218 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77963cc-468b-481b-9559-845582cfc582 None admin] RBAC: Authorizing `identity:get_project(project_id=5fcfe56fb9bf4cc7b15db190133a1d28)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:47.353887 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77963cc-468b-481b-9559-845582cfc582 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:47.355830 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 65/131] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Apr 11 16:21:47 2022] GET /identity/v3/projects/5fcfe56fb9bf4cc7b15db190133a1d28 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:21:47.356859 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77963cc-468b-481b-9559-845582cfc582 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:47.459303 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77963cc-468b-481b-9559-845582cfc582 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:47.498237 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec033c-4348-4b6a-ae5b-13f003623465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:47.501509 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec033c-4348-4b6a-ae5b-13f003623465 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:47.501509 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec033c-4348-4b6a-ae5b-13f003623465 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:47.501509 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec033c-4348-4b6a-ae5b-13f003623465 None admin] PATH_INFO: `/v3/users/8017d78c60f04cb48bc6bb22afc32115` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:47.501509 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ec033c-4348-4b6a-ae5b-13f003623465 None admin] RBAC: Authorizing `identity:get_user(user_id=8017d78c60f04cb48bc6bb22afc32115)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:47.501838 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80718cb0-5064-44b1-9c50-0cba22596a5a None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:47.502843 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ec033c-4348-4b6a-ae5b-13f003623465 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:47.507897 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 66/132] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Apr 11 16:21:47 2022] GET /identity/v3/users/8017d78c60f04cb48bc6bb22afc32115 => generated 275 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:21:47.507897 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec033c-4348-4b6a-ae5b-13f003623465 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:47.589988 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a67e2d5-3949-41b6-894b-7e1d20ee729a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:47.590805 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a67e2d5-3949-41b6-894b-7e1d20ee729a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:47.591092 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a67e2d5-3949-41b6-894b-7e1d20ee729a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:47.591371 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a67e2d5-3949-41b6-894b-7e1d20ee729a None admin] PATH_INFO: `/v3/projects/5fcfe56fb9bf4cc7b15db190133a1d28` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:47.597112 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a67e2d5-3949-41b6-894b-7e1d20ee729a None admin] RBAC: Authorizing `identity:get_project(project_id=5fcfe56fb9bf4cc7b15db190133a1d28)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:47.600027 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a67e2d5-3949-41b6-894b-7e1d20ee729a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:47.603757 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 67/133] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Apr 11 16:21:47 2022] GET /identity/v3/projects/5fcfe56fb9bf4cc7b15db190133a1d28 => generated 298 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:21:47.604864 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a67e2d5-3949-41b6-894b-7e1d20ee729a None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:47.623789 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec033c-4348-4b6a-ae5b-13f003623465 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:47.658781 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cfaff2-0eab-48a6-9537-d26285ff8572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:47.659720 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cfaff2-0eab-48a6-9537-d26285ff8572 None admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:47.660012 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cfaff2-0eab-48a6-9537-d26285ff8572 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:47.660295 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cfaff2-0eab-48a6-9537-d26285ff8572 None admin] PATH_INFO: `/v3/projects/5fcfe56fb9bf4cc7b15db190133a1d28/users/8017d78c60f04cb48bc6bb22afc32115/roles/7d3d5d04ca634b3a9b63e7b05bb5d333` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:47.662833 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cfaff2-0eab-48a6-9537-d26285ff8572 None admin] RBAC: Authorizing `identity:create_grant(project_id=5fcfe56fb9bf4cc7b15db190133a1d28, user_id=8017d78c60f04cb48bc6bb22afc32115, role_id=7d3d5d04ca634b3a9b63e7b05bb5d333)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:47.664645 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cfaff2-0eab-48a6-9537-d26285ff8572 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:47.730133 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a67e2d5-3949-41b6-894b-7e1d20ee729a None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:47.769768 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 67/134] 10.222.0.43 () {58 vars in 1439 bytes} [Mon Apr 11 16:21:47 2022] PUT /identity/v3/projects/5fcfe56fb9bf4cc7b15db190133a1d28/users/8017d78c60f04cb48bc6bb22afc32115/roles/7d3d5d04ca634b3a9b63e7b05bb5d333 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:21:47.770636 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cfaff2-0eab-48a6-9537-d26285ff8572 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:47.785520 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4dedc5-cef9-48b6-87c7-ada68375b652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:47.786453 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4dedc5-cef9-48b6-87c7-ada68375b652 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:47.788223 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4dedc5-cef9-48b6-87c7-ada68375b652 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:47.788544 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4dedc5-cef9-48b6-87c7-ada68375b652 None admin] PATH_INFO: `/v3/projects/e5b41ef7f603454f9573712ab5b7f00e` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:47.795263 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4dedc5-cef9-48b6-87c7-ada68375b652 None admin] RBAC: Authorizing `identity:get_project(project_id=e5b41ef7f603454f9573712ab5b7f00e)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:47.797234 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4dedc5-cef9-48b6-87c7-ada68375b652 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:47.801045 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 68/135] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Apr 11 16:21:47 2022] GET /identity/v3/projects/e5b41ef7f603454f9573712ab5b7f00e => generated 312 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:21:47.807032 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4dedc5-cef9-48b6-87c7-ada68375b652 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:47.964541 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4dedc5-cef9-48b6-87c7-ada68375b652 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:48.001708 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980b6a52-00f5-44b4-98f2-6203f8a38f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:48.002635 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980b6a52-00f5-44b4-98f2-6203f8a38f68 None admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:48.002927 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980b6a52-00f5-44b4-98f2-6203f8a38f68 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:48.003482 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980b6a52-00f5-44b4-98f2-6203f8a38f68 None admin] PATH_INFO: `/v3/projects/e5b41ef7f603454f9573712ab5b7f00e/users/8017d78c60f04cb48bc6bb22afc32115/roles/0d41da7bec094450b5bff4e4831be52c` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:48.005635 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980b6a52-00f5-44b4-98f2-6203f8a38f68 None admin] RBAC: Authorizing `identity:create_grant(project_id=e5b41ef7f603454f9573712ab5b7f00e, user_id=8017d78c60f04cb48bc6bb22afc32115, role_id=0d41da7bec094450b5bff4e4831be52c)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:48.008268 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980b6a52-00f5-44b4-98f2-6203f8a38f68 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:48.020949 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cfaff2-0eab-48a6-9537-d26285ff8572 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:48.062311 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bb317a-30ed-4783-b0d7-943bf7729928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:48.063242 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb317a-30ed-4783-b0d7-943bf7729928 None admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:48.063604 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb317a-30ed-4783-b0d7-943bf7729928 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:48.063891 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb317a-30ed-4783-b0d7-943bf7729928 None admin] PATH_INFO: `/v3/projects/5fcfe56fb9bf4cc7b15db190133a1d28/users/f5967d9641344da186ff23b8711ba0d8/roles/702e5e78b5d744529384b96a390ae92f` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:48.066021 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bb317a-30ed-4783-b0d7-943bf7729928 None admin] RBAC: Authorizing `identity:create_grant(project_id=5fcfe56fb9bf4cc7b15db190133a1d28, user_id=f5967d9641344da186ff23b8711ba0d8, role_id=702e5e78b5d744529384b96a390ae92f)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:48.067535 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bb317a-30ed-4783-b0d7-943bf7729928 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:48.077287 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 69/136] 10.222.0.43 () {58 vars in 1439 bytes} [Mon Apr 11 16:21:47 2022] PUT /identity/v3/projects/e5b41ef7f603454f9573712ab5b7f00e/users/8017d78c60f04cb48bc6bb22afc32115/roles/0d41da7bec094450b5bff4e4831be52c => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:21:48.078492 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaedfc2-002b-4840-889e-133f87b8275f None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:48.083655 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaedfc2-002b-4840-889e-133f87b8275f None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:48.083655 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaedfc2-002b-4840-889e-133f87b8275f None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:48.083655 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 70/137] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:21:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:21:48.088011 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c578ee3-ba3f-494b-a1f3-af06b7e74098 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:48.088312 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c578ee3-ba3f-494b-a1f3-af06b7e74098 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:48.088601 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c578ee3-ba3f-494b-a1f3-af06b7e74098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:48.108545 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-7c578ee3-ba3f-494b-a1f3-af06b7e74098 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:21:48.109869 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-7c578ee3-ba3f-494b-a1f3-af06b7e74098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:21:48.169669 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 68/138] 10.222.0.43 () {58 vars in 1439 bytes} [Mon Apr 11 16:21:47 2022] PUT /identity/v3/projects/5fcfe56fb9bf4cc7b15db190133a1d28/users/f5967d9641344da186ff23b8711ba0d8/roles/702e5e78b5d744529384b96a390ae92f => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:21:48.205004 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 71/139] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:21:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 16:21:48.234602 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bb317a-30ed-4783-b0d7-943bf7729928 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:48.362045 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bb317a-30ed-4783-b0d7-943bf7729928 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:48.400569 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5094ce-204d-4ac5-977d-f4337de949cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:48.401403 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5094ce-204d-4ac5-977d-f4337de949cd None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:48.401690 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5094ce-204d-4ac5-977d-f4337de949cd None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:48.401969 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5094ce-204d-4ac5-977d-f4337de949cd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:48.403203 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5094ce-204d-4ac5-977d-f4337de949cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:48.404708 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5094ce-204d-4ac5-977d-f4337de949cd None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:48.406385 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 69/140] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:21:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:21:48.412007 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c578ee3-ba3f-494b-a1f3-af06b7e74098 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:48.531756 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c578ee3-ba3f-494b-a1f3-af06b7e74098 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:48.579588 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b65d10-6467-4bc8-aa1f-7b8abaf69eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:48.580287 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b65d10-6467-4bc8-aa1f-7b8abaf69eec None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:48.580577 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b65d10-6467-4bc8-aa1f-7b8abaf69eec None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:48.580858 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b65d10-6467-4bc8-aa1f-7b8abaf69eec None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:48.581591 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b65d10-6467-4bc8-aa1f-7b8abaf69eec None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:48.583120 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b65d10-6467-4bc8-aa1f-7b8abaf69eec None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:48.704841 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 72/141] 10.222.0.43 () {60 vars in 1132 bytes} [Mon Apr 11 16:21:48 2022] POST /identity/v3/users => generated 283 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:21:49.255718 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d384ced-a7bb-4b1a-b39b-9d91c8d32d36 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:49.256283 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d384ced-a7bb-4b1a-b39b-9d91c8d32d36 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:49.256570 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d384ced-a7bb-4b1a-b39b-9d91c8d32d36 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:49.257987 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 70/142] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:21:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:21:49.265989 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabdc7f6-5b5c-4161-80fd-83164223d114 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:49.265989 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabdc7f6-5b5c-4161-80fd-83164223d114 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:49.265989 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabdc7f6-5b5c-4161-80fd-83164223d114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:49.283670 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-cabdc7f6-5b5c-4161-80fd-83164223d114 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:21:49.285179 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-cabdc7f6-5b5c-4161-80fd-83164223d114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:21:49.353131 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 73/143] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:21:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:21:49.376678 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d384ced-a7bb-4b1a-b39b-9d91c8d32d36 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:49.487508 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d384ced-a7bb-4b1a-b39b-9d91c8d32d36 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:49.525547 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dc1b72-f465-4b04-b297-54c3afb71d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:49.526286 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc1b72-f465-4b04-b297-54c3afb71d84 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:49.526576 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc1b72-f465-4b04-b297-54c3afb71d84 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:49.526858 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc1b72-f465-4b04-b297-54c3afb71d84 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:49.540001 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dc1b72-f465-4b04-b297-54c3afb71d84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:21:49.547412 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-40dc1b72-f465-4b04-b297-54c3afb71d84 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 11 16:21:49.553426 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 71/144] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Apr 11 16:21:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:21:49.556340 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabdc7f6-5b5c-4161-80fd-83164223d114 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:49.663787 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabdc7f6-5b5c-4161-80fd-83164223d114 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:49.700855 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf1fe70-73b4-49d5-ab48-65fb965a7ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:49.701542 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf1fe70-73b4-49d5-ab48-65fb965a7ed7 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:49.701829 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf1fe70-73b4-49d5-ab48-65fb965a7ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:49.702109 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf1fe70-73b4-49d5-ab48-65fb965a7ed7 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:49.702871 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf1fe70-73b4-49d5-ab48-65fb965a7ed7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:21:49.703188 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf1fe70-73b4-49d5-ab48-65fb965a7ed7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:49.704625 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf1fe70-73b4-49d5-ab48-65fb965a7ed7 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:49.715230 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 74/145] 10.222.0.43 () {56 vars in 1101 bytes} [Mon Apr 11 16:21:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:21:49.722265 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dc1b72-f465-4b04-b297-54c3afb71d84 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:49.833384 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dc1b72-f465-4b04-b297-54c3afb71d84 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:49.867877 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76f3942-63f6-4727-962e-a5ed5d069587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:49.868781 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f3942-63f6-4727-962e-a5ed5d069587 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:49.869068 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f3942-63f6-4727-962e-a5ed5d069587 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:49.869350 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f3942-63f6-4727-962e-a5ed5d069587 None admin] PATH_INFO: `/v3/users/7b102f3f97764644a5c9439eccea7def` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:49.870595 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76f3942-63f6-4727-962e-a5ed5d069587 None admin] RBAC: Authorizing `identity:get_user(user_id=7b102f3f97764644a5c9439eccea7def)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:49.872098 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76f3942-63f6-4727-962e-a5ed5d069587 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:49.873970 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 72/146] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Apr 11 16:21:49 2022] GET /identity/v3/users/7b102f3f97764644a5c9439eccea7def => generated 289 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:21:49.879853 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf1fe70-73b4-49d5-ab48-65fb965a7ed7 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:49.919663 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02688a49-8887-41bf-812b-8f2ecdf0c7db None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:49.919955 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02688a49-8887-41bf-812b-8f2ecdf0c7db None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:49.920231 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02688a49-8887-41bf-812b-8f2ecdf0c7db None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:49.921612 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 73/147] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:21:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 16:21:49.926637 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb1174-100b-4d45-bbc5-9f07554a1a55 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:49.926929 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb1174-100b-4d45-bbc5-9f07554a1a55 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:49.927215 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb1174-100b-4d45-bbc5-9f07554a1a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:49.946196 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-b1fb1174-100b-4d45-bbc5-9f07554a1a55 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:21:49.947422 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-b1fb1174-100b-4d45-bbc5-9f07554a1a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:21:50.025092 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 74/148] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:21:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 16:21:50.051426 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb1174-100b-4d45-bbc5-9f07554a1a55 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:50.054589 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf1fe70-73b4-49d5-ab48-65fb965a7ed7 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:50.121609 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a038467d-5114-49d9-820a-18f445d83eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:50.122501 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a038467d-5114-49d9-820a-18f445d83eff None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:50.122787 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a038467d-5114-49d9-820a-18f445d83eff None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:50.123067 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a038467d-5114-49d9-820a-18f445d83eff None admin] PATH_INFO: `/v3/projects/5fcfe56fb9bf4cc7b15db190133a1d28` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:50.128565 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a038467d-5114-49d9-820a-18f445d83eff None admin] RBAC: Authorizing `identity:get_project(project_id=5fcfe56fb9bf4cc7b15db190133a1d28)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:50.130041 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a038467d-5114-49d9-820a-18f445d83eff None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:50.132707 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 75/149] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Apr 11 16:21:49 2022] GET /identity/v3/projects/5fcfe56fb9bf4cc7b15db190133a1d28 => generated 298 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:21:50.157043 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a038467d-5114-49d9-820a-18f445d83eff None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:50.161583 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb1174-100b-4d45-bbc5-9f07554a1a55 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:50.199382 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218d5cac-9812-426d-9a95-e832b05c8ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:50.200261 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d5cac-9812-426d-9a95-e832b05c8ef1 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:50.200553 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d5cac-9812-426d-9a95-e832b05c8ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:50.200837 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d5cac-9812-426d-9a95-e832b05c8ef1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:50.212652 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218d5cac-9812-426d-9a95-e832b05c8ef1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:21:50.220103 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-218d5cac-9812-426d-9a95-e832b05c8ef1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 16:21:50.221365 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 75/150] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Apr 11 16:21:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:21:50.227910 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218d5cac-9812-426d-9a95-e832b05c8ef1 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:50.332738 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218d5cac-9812-426d-9a95-e832b05c8ef1 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:50.368710 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e5db0-159a-4cfa-a90f-07a7fac3af8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:50.369405 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e5db0-159a-4cfa-a90f-07a7fac3af8b None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:50.369694 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e5db0-159a-4cfa-a90f-07a7fac3af8b None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:50.369982 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e5db0-159a-4cfa-a90f-07a7fac3af8b None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:50.370749 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460e5db0-159a-4cfa-a90f-07a7fac3af8b None admin] RBAC: Adding query filter params (name=member) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:21:50.371065 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460e5db0-159a-4cfa-a90f-07a7fac3af8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:50.372542 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460e5db0-159a-4cfa-a90f-07a7fac3af8b None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:50.382139 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 76/151] 10.222.0.43 () {56 vars in 1101 bytes} [Mon Apr 11 16:21:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:21:50.387761 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e5db0-159a-4cfa-a90f-07a7fac3af8b None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:50.411095 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a038467d-5114-49d9-820a-18f445d83eff None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:50.492566 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e5db0-159a-4cfa-a90f-07a7fac3af8b None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:50.512253 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0794ac-4919-4f35-94c3-e15108e15984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:50.513179 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0794ac-4919-4f35-94c3-e15108e15984 None admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:50.513468 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0794ac-4919-4f35-94c3-e15108e15984 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:50.513749 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0794ac-4919-4f35-94c3-e15108e15984 None admin] PATH_INFO: `/v3/projects/5fcfe56fb9bf4cc7b15db190133a1d28/users/7b102f3f97764644a5c9439eccea7def/roles/282780749a1d4592b823458aecfc5caf` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:50.520858 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0794ac-4919-4f35-94c3-e15108e15984 None admin] RBAC: Authorizing `identity:create_grant(project_id=5fcfe56fb9bf4cc7b15db190133a1d28, user_id=7b102f3f97764644a5c9439eccea7def, role_id=282780749a1d4592b823458aecfc5caf)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:50.522366 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0794ac-4919-4f35-94c3-e15108e15984 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:50.530608 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e9b72-fb27-408c-9799-d52750ecc566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:50.531658 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e9b72-fb27-408c-9799-d52750ecc566 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:50.532005 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e9b72-fb27-408c-9799-d52750ecc566 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:50.532290 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e9b72-fb27-408c-9799-d52750ecc566 None admin] PATH_INFO: `/v3/users/8017d78c60f04cb48bc6bb22afc32115` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:50.533568 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4e9b72-fb27-408c-9799-d52750ecc566 None admin] RBAC: Authorizing `identity:get_user(user_id=8017d78c60f04cb48bc6bb22afc32115)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:50.535048 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4e9b72-fb27-408c-9799-d52750ecc566 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:50.541382 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 77/152] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Apr 11 16:21:50 2022] GET /identity/v3/users/8017d78c60f04cb48bc6bb22afc32115 => generated 275 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:21:50.542664 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e9b72-fb27-408c-9799-d52750ecc566 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:50.648418 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e9b72-fb27-408c-9799-d52750ecc566 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:50.671753 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 76/153] 10.222.0.43 () {58 vars in 1439 bytes} [Mon Apr 11 16:21:50 2022] PUT /identity/v3/projects/5fcfe56fb9bf4cc7b15db190133a1d28/users/7b102f3f97764644a5c9439eccea7def/roles/282780749a1d4592b823458aecfc5caf => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:21:50.687472 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1551de0-50af-4883-b59e-d08b1c2f5fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:50.688176 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1551de0-50af-4883-b59e-d08b1c2f5fa2 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:50.688463 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1551de0-50af-4883-b59e-d08b1c2f5fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:50.688743 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1551de0-50af-4883-b59e-d08b1c2f5fa2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:50.765415 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1551de0-50af-4883-b59e-d08b1c2f5fa2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:50.767035 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1551de0-50af-4883-b59e-d08b1c2f5fa2 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:50.876097 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 78/154] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Apr 11 16:21:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 11 16:21:50.882844 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0794ac-4919-4f35-94c3-e15108e15984 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:50.990740 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0794ac-4919-4f35-94c3-e15108e15984 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:51.033482 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ab45b0-662b-443a-a510-822245610824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:51.034366 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab45b0-662b-443a-a510-822245610824 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:51.034657 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab45b0-662b-443a-a510-822245610824 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:51.034939 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab45b0-662b-443a-a510-822245610824 None admin] PATH_INFO: `/v3/projects/5fcfe56fb9bf4cc7b15db190133a1d28` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:51.036185 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ab45b0-662b-443a-a510-822245610824 None admin] RBAC: Authorizing `identity:get_project(project_id=5fcfe56fb9bf4cc7b15db190133a1d28)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:51.037931 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ab45b0-662b-443a-a510-822245610824 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:51.039820 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 77/155] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Apr 11 16:21:50 2022] GET /identity/v3/projects/5fcfe56fb9bf4cc7b15db190133a1d28 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:21:51.045892 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1551de0-50af-4883-b59e-d08b1c2f5fa2 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:51.174777 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1551de0-50af-4883-b59e-d08b1c2f5fa2 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:51.215531 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102c3ffc-a040-4d58-bef9-9166a6b21bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:51.216213 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c3ffc-a040-4d58-bef9-9166a6b21bc1 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:51.216501 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c3ffc-a040-4d58-bef9-9166a6b21bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:51.216782 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c3ffc-a040-4d58-bef9-9166a6b21bc1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:51.217626 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102c3ffc-a040-4d58-bef9-9166a6b21bc1 None admin] RBAC: Adding query filter params (role.id=0d41da7bec094450b5bff4e4831be52c, scope.project.id=5fcfe56fb9bf4cc7b15db190133a1d28, user.id=8017d78c60f04cb48bc6bb22afc32115) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:21:51.217941 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102c3ffc-a040-4d58-bef9-9166a6b21bc1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:51.219399 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102c3ffc-a040-4d58-bef9-9166a6b21bc1 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:51.231685 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 79/156] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Apr 11 16:21:51 2022] GET /identity/v3/role_assignments?user.id=8017d78c60f04cb48bc6bb22afc32115&scope.project.id=5fcfe56fb9bf4cc7b15db190133a1d28&role.id=0d41da7bec094450b5bff4e4831be52c => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:21:51.772226 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c421cbf2-a1d9-41e8-afdb-d2625e746ca2 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:51.772712 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c421cbf2-a1d9-41e8-afdb-d2625e746ca2 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:51.772712 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c421cbf2-a1d9-41e8-afdb-d2625e746ca2 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:51.774091 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 78/157] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:21:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:21:51.779507 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1711748-dafd-4d1c-aa05-e64e9985c9d5 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:51.779929 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1711748-dafd-4d1c-aa05-e64e9985c9d5 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:51.780093 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1711748-dafd-4d1c-aa05-e64e9985c9d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:51.800652 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-b1711748-dafd-4d1c-aa05-e64e9985c9d5 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:21:51.801924 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-b1711748-dafd-4d1c-aa05-e64e9985c9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:21:51.889824 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 80/158] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:21:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:21:51.927131 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c421cbf2-a1d9-41e8-afdb-d2625e746ca2 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:52.044336 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c421cbf2-a1d9-41e8-afdb-d2625e746ca2 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:52.089679 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4fe908-1e95-4899-84b2-32769d258057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:52.090524 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4fe908-1e95-4899-84b2-32769d258057 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:52.090819 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4fe908-1e95-4899-84b2-32769d258057 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:52.091106 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4fe908-1e95-4899-84b2-32769d258057 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:52.106405 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4fe908-1e95-4899-84b2-32769d258057 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:21:52.114365 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-1c4fe908-1e95-4899-84b2-32769d258057 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 11 16:21:52.115977 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 79/159] 10.222.0.43 () {56 vars in 1114 bytes} [Mon Apr 11 16:21:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:21:52.121924 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1711748-dafd-4d1c-aa05-e64e9985c9d5 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:52.228147 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1711748-dafd-4d1c-aa05-e64e9985c9d5 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:52.267121 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57afbfea-18da-4633-9343-71a9ebeac41b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:52.267834 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57afbfea-18da-4633-9343-71a9ebeac41b None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:52.268137 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57afbfea-18da-4633-9343-71a9ebeac41b None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:52.268402 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57afbfea-18da-4633-9343-71a9ebeac41b None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:52.269161 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57afbfea-18da-4633-9343-71a9ebeac41b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:21:52.269473 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57afbfea-18da-4633-9343-71a9ebeac41b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:52.270866 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57afbfea-18da-4633-9343-71a9ebeac41b None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:52.280404 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 81/160] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Apr 11 16:21:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:21:52.286081 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4fe908-1e95-4899-84b2-32769d258057 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:52.340288 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f9e07c-104e-4dde-9aec-6d58d255954d None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:52.340559 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f9e07c-104e-4dde-9aec-6d58d255954d None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:52.340780 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f9e07c-104e-4dde-9aec-6d58d255954d None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:52.342168 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 82/161] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:21:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 16:21:52.353059 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f8c486-7fbd-4ad3-b1f3-152d9fb970f6 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:52.353337 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f8c486-7fbd-4ad3-b1f3-152d9fb970f6 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:52.353620 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f8c486-7fbd-4ad3-b1f3-152d9fb970f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:52.385300 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-a8f8c486-7fbd-4ad3-b1f3-152d9fb970f6 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:21:52.386839 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-a8f8c486-7fbd-4ad3-b1f3-152d9fb970f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:21:52.411751 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4fe908-1e95-4899-84b2-32769d258057 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:52.450952 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a541beb-41e9-476c-a302-e11741e79353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:52.452210 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a541beb-41e9-476c-a302-e11741e79353 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:52.452693 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a541beb-41e9-476c-a302-e11741e79353 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:52.453157 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a541beb-41e9-476c-a302-e11741e79353 None admin] PATH_INFO: `/v3/users/8017d78c60f04cb48bc6bb22afc32115` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:52.454602 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a541beb-41e9-476c-a302-e11741e79353 None admin] RBAC: Authorizing `identity:get_user(user_id=8017d78c60f04cb48bc6bb22afc32115)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:52.456285 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a541beb-41e9-476c-a302-e11741e79353 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:52.458137 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 80/162] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Apr 11 16:21:52 2022] GET /identity/v3/users/8017d78c60f04cb48bc6bb22afc32115 => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:21:52.464707 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a541beb-41e9-476c-a302-e11741e79353 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:52.509611 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 83/163] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:21:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 16:21:52.562590 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c02e8-4dbe-4a9c-a7b7-407a78ba7a7e None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:52.562893 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c02e8-4dbe-4a9c-a7b7-407a78ba7a7e None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:52.563156 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c02e8-4dbe-4a9c-a7b7-407a78ba7a7e None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:52.564676 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 84/164] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:21:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 16:21:52.572428 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5c02e8-4dbe-4a9c-a7b7-407a78ba7a7e None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:52.603808 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a541beb-41e9-476c-a302-e11741e79353 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:52.648215 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a98ad83-db9f-428f-88b9-9e8d418c4b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:52.649222 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98ad83-db9f-428f-88b9-9e8d418c4b76 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:52.649698 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98ad83-db9f-428f-88b9-9e8d418c4b76 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:52.650256 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98ad83-db9f-428f-88b9-9e8d418c4b76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:52.701950 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5c02e8-4dbe-4a9c-a7b7-407a78ba7a7e None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:52.737661 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6318f8bd-12f2-4a78-95f9-eebc6c398152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:52.738472 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6318f8bd-12f2-4a78-95f9-eebc6c398152 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:52.738759 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6318f8bd-12f2-4a78-95f9-eebc6c398152 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:52.739038 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6318f8bd-12f2-4a78-95f9-eebc6c398152 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:52.761049 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6318f8bd-12f2-4a78-95f9-eebc6c398152 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:21:52.769330 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-6318f8bd-12f2-4a78-95f9-eebc6c398152 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 16:21:52.771531 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 85/165] 10.222.0.43 () {56 vars in 1096 bytes} [Mon Apr 11 16:21:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:21:52.772851 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90099337-b4cd-46ae-a3ab-d52c86d25556 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:52.773152 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90099337-b4cd-46ae-a3ab-d52c86d25556 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:52.773492 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90099337-b4cd-46ae-a3ab-d52c86d25556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:52.791922 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-90099337-b4cd-46ae-a3ab-d52c86d25556 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:21:52.793409 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-90099337-b4cd-46ae-a3ab-d52c86d25556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:21:52.824420 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a98ad83-db9f-428f-88b9-9e8d418c4b76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:52.826596 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a98ad83-db9f-428f-88b9-9e8d418c4b76 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:52.863500 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 86/166] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:21:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:21:52.864390 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90099337-b4cd-46ae-a3ab-d52c86d25556 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:52.966988 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90099337-b4cd-46ae-a3ab-d52c86d25556 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:53.001200 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4d6e04-dd76-436f-b71e-c1ec932acbe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:53.001887 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d6e04-dd76-436f-b71e-c1ec932acbe2 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:53.002171 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d6e04-dd76-436f-b71e-c1ec932acbe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:53.002722 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d6e04-dd76-436f-b71e-c1ec932acbe2 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:53.003472 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4d6e04-dd76-436f-b71e-c1ec932acbe2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:21:53.003827 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4d6e04-dd76-436f-b71e-c1ec932acbe2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:53.005223 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4d6e04-dd76-436f-b71e-c1ec932acbe2 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:53.014520 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 87/167] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Apr 11 16:21:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:21:53.015550 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4d6e04-dd76-436f-b71e-c1ec932acbe2 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:53.048256 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 81/168] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Apr 11 16:21:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 584 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 11 16:21:53.049137 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a98ad83-db9f-428f-88b9-9e8d418c4b76 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:53.117798 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4d6e04-dd76-436f-b71e-c1ec932acbe2 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:53.154916 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a5800-3da7-427e-95b3-9d4d92b5d9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:53.155761 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a5800-3da7-427e-95b3-9d4d92b5d9cd None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:53.156051 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a5800-3da7-427e-95b3-9d4d92b5d9cd None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:53.156331 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a5800-3da7-427e-95b3-9d4d92b5d9cd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:53.167389 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873a5800-3da7-427e-95b3-9d4d92b5d9cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:21:53.174546 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-873a5800-3da7-427e-95b3-9d4d92b5d9cd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 16:21:53.175794 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 88/169] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Apr 11 16:21:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:21:53.176649 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a5800-3da7-427e-95b3-9d4d92b5d9cd None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:53.279213 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a98ad83-db9f-428f-88b9-9e8d418c4b76 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:53.282493 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a5800-3da7-427e-95b3-9d4d92b5d9cd None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:53.335542 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70535dcf-ae5a-4cec-b2f7-32c7e3e489a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:53.335542 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70535dcf-ae5a-4cec-b2f7-32c7e3e489a8 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:53.335542 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70535dcf-ae5a-4cec-b2f7-32c7e3e489a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:53.335542 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70535dcf-ae5a-4cec-b2f7-32c7e3e489a8 None admin] PATH_INFO: `/v3/projects/5fcfe56fb9bf4cc7b15db190133a1d28` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:53.335933 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70535dcf-ae5a-4cec-b2f7-32c7e3e489a8 None admin] RBAC: Authorizing `identity:get_project(project_id=5fcfe56fb9bf4cc7b15db190133a1d28)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:53.335933 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70535dcf-ae5a-4cec-b2f7-32c7e3e489a8 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:53.335933 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 89/170] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Apr 11 16:21:53 2022] GET /identity/v3/projects/5fcfe56fb9bf4cc7b15db190133a1d28 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:21:53.335933 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70535dcf-ae5a-4cec-b2f7-32c7e3e489a8 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:53.372322 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc985ab7-6f09-4d52-a9fe-80fa29a732d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:53.373557 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc985ab7-6f09-4d52-a9fe-80fa29a732d4 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:53.374039 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc985ab7-6f09-4d52-a9fe-80fa29a732d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:53.374517 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc985ab7-6f09-4d52-a9fe-80fa29a732d4 None admin] PATH_INFO: `/v3/users/f5967d9641344da186ff23b8711ba0d8` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:53.376106 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc985ab7-6f09-4d52-a9fe-80fa29a732d4 None admin] RBAC: Authorizing `identity:get_user(user_id=f5967d9641344da186ff23b8711ba0d8)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:53.378078 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc985ab7-6f09-4d52-a9fe-80fa29a732d4 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:53.380088 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 82/171] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Apr 11 16:21:53 2022] GET /identity/v3/users/f5967d9641344da186ff23b8711ba0d8 => generated 247 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:21:53.381145 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc985ab7-6f09-4d52-a9fe-80fa29a732d4 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:53.439796 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70535dcf-ae5a-4cec-b2f7-32c7e3e489a8 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:53.475496 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95956d8-0eca-439e-bc12-7b8ba7e0139c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:53.476208 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95956d8-0eca-439e-bc12-7b8ba7e0139c None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:53.476542 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95956d8-0eca-439e-bc12-7b8ba7e0139c None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:53.476826 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95956d8-0eca-439e-bc12-7b8ba7e0139c None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:53.477587 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95956d8-0eca-439e-bc12-7b8ba7e0139c None admin] RBAC: Adding query filter params (name=member) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:21:53.477899 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95956d8-0eca-439e-bc12-7b8ba7e0139c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:53.479274 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95956d8-0eca-439e-bc12-7b8ba7e0139c None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:53.488419 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 90/172] 10.222.0.43 () {56 vars in 1101 bytes} [Mon Apr 11 16:21:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:21:53.489320 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95956d8-0eca-439e-bc12-7b8ba7e0139c None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:53.592237 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95956d8-0eca-439e-bc12-7b8ba7e0139c None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:53.617812 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc985ab7-6f09-4d52-a9fe-80fa29a732d4 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:53.627084 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8a4bdd-3012-42a9-b638-ce9c4b5c4cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:53.628289 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a4bdd-3012-42a9-b638-ce9c4b5c4cc9 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:53.628723 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a4bdd-3012-42a9-b638-ce9c4b5c4cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:53.629173 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a4bdd-3012-42a9-b638-ce9c4b5c4cc9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:53.683282 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062ba9b2-8b6e-491a-92ae-c342e723f467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:53.683986 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ba9b2-8b6e-491a-92ae-c342e723f467 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:53.684364 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ba9b2-8b6e-491a-92ae-c342e723f467 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:53.684553 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ba9b2-8b6e-491a-92ae-c342e723f467 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:53.685397 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062ba9b2-8b6e-491a-92ae-c342e723f467 None admin] RBAC: Adding query filter params (role.id=7d3d5d04ca634b3a9b63e7b05bb5d333, scope.project.id=5fcfe56fb9bf4cc7b15db190133a1d28, user.id=8017d78c60f04cb48bc6bb22afc32115) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:21:53.685714 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062ba9b2-8b6e-491a-92ae-c342e723f467 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:53.687360 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062ba9b2-8b6e-491a-92ae-c342e723f467 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:53.702596 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 83/173] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Apr 11 16:21:53 2022] GET /identity/v3/role_assignments?user.id=8017d78c60f04cb48bc6bb22afc32115&scope.project.id=5fcfe56fb9bf4cc7b15db190133a1d28&role.id=7d3d5d04ca634b3a9b63e7b05bb5d333 => generated 608 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:21:53.703452 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062ba9b2-8b6e-491a-92ae-c342e723f467 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:53.707560 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8a4bdd-3012-42a9-b638-ce9c4b5c4cc9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:53.710214 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8a4bdd-3012-42a9-b638-ce9c4b5c4cc9 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:53.816176 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 91/174] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Apr 11 16:21:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 16:21:53.826870 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8a4bdd-3012-42a9-b638-ce9c4b5c4cc9 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:53.896951 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062ba9b2-8b6e-491a-92ae-c342e723f467 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:53.968788 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac24ce-f5eb-43b5-a057-3f0fb476dd71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:53.969702 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac24ce-f5eb-43b5-a057-3f0fb476dd71 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:53.969995 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac24ce-f5eb-43b5-a057-3f0fb476dd71 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:53.970272 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac24ce-f5eb-43b5-a057-3f0fb476dd71 None admin] PATH_INFO: `/v3/users/8017d78c60f04cb48bc6bb22afc32115` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:53.971568 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ac24ce-f5eb-43b5-a057-3f0fb476dd71 None admin] RBAC: Authorizing `identity:get_user(user_id=8017d78c60f04cb48bc6bb22afc32115)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:53.973321 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ac24ce-f5eb-43b5-a057-3f0fb476dd71 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:53.976513 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 84/175] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Apr 11 16:21:53 2022] GET /identity/v3/users/8017d78c60f04cb48bc6bb22afc32115 => generated 275 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:21:53.977867 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6059fbbc-9e2a-413a-996d-bcbefb7d84ce None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:53.978160 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6059fbbc-9e2a-413a-996d-bcbefb7d84ce None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:53.978438 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6059fbbc-9e2a-413a-996d-bcbefb7d84ce None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:53.984473 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 85/176] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:21:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:21:53.991248 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff03413-59fa-4903-8718-0e6c42af483e None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:53.991749 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff03413-59fa-4903-8718-0e6c42af483e None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:53.992444 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff03413-59fa-4903-8718-0e6c42af483e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:54.001260 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8a4bdd-3012-42a9-b638-ce9c4b5c4cc9 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:54.025958 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-8ff03413-59fa-4903-8718-0e6c42af483e None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:21:54.027285 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-8ff03413-59fa-4903-8718-0e6c42af483e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:21:54.045479 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fb96ae-eb97-4e5d-a801-722fb8a603fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:54.046610 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb96ae-eb97-4e5d-a801-722fb8a603fa None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:54.047055 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb96ae-eb97-4e5d-a801-722fb8a603fa None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:54.047469 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb96ae-eb97-4e5d-a801-722fb8a603fa None admin] PATH_INFO: `/v3/projects/5fcfe56fb9bf4cc7b15db190133a1d28` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:54.050251 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fb96ae-eb97-4e5d-a801-722fb8a603fa None admin] RBAC: Authorizing `identity:get_project(project_id=5fcfe56fb9bf4cc7b15db190133a1d28)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:54.052904 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fb96ae-eb97-4e5d-a801-722fb8a603fa None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:54.057708 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 92/177] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Apr 11 16:21:53 2022] GET /identity/v3/projects/5fcfe56fb9bf4cc7b15db190133a1d28 => generated 298 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:21:54.059750 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fb96ae-eb97-4e5d-a801-722fb8a603fa None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:54.161472 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 86/178] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:21:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 16:21:54.162828 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff03413-59fa-4903-8718-0e6c42af483e None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:54.193964 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fb96ae-eb97-4e5d-a801-722fb8a603fa None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:54.253328 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b366f-666b-4737-be83-f25840819ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:54.254071 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b366f-666b-4737-be83-f25840819ac5 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:54.254359 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b366f-666b-4737-be83-f25840819ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:54.254689 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b366f-666b-4737-be83-f25840819ac5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:54.271396 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff03413-59fa-4903-8718-0e6c42af483e None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:54.316250 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8195c09e-4cb1-4b36-b5b5-b1de35f4b76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:54.316928 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195c09e-4cb1-4b36-b5b5-b1de35f4b76b None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:54.317211 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195c09e-4cb1-4b36-b5b5-b1de35f4b76b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:54.317487 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195c09e-4cb1-4b36-b5b5-b1de35f4b76b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:54.318660 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8195c09e-4cb1-4b36-b5b5-b1de35f4b76b None admin] RBAC: Adding query filter params (role.id=702e5e78b5d744529384b96a390ae92f, scope.project.id=5fcfe56fb9bf4cc7b15db190133a1d28, user.id=f5967d9641344da186ff23b8711ba0d8) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:21:54.318983 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8195c09e-4cb1-4b36-b5b5-b1de35f4b76b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:54.320497 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8195c09e-4cb1-4b36-b5b5-b1de35f4b76b None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:54.326699 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 87/179] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Apr 11 16:21:54 2022] GET /identity/v3/role_assignments?user.id=f5967d9641344da186ff23b8711ba0d8&scope.project.id=5fcfe56fb9bf4cc7b15db190133a1d28&role.id=702e5e78b5d744529384b96a390ae92f => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:21:54.327499 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8195c09e-4cb1-4b36-b5b5-b1de35f4b76b None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:54.343129 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6b366f-666b-4737-be83-f25840819ac5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:54.344649 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6b366f-666b-4737-be83-f25840819ac5 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:54.460866 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 93/180] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Apr 11 16:21:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 16:21:54.469198 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b366f-666b-4737-be83-f25840819ac5 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:54.497384 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8195c09e-4cb1-4b36-b5b5-b1de35f4b76b None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:54.572337 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f32f93-5110-4f47-92a0-6113264afff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:54.573243 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f32f93-5110-4f47-92a0-6113264afff4 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:54.574036 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f32f93-5110-4f47-92a0-6113264afff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:54.574036 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f32f93-5110-4f47-92a0-6113264afff4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:54.601154 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f32f93-5110-4f47-92a0-6113264afff4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:21:54.613016 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-03f32f93-5110-4f47-92a0-6113264afff4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 16:21:54.614567 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 88/181] 10.222.0.43 () {56 vars in 1096 bytes} [Mon Apr 11 16:21:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:21:54.624604 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f32f93-5110-4f47-92a0-6113264afff4 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:54.633430 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b366f-666b-4737-be83-f25840819ac5 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:54.675281 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb97db2-e919-412c-8f89-be7e6e3ce982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:54.676641 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb97db2-e919-412c-8f89-be7e6e3ce982 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:54.677745 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb97db2-e919-412c-8f89-be7e6e3ce982 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:54.678246 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb97db2-e919-412c-8f89-be7e6e3ce982 None admin] PATH_INFO: `/v3/projects/e5b41ef7f603454f9573712ab5b7f00e` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:54.682753 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb97db2-e919-412c-8f89-be7e6e3ce982 None admin] RBAC: Authorizing `identity:get_project(project_id=e5b41ef7f603454f9573712ab5b7f00e)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:54.684554 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb97db2-e919-412c-8f89-be7e6e3ce982 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:54.686533 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 94/182] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Apr 11 16:21:54 2022] GET /identity/v3/projects/e5b41ef7f603454f9573712ab5b7f00e => generated 312 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:21:54.692368 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb97db2-e919-412c-8f89-be7e6e3ce982 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:54.808325 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f32f93-5110-4f47-92a0-6113264afff4 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:54.818259 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb97db2-e919-412c-8f89-be7e6e3ce982 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:54.842494 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184c6946-1fb4-4e0b-b7dd-47f2443a30de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:54.843179 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c6946-1fb4-4e0b-b7dd-47f2443a30de None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:54.843498 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c6946-1fb4-4e0b-b7dd-47f2443a30de None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:54.843790 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c6946-1fb4-4e0b-b7dd-47f2443a30de None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:54.844552 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184c6946-1fb4-4e0b-b7dd-47f2443a30de None admin] RBAC: Adding query filter params (name=admin) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:21:54.844862 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184c6946-1fb4-4e0b-b7dd-47f2443a30de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:54.846455 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184c6946-1fb4-4e0b-b7dd-47f2443a30de None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:54.856825 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 89/183] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Apr 11 16:21:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:21:54.858147 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23dfadc-b7ed-4032-a551-8fa940df379e None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:54.858439 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23dfadc-b7ed-4032-a551-8fa940df379e None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:54.858716 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23dfadc-b7ed-4032-a551-8fa940df379e None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:54.864176 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 90/184] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:21:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:21:54.866041 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23dfadc-b7ed-4032-a551-8fa940df379e None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:54.869973 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3542bcd5-655c-4635-b509-a6e5ae21e493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:54.870656 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3542bcd5-655c-4635-b509-a6e5ae21e493 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:54.870986 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3542bcd5-655c-4635-b509-a6e5ae21e493 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:54.871272 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3542bcd5-655c-4635-b509-a6e5ae21e493 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:54.872161 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3542bcd5-655c-4635-b509-a6e5ae21e493 None admin] RBAC: Adding query filter params (role.id=0d41da7bec094450b5bff4e4831be52c, scope.project.id=e5b41ef7f603454f9573712ab5b7f00e, user.id=8017d78c60f04cb48bc6bb22afc32115) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:21:54.873410 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3542bcd5-655c-4635-b509-a6e5ae21e493 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:54.874948 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3542bcd5-655c-4635-b509-a6e5ae21e493 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:54.887542 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 95/185] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Apr 11 16:21:54 2022] GET /identity/v3/role_assignments?user.id=8017d78c60f04cb48bc6bb22afc32115&scope.project.id=e5b41ef7f603454f9573712ab5b7f00e&role.id=0d41da7bec094450b5bff4e4831be52c => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:21:54.887542 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffa5ab-ec28-4c19-9010-6bd365eb1a4e None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:54.887542 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffa5ab-ec28-4c19-9010-6bd365eb1a4e None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:54.887542 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffa5ab-ec28-4c19-9010-6bd365eb1a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:54.925702 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-9bffa5ab-ec28-4c19-9010-6bd365eb1a4e None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:21:54.930553 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-9bffa5ab-ec28-4c19-9010-6bd365eb1a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:21:55.054951 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 96/186] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:21:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:21:55.058017 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bbbc08-f8ba-437c-bbe0-8ef83cdd62a2 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:55.058319 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bbbc08-f8ba-437c-bbe0-8ef83cdd62a2 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:55.058622 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bbbc08-f8ba-437c-bbe0-8ef83cdd62a2 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:55.060258 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 97/187] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:21:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:21:55.069748 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e7256-0d1a-413b-bb3a-fb03902a5e44 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:55.070496 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e7256-0d1a-413b-bb3a-fb03902a5e44 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:55.071304 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23dfadc-b7ed-4032-a551-8fa940df379e None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:55.072836 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e7256-0d1a-413b-bb3a-fb03902a5e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:55.097795 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-3c3e7256-0d1a-413b-bb3a-fb03902a5e44 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:21:55.099723 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-3c3e7256-0d1a-413b-bb3a-fb03902a5e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:21:55.120192 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328a06db-67d2-4337-ae2f-abf076915533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:55.121089 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a06db-67d2-4337-ae2f-abf076915533 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:55.121376 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a06db-67d2-4337-ae2f-abf076915533 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:55.121650 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a06db-67d2-4337-ae2f-abf076915533 None admin] PATH_INFO: `/v3/users/6cd3e7b23740492aa3ce8da932cfee99` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:55.135941 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328a06db-67d2-4337-ae2f-abf076915533 None admin] RBAC: Authorizing `identity:get_user(user_id=6cd3e7b23740492aa3ce8da932cfee99)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:55.137395 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328a06db-67d2-4337-ae2f-abf076915533 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:55.139100 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 91/188] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Apr 11 16:21:54 2022] GET /identity/v3/users/6cd3e7b23740492aa3ce8da932cfee99 => generated 283 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:21:55.142519 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328a06db-67d2-4337-ae2f-abf076915533 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:55.180664 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 98/189] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:21:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:21:55.182021 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ec70c-e850-40cc-b4c1-121897bfd7a3 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:55.182314 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ec70c-e850-40cc-b4c1-121897bfd7a3 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:55.182591 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ec70c-e850-40cc-b4c1-121897bfd7a3 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:55.187890 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 99/190] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:21:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:21:55.187890 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41ec70c-e850-40cc-b4c1-121897bfd7a3 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:55.244432 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328a06db-67d2-4337-ae2f-abf076915533 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:55.277017 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5400c238-9581-49e1-a787-380b1962b0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:55.277818 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5400c238-9581-49e1-a787-380b1962b0d7 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:55.278099 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5400c238-9581-49e1-a787-380b1962b0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:55.278376 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5400c238-9581-49e1-a787-380b1962b0d7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:55.282328 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41ec70c-e850-40cc-b4c1-121897bfd7a3 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:55.288430 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5400c238-9581-49e1-a787-380b1962b0d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:21:55.296180 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-5400c238-9581-49e1-a787-380b1962b0d7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 11 16:21:55.297384 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 92/191] 10.222.0.43 () {56 vars in 1114 bytes} [Mon Apr 11 16:21:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:21:55.298545 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac4244-84d5-4a6e-935a-59d9a0a097fb None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:55.298832 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac4244-84d5-4a6e-935a-59d9a0a097fb None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:55.299106 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac4244-84d5-4a6e-935a-59d9a0a097fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:55.315198 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-b8ac4244-84d5-4a6e-935a-59d9a0a097fb None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:21:55.316180 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0523af-a6f7-4482-9010-b1320c001144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:55.316323 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b8ac4244-84d5-4a6e-935a-59d9a0a097fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:21:55.316836 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0523af-a6f7-4482-9010-b1320c001144 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:55.317120 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0523af-a6f7-4482-9010-b1320c001144 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:55.317981 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0523af-a6f7-4482-9010-b1320c001144 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:55.379265 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 93/192] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:21:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:21:55.391702 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ac4244-84d5-4a6e-935a-59d9a0a097fb None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:55.391787 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0523af-a6f7-4482-9010-b1320c001144 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:55.391787 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0523af-a6f7-4482-9010-b1320c001144 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:55.476879 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ac4244-84d5-4a6e-935a-59d9a0a097fb None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:55.479676 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 100/193] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Apr 11 16:21:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 16:21:55.484400 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0523af-a6f7-4482-9010-b1320c001144 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:55.510390 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8b7b90-c2ca-4349-84f0-2321c126d191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:55.511200 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b7b90-c2ca-4349-84f0-2321c126d191 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:55.511482 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b7b90-c2ca-4349-84f0-2321c126d191 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:55.511777 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b7b90-c2ca-4349-84f0-2321c126d191 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:55.522326 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8b7b90-c2ca-4349-84f0-2321c126d191 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:21:55.529376 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-7c8b7b90-c2ca-4349-84f0-2321c126d191 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 11 16:21:55.532669 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 94/194] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Apr 11 16:21:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:21:55.532669 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8b7b90-c2ca-4349-84f0-2321c126d191 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:55.579891 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0523af-a6f7-4482-9010-b1320c001144 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:55.612359 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bf27f2-50bc-4d93-b58b-ef58940c4d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:55.613026 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf27f2-50bc-4d93-b58b-ef58940c4d09 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:55.613308 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf27f2-50bc-4d93-b58b-ef58940c4d09 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:55.613581 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf27f2-50bc-4d93-b58b-ef58940c4d09 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:55.614424 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bf27f2-50bc-4d93-b58b-ef58940c4d09 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:21:55.614936 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bf27f2-50bc-4d93-b58b-ef58940c4d09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:55.616337 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bf27f2-50bc-4d93-b58b-ef58940c4d09 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:55.623942 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 101/195] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Apr 11 16:21:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:21:55.624790 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bf27f2-50bc-4d93-b58b-ef58940c4d09 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:55.625314 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8b7b90-c2ca-4349-84f0-2321c126d191 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:55.658050 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fdfad0-015c-4027-8cb8-c44e5bf37edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:55.658840 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fdfad0-015c-4027-8cb8-c44e5bf37edc None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:55.659126 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fdfad0-015c-4027-8cb8-c44e5bf37edc None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:55.659402 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fdfad0-015c-4027-8cb8-c44e5bf37edc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:55.660615 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fdfad0-015c-4027-8cb8-c44e5bf37edc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:55.662598 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fdfad0-015c-4027-8cb8-c44e5bf37edc None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:55.664239 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 95/196] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:21:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:21:55.668377 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fdfad0-015c-4027-8cb8-c44e5bf37edc None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:55.721883 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bf27f2-50bc-4d93-b58b-ef58940c4d09 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:55.755693 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e15773-9c23-4bd3-adad-320f0be029c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:55.756612 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e15773-9c23-4bd3-adad-320f0be029c4 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:55.756897 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e15773-9c23-4bd3-adad-320f0be029c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:55.757171 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e15773-9c23-4bd3-adad-320f0be029c4 None admin] PATH_INFO: `/v3/projects/3ed98a96ee294394baa1187f4c99252f` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:55.758361 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e15773-9c23-4bd3-adad-320f0be029c4 None admin] RBAC: Authorizing `identity:get_project(project_id=3ed98a96ee294394baa1187f4c99252f)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:55.759852 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e15773-9c23-4bd3-adad-320f0be029c4 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:55.761542 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 102/197] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Apr 11 16:21:55 2022] GET /identity/v3/projects/3ed98a96ee294394baa1187f4c99252f => generated 302 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:21:55.762296 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e15773-9c23-4bd3-adad-320f0be029c4 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:55.762398 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fdfad0-015c-4027-8cb8-c44e5bf37edc None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:55.793952 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0428935b-07f6-4545-838a-02bd17a509c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:55.794633 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428935b-07f6-4545-838a-02bd17a509c2 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:55.794918 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428935b-07f6-4545-838a-02bd17a509c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:55.795198 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428935b-07f6-4545-838a-02bd17a509c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:55.795992 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0428935b-07f6-4545-838a-02bd17a509c2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:21:55.796301 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0428935b-07f6-4545-838a-02bd17a509c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:55.797671 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0428935b-07f6-4545-838a-02bd17a509c2 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:55.806147 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 96/198] 10.222.0.43 () {56 vars in 1101 bytes} [Mon Apr 11 16:21:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:21:55.806147 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0428935b-07f6-4545-838a-02bd17a509c2 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:55.868735 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e15773-9c23-4bd3-adad-320f0be029c4 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:55.901586 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0ea9c7-fcfd-424c-b339-1da16835f52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:55.902463 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ea9c7-fcfd-424c-b339-1da16835f52f None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:55.902742 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ea9c7-fcfd-424c-b339-1da16835f52f None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:55.903010 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ea9c7-fcfd-424c-b339-1da16835f52f None admin] PATH_INFO: `/v3/users/6cd3e7b23740492aa3ce8da932cfee99` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:55.904218 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0ea9c7-fcfd-424c-b339-1da16835f52f None admin] RBAC: Authorizing `identity:get_user(user_id=6cd3e7b23740492aa3ce8da932cfee99)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:55.905668 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0ea9c7-fcfd-424c-b339-1da16835f52f None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:55.907277 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 103/199] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Apr 11 16:21:55 2022] GET /identity/v3/users/6cd3e7b23740492aa3ce8da932cfee99 => generated 283 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:21:55.912412 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0ea9c7-fcfd-424c-b339-1da16835f52f None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:55.912493 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0428935b-07f6-4545-838a-02bd17a509c2 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:55.942485 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656be20b-4ac0-4d59-824e-93d0132bf91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:55.943161 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656be20b-4ac0-4d59-824e-93d0132bf91e None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:55.943442 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656be20b-4ac0-4d59-824e-93d0132bf91e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:55.943753 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656be20b-4ac0-4d59-824e-93d0132bf91e None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:55.944469 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656be20b-4ac0-4d59-824e-93d0132bf91e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:55.945917 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656be20b-4ac0-4d59-824e-93d0132bf91e None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:56.002457 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0ea9c7-fcfd-424c-b339-1da16835f52f None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:56.027305 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 97/200] 10.222.0.43 () {60 vars in 1132 bytes} [Mon Apr 11 16:21:55 2022] POST /identity/v3/users => generated 297 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:21:56.028153 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656be20b-4ac0-4d59-824e-93d0132bf91e None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:56.034437 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2379647-3f0e-4038-9eeb-988fda54325a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:56.035122 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2379647-3f0e-4038-9eeb-988fda54325a None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:56.035410 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2379647-3f0e-4038-9eeb-988fda54325a None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:56.035729 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2379647-3f0e-4038-9eeb-988fda54325a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:56.037720 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2379647-3f0e-4038-9eeb-988fda54325a None admin] RBAC: Adding query filter params (role.id=702e5e78b5d744529384b96a390ae92f, scope.project.id=3ed98a96ee294394baa1187f4c99252f, user.id=6cd3e7b23740492aa3ce8da932cfee99) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:21:56.038041 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2379647-3f0e-4038-9eeb-988fda54325a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:56.039668 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2379647-3f0e-4038-9eeb-988fda54325a None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:56.045769 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 104/201] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Apr 11 16:21:55 2022] GET /identity/v3/role_assignments?user.id=6cd3e7b23740492aa3ce8da932cfee99&scope.project.id=3ed98a96ee294394baa1187f4c99252f&role.id=702e5e78b5d744529384b96a390ae92f => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:21:56.046661 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2379647-3f0e-4038-9eeb-988fda54325a None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:56.184536 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2379647-3f0e-4038-9eeb-988fda54325a None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:56.195747 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656be20b-4ac0-4d59-824e-93d0132bf91e None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:56.226229 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e82812-0be5-40ea-9de9-0cca865da477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:56.227294 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e82812-0be5-40ea-9de9-0cca865da477 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:56.227809 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e82812-0be5-40ea-9de9-0cca865da477 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:56.228273 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e82812-0be5-40ea-9de9-0cca865da477 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:56.238137 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ce5053-aabd-4e11-aa5e-4d06ed1e2e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:56.239050 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce5053-aabd-4e11-aa5e-4d06ed1e2e13 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:56.240060 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce5053-aabd-4e11-aa5e-4d06ed1e2e13 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:56.241029 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce5053-aabd-4e11-aa5e-4d06ed1e2e13 None admin] PATH_INFO: `/v3/users/7b102f3f97764644a5c9439eccea7def` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:56.242198 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ce5053-aabd-4e11-aa5e-4d06ed1e2e13 None admin] RBAC: Authorizing `identity:get_user(user_id=7b102f3f97764644a5c9439eccea7def)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:56.243756 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ce5053-aabd-4e11-aa5e-4d06ed1e2e13 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:56.245691 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 98/202] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Apr 11 16:21:56 2022] GET /identity/v3/users/7b102f3f97764644a5c9439eccea7def => generated 289 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:21:56.251004 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ce5053-aabd-4e11-aa5e-4d06ed1e2e13 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:56.324110 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e82812-0be5-40ea-9de9-0cca865da477 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:56.325600 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e82812-0be5-40ea-9de9-0cca865da477 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:56.386684 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ce5053-aabd-4e11-aa5e-4d06ed1e2e13 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:56.435917 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6198b6a-77ff-42e6-b63d-4a397373d40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:56.436504 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6198b6a-77ff-42e6-b63d-4a397373d40c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:56.436787 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6198b6a-77ff-42e6-b63d-4a397373d40c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:56.437063 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6198b6a-77ff-42e6-b63d-4a397373d40c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:56.452561 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 105/203] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Apr 11 16:21:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 16:21:56.458306 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e82812-0be5-40ea-9de9-0cca865da477 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:56.537951 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6198b6a-77ff-42e6-b63d-4a397373d40c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:56.539580 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6198b6a-77ff-42e6-b63d-4a397373d40c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:56.572671 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e82812-0be5-40ea-9de9-0cca865da477 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:56.622998 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f78666-af2e-4b40-9a5b-a25b3e321252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:56.624313 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f78666-af2e-4b40-9a5b-a25b3e321252 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:56.624674 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f78666-af2e-4b40-9a5b-a25b3e321252 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:56.625027 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f78666-af2e-4b40-9a5b-a25b3e321252 None admin] PATH_INFO: `/v3/projects/3ed98a96ee294394baa1187f4c99252f` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:56.626500 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f78666-af2e-4b40-9a5b-a25b3e321252 None admin] RBAC: Authorizing `identity:get_project(project_id=3ed98a96ee294394baa1187f4c99252f)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:56.628831 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f78666-af2e-4b40-9a5b-a25b3e321252 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:56.630755 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 106/204] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Apr 11 16:21:56 2022] GET /identity/v3/projects/3ed98a96ee294394baa1187f4c99252f => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:21:56.639025 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f78666-af2e-4b40-9a5b-a25b3e321252 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:56.672825 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 99/205] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Apr 11 16:21:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 11 16:21:56.681210 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6198b6a-77ff-42e6-b63d-4a397373d40c None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:56.757622 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f78666-af2e-4b40-9a5b-a25b3e321252 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:56.784248 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6198b6a-77ff-42e6-b63d-4a397373d40c None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:56.805211 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd05c13b-22ab-4d7e-822e-d5c13b347645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:56.806235 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd05c13b-22ab-4d7e-822e-d5c13b347645 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:56.806747 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd05c13b-22ab-4d7e-822e-d5c13b347645 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:56.807213 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd05c13b-22ab-4d7e-822e-d5c13b347645 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:56.808297 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd05c13b-22ab-4d7e-822e-d5c13b347645 None admin] RBAC: Adding query filter params (role.id=7d3d5d04ca634b3a9b63e7b05bb5d333, scope.project.id=3ed98a96ee294394baa1187f4c99252f, user.id=6cd3e7b23740492aa3ce8da932cfee99) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:21:56.808807 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd05c13b-22ab-4d7e-822e-d5c13b347645 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:56.810445 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd05c13b-22ab-4d7e-822e-d5c13b347645 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:56.819940 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b89fa9-f814-4e57-8744-0ebd3720ddd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:56.820851 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b89fa9-f814-4e57-8744-0ebd3720ddd7 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:56.821171 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b89fa9-f814-4e57-8744-0ebd3720ddd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:56.821536 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b89fa9-f814-4e57-8744-0ebd3720ddd7 None admin] PATH_INFO: `/v3/projects/5fcfe56fb9bf4cc7b15db190133a1d28` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:56.822738 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b89fa9-f814-4e57-8744-0ebd3720ddd7 None admin] RBAC: Authorizing `identity:get_project(project_id=5fcfe56fb9bf4cc7b15db190133a1d28)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:56.823921 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 107/206] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Apr 11 16:21:56 2022] GET /identity/v3/role_assignments?user.id=6cd3e7b23740492aa3ce8da932cfee99&scope.project.id=3ed98a96ee294394baa1187f4c99252f&role.id=7d3d5d04ca634b3a9b63e7b05bb5d333 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:21:56.827536 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b89fa9-f814-4e57-8744-0ebd3720ddd7 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:56.827536 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 100/207] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Apr 11 16:21:56 2022] GET /identity/v3/projects/5fcfe56fb9bf4cc7b15db190133a1d28 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:21:56.844928 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd05c13b-22ab-4d7e-822e-d5c13b347645 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:56.999664 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd05c13b-22ab-4d7e-822e-d5c13b347645 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:57.047408 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301739a6-4b89-4e22-ab6f-13b6f57423cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:57.048041 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301739a6-4b89-4e22-ab6f-13b6f57423cd None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:57.048326 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301739a6-4b89-4e22-ab6f-13b6f57423cd None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:57.048604 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301739a6-4b89-4e22-ab6f-13b6f57423cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:57.049443 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301739a6-4b89-4e22-ab6f-13b6f57423cd None admin] RBAC: Adding query filter params (role.id=282780749a1d4592b823458aecfc5caf, scope.project.id=5fcfe56fb9bf4cc7b15db190133a1d28, user.id=7b102f3f97764644a5c9439eccea7def) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:21:57.049754 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301739a6-4b89-4e22-ab6f-13b6f57423cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:57.051198 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301739a6-4b89-4e22-ab6f-13b6f57423cd None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:57.058060 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 108/208] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Apr 11 16:21:56 2022] GET /identity/v3/role_assignments?user.id=7b102f3f97764644a5c9439eccea7def&scope.project.id=5fcfe56fb9bf4cc7b15db190133a1d28&role.id=282780749a1d4592b823458aecfc5caf => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:21:58.720258 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdebbd5f-1b6d-4c6a-96a8-349e94117dfd None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:58.720771 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdebbd5f-1b6d-4c6a-96a8-349e94117dfd None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:58.720844 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdebbd5f-1b6d-4c6a-96a8-349e94117dfd None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:58.722549 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 101/209] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:21:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:21:58.729183 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17254a47-326e-44a0-97e7-0692b511906b None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:58.730143 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17254a47-326e-44a0-97e7-0692b511906b None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:58.730632 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17254a47-326e-44a0-97e7-0692b511906b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:58.748181 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-17254a47-326e-44a0-97e7-0692b511906b None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:21:58.749695 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-17254a47-326e-44a0-97e7-0692b511906b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:21:58.818192 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 109/210] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:21:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:21:58.841829 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdebbd5f-1b6d-4c6a-96a8-349e94117dfd None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:58.950012 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdebbd5f-1b6d-4c6a-96a8-349e94117dfd None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:58.985306 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd4876e-bdeb-4bdd-a065-3193b64dd3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:58.986454 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd4876e-bdeb-4bdd-a065-3193b64dd3d9 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:58.986955 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd4876e-bdeb-4bdd-a065-3193b64dd3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:58.987426 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd4876e-bdeb-4bdd-a065-3193b64dd3d9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:58.993392 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab08981-7996-4451-98bb-2663d276fe81 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:58.995240 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab08981-7996-4451-98bb-2663d276fe81 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:58.995240 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab08981-7996-4451-98bb-2663d276fe81 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:58.995473 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 110/211] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:21:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 16:21:59.003077 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782727ba-3166-464e-a014-88d5a2e2816a None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:59.003358 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782727ba-3166-464e-a014-88d5a2e2816a None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:59.003871 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782727ba-3166-464e-a014-88d5a2e2816a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:59.005221 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd4876e-bdeb-4bdd-a065-3193b64dd3d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:21:59.012329 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-ecd4876e-bdeb-4bdd-a065-3193b64dd3d9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 16:21:59.013841 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 102/212] 10.222.0.43 () {56 vars in 1096 bytes} [Mon Apr 11 16:21:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:21:59.019324 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd4876e-bdeb-4bdd-a065-3193b64dd3d9 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:59.022364 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-782727ba-3166-464e-a014-88d5a2e2816a None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:21:59.024633 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-782727ba-3166-464e-a014-88d5a2e2816a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:21:59.119269 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 111/213] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:21:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 16:21:59.120675 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448be8f0-8520-470c-b13d-772f07a3a7ae None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:59.120959 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448be8f0-8520-470c-b13d-772f07a3a7ae None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:59.121387 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448be8f0-8520-470c-b13d-772f07a3a7ae None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:59.123136 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 112/214] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:21:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:21:59.129000 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926a8fe-13bd-4306-8588-1651ad02e0c9 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:59.129370 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926a8fe-13bd-4306-8588-1651ad02e0c9 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:59.129657 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926a8fe-13bd-4306-8588-1651ad02e0c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:59.138908 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd4876e-bdeb-4bdd-a065-3193b64dd3d9 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:59.147487 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-5926a8fe-13bd-4306-8588-1651ad02e0c9 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:21:59.148775 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-5926a8fe-13bd-4306-8588-1651ad02e0c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:21:59.172901 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47fc8df-2fcf-42b4-8936-205ddafdf55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:59.173909 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47fc8df-2fcf-42b4-8936-205ddafdf55e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:59.174404 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47fc8df-2fcf-42b4-8936-205ddafdf55e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:59.174856 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47fc8df-2fcf-42b4-8936-205ddafdf55e None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:59.175823 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47fc8df-2fcf-42b4-8936-205ddafdf55e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:21:59.176883 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47fc8df-2fcf-42b4-8936-205ddafdf55e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:59.178433 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47fc8df-2fcf-42b4-8936-205ddafdf55e None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:59.187127 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 103/215] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Apr 11 16:21:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:21:59.187127 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47fc8df-2fcf-42b4-8936-205ddafdf55e None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:59.215051 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 113/216] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:21:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:21:59.216569 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5926a8fe-13bd-4306-8588-1651ad02e0c9 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:59.294743 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47fc8df-2fcf-42b4-8936-205ddafdf55e None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:59.317569 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5926a8fe-13bd-4306-8588-1651ad02e0c9 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:59.330282 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e89318e-051f-4b1b-9e7f-bd6952a3c1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:59.331089 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89318e-051f-4b1b-9e7f-bd6952a3c1b7 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:59.331380 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89318e-051f-4b1b-9e7f-bd6952a3c1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:59.331681 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89318e-051f-4b1b-9e7f-bd6952a3c1b7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:59.343448 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e89318e-051f-4b1b-9e7f-bd6952a3c1b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:21:59.351728 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd7a328-faab-44a4-9c7b-6bd65ffe536b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:59.351954 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-2e89318e-051f-4b1b-9e7f-bd6952a3c1b7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 16:21:59.352611 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7a328-faab-44a4-9c7b-6bd65ffe536b None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:59.352894 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7a328-faab-44a4-9c7b-6bd65ffe536b None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:59.353169 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7a328-faab-44a4-9c7b-6bd65ffe536b None admin] PATH_INFO: `/v3/users/6cd3e7b23740492aa3ce8da932cfee99` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:59.355656 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 104/217] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Apr 11 16:21:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:21:59.356474 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e89318e-051f-4b1b-9e7f-bd6952a3c1b7 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:59.358276 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd7a328-faab-44a4-9c7b-6bd65ffe536b None admin] RBAC: Authorizing `identity:get_user(user_id=6cd3e7b23740492aa3ce8da932cfee99)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:59.359738 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd7a328-faab-44a4-9c7b-6bd65ffe536b None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:59.361496 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 114/218] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Apr 11 16:21:59 2022] GET /identity/v3/users/6cd3e7b23740492aa3ce8da932cfee99 => generated 283 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:21:59.362123 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd7a328-faab-44a4-9c7b-6bd65ffe536b None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:59.458923 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd7a328-faab-44a4-9c7b-6bd65ffe536b None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:59.459900 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e89318e-051f-4b1b-9e7f-bd6952a3c1b7 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:59.491929 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd01c86b-9cd5-47c9-8443-50f39100094a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:59.492087 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdc7d56-11ef-4754-8535-d9b0b34943c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:59.492626 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc7d56-11ef-4754-8535-d9b0b34943c7 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:59.492745 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01c86b-9cd5-47c9-8443-50f39100094a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:59.492909 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc7d56-11ef-4754-8535-d9b0b34943c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:59.492994 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01c86b-9cd5-47c9-8443-50f39100094a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:59.493181 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc7d56-11ef-4754-8535-d9b0b34943c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:59.493265 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01c86b-9cd5-47c9-8443-50f39100094a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:59.493924 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdc7d56-11ef-4754-8535-d9b0b34943c7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:21:59.494226 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdc7d56-11ef-4754-8535-d9b0b34943c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:59.494496 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd01c86b-9cd5-47c9-8443-50f39100094a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:59.495610 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdc7d56-11ef-4754-8535-d9b0b34943c7 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:59.495934 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd01c86b-9cd5-47c9-8443-50f39100094a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:59.502048 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 105/219] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:21:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:21:59.502048 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd01c86b-9cd5-47c9-8443-50f39100094a None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:59.507175 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 115/220] 10.222.0.43 () {56 vars in 1101 bytes} [Mon Apr 11 16:21:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:21:59.508528 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6689dca-1180-4d45-b691-255aad72f399 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:59.508807 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6689dca-1180-4d45-b691-255aad72f399 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:59.509084 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6689dca-1180-4d45-b691-255aad72f399 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:59.512083 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 116/221] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:21:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:21:59.512083 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6689dca-1180-4d45-b691-255aad72f399 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:59.593725 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd01c86b-9cd5-47c9-8443-50f39100094a None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:59.608611 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6689dca-1180-4d45-b691-255aad72f399 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:59.625321 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8721c6-13b4-481c-ab39-41cae2245c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:59.626366 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8721c6-13b4-481c-ab39-41cae2245c81 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:59.626962 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8721c6-13b4-481c-ab39-41cae2245c81 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:59.627249 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8721c6-13b4-481c-ab39-41cae2245c81 None admin] PATH_INFO: `/v3/projects/3ed98a96ee294394baa1187f4c99252f` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:59.628610 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8721c6-13b4-481c-ab39-41cae2245c81 None admin] RBAC: Authorizing `identity:get_project(project_id=3ed98a96ee294394baa1187f4c99252f)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:59.630481 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8721c6-13b4-481c-ab39-41cae2245c81 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:59.632271 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 106/222] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Apr 11 16:21:59 2022] GET /identity/v3/projects/3ed98a96ee294394baa1187f4c99252f => generated 302 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:21:59.633029 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8721c6-13b4-481c-ab39-41cae2245c81 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:59.640655 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacf9c7b-7d2d-4d29-a148-bfce4ee05e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:59.641327 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf9c7b-7d2d-4d29-a148-bfce4ee05e8c None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:59.645497 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf9c7b-7d2d-4d29-a148-bfce4ee05e8c None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:59.645497 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf9c7b-7d2d-4d29-a148-bfce4ee05e8c None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:59.645497 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacf9c7b-7d2d-4d29-a148-bfce4ee05e8c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:59.645497 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacf9c7b-7d2d-4d29-a148-bfce4ee05e8c None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:59.736019 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8721c6-13b4-481c-ab39-41cae2245c81 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:59.767447 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb08c4-d13f-4642-8a09-3c6541afd719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:59.768333 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb08c4-d13f-4642-8a09-3c6541afd719 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:59.768613 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb08c4-d13f-4642-8a09-3c6541afd719 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:59.768883 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb08c4-d13f-4642-8a09-3c6541afd719 None admin] PATH_INFO: `/v3/users/8c5cddc0543542bd9811a3f8e2d7bb3a` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:59.781642 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeb08c4-d13f-4642-8a09-3c6541afd719 None admin] RBAC: Authorizing `identity:get_user(user_id=8c5cddc0543542bd9811a3f8e2d7bb3a)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:59.783072 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeb08c4-d13f-4642-8a09-3c6541afd719 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:21:59.784797 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 107/223] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Apr 11 16:21:59 2022] GET /identity/v3/users/8c5cddc0543542bd9811a3f8e2d7bb3a => generated 297 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:21:59.786108 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b46d35-020a-40fa-a639-7ed63274d388 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:59.786406 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b46d35-020a-40fa-a639-7ed63274d388 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:59.786697 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b46d35-020a-40fa-a639-7ed63274d388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:59.788827 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 117/224] 10.222.0.43 () {60 vars in 1132 bytes} [Mon Apr 11 16:21:59 2022] POST /identity/v3/users => generated 297 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:21:59.792472 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacf9c7b-7d2d-4d29-a148-bfce4ee05e8c None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:59.803983 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-24b46d35-020a-40fa-a639-7ed63274d388 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:21:59.805213 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-24b46d35-020a-40fa-a639-7ed63274d388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:21:59.888858 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 108/225] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:21:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:21:59.889924 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b46d35-020a-40fa-a639-7ed63274d388 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:21:59.903397 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacf9c7b-7d2d-4d29-a148-bfce4ee05e8c None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:21:59.944696 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ed5f4a-fedd-4796-a044-132a23c53218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:21:59.945622 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed5f4a-fedd-4796-a044-132a23c53218 None admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:21:59.945908 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed5f4a-fedd-4796-a044-132a23c53218 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:21:59.946187 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed5f4a-fedd-4796-a044-132a23c53218 None admin] PATH_INFO: `/v3/projects/3ed98a96ee294394baa1187f4c99252f/users/6cd3e7b23740492aa3ce8da932cfee99/roles/702e5e78b5d744529384b96a390ae92f` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:21:59.948242 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ed5f4a-fedd-4796-a044-132a23c53218 None admin] RBAC: Authorizing `identity:create_grant(project_id=3ed98a96ee294394baa1187f4c99252f, user_id=6cd3e7b23740492aa3ce8da932cfee99, role_id=702e5e78b5d744529384b96a390ae92f)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:21:59.949866 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ed5f4a-fedd-4796-a044-132a23c53218 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:00.010502 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b46d35-020a-40fa-a639-7ed63274d388 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:00.028834 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 118/226] 10.222.0.43 () {58 vars in 1439 bytes} [Mon Apr 11 16:21:59 2022] PUT /identity/v3/projects/3ed98a96ee294394baa1187f4c99252f/users/6cd3e7b23740492aa3ce8da932cfee99/roles/702e5e78b5d744529384b96a390ae92f => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:22:00.030793 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ed5f4a-fedd-4796-a044-132a23c53218 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:00.054452 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9e9fa6-c878-45b1-b56d-5c241d2bd4be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:00.055442 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e9fa6-c878-45b1-b56d-5c241d2bd4be None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:00.055937 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e9fa6-c878-45b1-b56d-5c241d2bd4be None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:00.056419 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e9fa6-c878-45b1-b56d-5c241d2bd4be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:00.151135 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9e9fa6-c878-45b1-b56d-5c241d2bd4be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:00.153113 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9e9fa6-c878-45b1-b56d-5c241d2bd4be None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:00.155130 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ed5f4a-fedd-4796-a044-132a23c53218 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:00.203452 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d245d365-5839-4e98-9818-7e02bef49323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:00.204620 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245d365-5839-4e98-9818-7e02bef49323 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:00.204900 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245d365-5839-4e98-9818-7e02bef49323 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:00.205173 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245d365-5839-4e98-9818-7e02bef49323 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:00.221264 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d245d365-5839-4e98-9818-7e02bef49323 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:22:00.231924 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-d245d365-5839-4e98-9818-7e02bef49323 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 11 16:22:00.233208 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 119/227] 10.222.0.43 () {56 vars in 1114 bytes} [Mon Apr 11 16:22:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:00.239966 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d245d365-5839-4e98-9818-7e02bef49323 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:00.265096 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 109/228] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Apr 11 16:21:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 16:22:00.271294 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9e9fa6-c878-45b1-b56d-5c241d2bd4be None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:00.342911 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d245d365-5839-4e98-9818-7e02bef49323 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:00.373166 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9e9fa6-c878-45b1-b56d-5c241d2bd4be None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:00.382608 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d843c80f-54df-47f3-b1aa-af225114b2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:00.383293 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843c80f-54df-47f3-b1aa-af225114b2b4 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:00.383596 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843c80f-54df-47f3-b1aa-af225114b2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:00.383872 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843c80f-54df-47f3-b1aa-af225114b2b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:00.384615 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d843c80f-54df-47f3-b1aa-af225114b2b4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:00.384919 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d843c80f-54df-47f3-b1aa-af225114b2b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:00.386296 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d843c80f-54df-47f3-b1aa-af225114b2b4 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:00.394883 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 120/229] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Apr 11 16:22:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:00.413968 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d843c80f-54df-47f3-b1aa-af225114b2b4 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:00.416899 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc9516-eec3-4b49-ab2a-e57111391f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:00.419108 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc9516-eec3-4b49-ab2a-e57111391f97 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:00.419397 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc9516-eec3-4b49-ab2a-e57111391f97 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:00.419706 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc9516-eec3-4b49-ab2a-e57111391f97 None admin] PATH_INFO: `/v3/projects/3ed98a96ee294394baa1187f4c99252f` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:00.421744 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cc9516-eec3-4b49-ab2a-e57111391f97 None admin] RBAC: Authorizing `identity:get_project(project_id=3ed98a96ee294394baa1187f4c99252f)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:00.424926 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cc9516-eec3-4b49-ab2a-e57111391f97 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:00.431672 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 110/230] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Apr 11 16:22:00 2022] GET /identity/v3/projects/3ed98a96ee294394baa1187f4c99252f => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:22:00.436572 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc9516-eec3-4b49-ab2a-e57111391f97 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:00.570134 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d843c80f-54df-47f3-b1aa-af225114b2b4 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:00.633019 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc9516-eec3-4b49-ab2a-e57111391f97 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:00.638199 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c29d0-0936-482e-b479-c964b652ffe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:00.639376 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c29d0-0936-482e-b479-c964b652ffe6 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:00.640958 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c29d0-0936-482e-b479-c964b652ffe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:00.647550 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c29d0-0936-482e-b479-c964b652ffe6 None admin] PATH_INFO: `/v3/users/6cd3e7b23740492aa3ce8da932cfee99` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:00.649137 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c29d0-0936-482e-b479-c964b652ffe6 None admin] RBAC: Authorizing `identity:get_user(user_id=6cd3e7b23740492aa3ce8da932cfee99)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:00.650809 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c29d0-0936-482e-b479-c964b652ffe6 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:00.652702 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 121/231] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Apr 11 16:22:00 2022] GET /identity/v3/users/6cd3e7b23740492aa3ce8da932cfee99 => generated 283 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:22:00.658205 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c29d0-0936-482e-b479-c964b652ffe6 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:00.685857 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957c7006-f147-45ab-b297-ec9969433b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:00.686942 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c7006-f147-45ab-b297-ec9969433b49 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:00.687426 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c7006-f147-45ab-b297-ec9969433b49 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:00.689193 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c7006-f147-45ab-b297-ec9969433b49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:00.690304 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957c7006-f147-45ab-b297-ec9969433b49 None admin] RBAC: Adding query filter params (role.id=0d41da7bec094450b5bff4e4831be52c, scope.project.id=3ed98a96ee294394baa1187f4c99252f, user.id=8c5cddc0543542bd9811a3f8e2d7bb3a) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:00.695906 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957c7006-f147-45ab-b297-ec9969433b49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:00.697672 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957c7006-f147-45ab-b297-ec9969433b49 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:00.709883 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 111/232] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Apr 11 16:22:00 2022] GET /identity/v3/role_assignments?user.id=8c5cddc0543542bd9811a3f8e2d7bb3a&scope.project.id=3ed98a96ee294394baa1187f4c99252f&role.id=0d41da7bec094450b5bff4e4831be52c => generated 259 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:22:00.806853 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c29d0-0936-482e-b479-c964b652ffe6 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:00.847540 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acca9c1c-03fb-4288-86b5-c25b4e2798e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:00.847540 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acca9c1c-03fb-4288-86b5-c25b4e2798e8 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:00.847875 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acca9c1c-03fb-4288-86b5-c25b4e2798e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:00.848200 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acca9c1c-03fb-4288-86b5-c25b4e2798e8 None admin] PATH_INFO: `/v3/projects/3ed98a96ee294394baa1187f4c99252f` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:00.849334 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acca9c1c-03fb-4288-86b5-c25b4e2798e8 None admin] RBAC: Authorizing `identity:get_project(project_id=3ed98a96ee294394baa1187f4c99252f)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:00.850788 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acca9c1c-03fb-4288-86b5-c25b4e2798e8 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:00.852639 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 122/233] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Apr 11 16:22:00 2022] GET /identity/v3/projects/3ed98a96ee294394baa1187f4c99252f => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:00.858673 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957c7006-f147-45ab-b297-ec9969433b49 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:01.030018 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957c7006-f147-45ab-b297-ec9969433b49 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:01.065800 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb4def1-c98a-43db-8469-8fb340be0e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:01.066758 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4def1-c98a-43db-8469-8fb340be0e49 None admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:01.067040 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4def1-c98a-43db-8469-8fb340be0e49 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:01.067318 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4def1-c98a-43db-8469-8fb340be0e49 None admin] PATH_INFO: `/v3/projects/3ed98a96ee294394baa1187f4c99252f/users/6cd3e7b23740492aa3ce8da932cfee99/roles/7d3d5d04ca634b3a9b63e7b05bb5d333` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:01.069609 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb4def1-c98a-43db-8469-8fb340be0e49 None admin] RBAC: Authorizing `identity:create_grant(project_id=3ed98a96ee294394baa1187f4c99252f, user_id=6cd3e7b23740492aa3ce8da932cfee99, role_id=7d3d5d04ca634b3a9b63e7b05bb5d333)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:01.071064 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb4def1-c98a-43db-8469-8fb340be0e49 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:01.194004 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 112/234] 10.222.0.43 () {58 vars in 1439 bytes} [Mon Apr 11 16:22:00 2022] PUT /identity/v3/projects/3ed98a96ee294394baa1187f4c99252f/users/6cd3e7b23740492aa3ce8da932cfee99/roles/7d3d5d04ca634b3a9b63e7b05bb5d333 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:22:02.921934 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb90c7b2-59e9-46e5-88e5-eb3c39cf234e None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:02.922497 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb90c7b2-59e9-46e5-88e5-eb3c39cf234e None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:02.922497 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb90c7b2-59e9-46e5-88e5-eb3c39cf234e None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:02.924275 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 123/235] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:22:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:22:02.929595 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54206afa-304f-4f30-8174-7886c7627b01 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:02.930028 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54206afa-304f-4f30-8174-7886c7627b01 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:02.930204 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54206afa-304f-4f30-8174-7886c7627b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:02.939251 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb473003-3ab5-44f9-870b-b21763e88606 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:02.939560 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb473003-3ab5-44f9-870b-b21763e88606 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:02.939845 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb473003-3ab5-44f9-870b-b21763e88606 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:02.941201 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 124/236] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:22:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 16:22:02.951048 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-54206afa-304f-4f30-8174-7886c7627b01 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:22:02.952354 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-54206afa-304f-4f30-8174-7886c7627b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:22:02.958386 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b46a1-7404-4613-bceb-0681d2f462c2 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:02.958542 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b46a1-7404-4613-bceb-0681d2f462c2 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:02.958811 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b46a1-7404-4613-bceb-0681d2f462c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:02.985525 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-3b5b46a1-7404-4613-bceb-0681d2f462c2 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:22:02.986708 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-3b5b46a1-7404-4613-bceb-0681d2f462c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:22:03.051346 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 113/237] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:22:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:22:03.052506 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dc0efa-b93c-4539-a45a-681b3f25357e None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:03.052795 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dc0efa-b93c-4539-a45a-681b3f25357e None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:03.053073 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dc0efa-b93c-4539-a45a-681b3f25357e None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:03.054577 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 114/238] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:22:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:22:03.060362 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c8884-905f-4bcd-a50f-13be314219c8 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:03.060645 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c8884-905f-4bcd-a50f-13be314219c8 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:03.060918 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c8884-905f-4bcd-a50f-13be314219c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:03.078244 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-c34c8884-905f-4bcd-a50f-13be314219c8 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:22:03.079415 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-c34c8884-905f-4bcd-a50f-13be314219c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:22:03.080955 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 125/239] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:22:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:22:03.085231 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5b46a1-7404-4613-bceb-0681d2f462c2 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:03.166070 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 115/240] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:22:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 16:22:03.166912 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c8884-905f-4bcd-a50f-13be314219c8 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:03.193641 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5b46a1-7404-4613-bceb-0681d2f462c2 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:03.239000 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc3b72c-d215-4bc4-bdcb-f6d05ac04bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:03.240323 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3b72c-d215-4bc4-bdcb-f6d05ac04bbd None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:03.240828 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3b72c-d215-4bc4-bdcb-f6d05ac04bbd None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:03.241310 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3b72c-d215-4bc4-bdcb-f6d05ac04bbd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:03.242886 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc3b72c-d215-4bc4-bdcb-f6d05ac04bbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:03.244683 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc3b72c-d215-4bc4-bdcb-f6d05ac04bbd None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:03.247115 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 126/241] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:22:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:03.248293 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc3b72c-d215-4bc4-bdcb-f6d05ac04bbd None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:03.289735 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c8884-905f-4bcd-a50f-13be314219c8 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:03.324231 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4717a4a1-9dd0-4f85-a2f7-b12b87bb8b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:03.325265 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4717a4a1-9dd0-4f85-a2f7-b12b87bb8b25 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:03.325265 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4717a4a1-9dd0-4f85-a2f7-b12b87bb8b25 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:03.325547 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4717a4a1-9dd0-4f85-a2f7-b12b87bb8b25 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:03.336115 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4717a4a1-9dd0-4f85-a2f7-b12b87bb8b25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:22:03.343198 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-4717a4a1-9dd0-4f85-a2f7-b12b87bb8b25 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 16:22:03.350517 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 116/242] 10.222.0.43 () {56 vars in 1096 bytes} [Mon Apr 11 16:22:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:03.350517 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4717a4a1-9dd0-4f85-a2f7-b12b87bb8b25 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:03.361883 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc3b72c-d215-4bc4-bdcb-f6d05ac04bbd None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:03.398864 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4241a082-8abd-49f7-be4f-3a6842e22edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:03.400065 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4241a082-8abd-49f7-be4f-3a6842e22edd None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:03.400568 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4241a082-8abd-49f7-be4f-3a6842e22edd None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:03.401057 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4241a082-8abd-49f7-be4f-3a6842e22edd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:03.412841 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4241a082-8abd-49f7-be4f-3a6842e22edd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:22:03.420363 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-4241a082-8abd-49f7-be4f-3a6842e22edd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 11 16:22:03.431425 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 127/243] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Apr 11 16:22:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:03.432746 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4241a082-8abd-49f7-be4f-3a6842e22edd None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:03.467666 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4717a4a1-9dd0-4f85-a2f7-b12b87bb8b25 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:03.515265 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1872f836-84c6-4ba1-a19b-9b4b664b9bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:03.516328 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872f836-84c6-4ba1-a19b-9b4b664b9bc5 None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:03.516833 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872f836-84c6-4ba1-a19b-9b4b664b9bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:03.517351 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872f836-84c6-4ba1-a19b-9b4b664b9bc5 None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:03.518272 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1872f836-84c6-4ba1-a19b-9b4b664b9bc5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:03.521157 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1872f836-84c6-4ba1-a19b-9b4b664b9bc5 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:03.556072 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4241a082-8abd-49f7-be4f-3a6842e22edd None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:03.589803 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0582a983-55af-49ee-8cc7-9f1c66c66a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:03.590478 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0582a983-55af-49ee-8cc7-9f1c66c66a6e None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:03.590761 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0582a983-55af-49ee-8cc7-9f1c66c66a6e None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:03.591036 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0582a983-55af-49ee-8cc7-9f1c66c66a6e None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:03.591801 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0582a983-55af-49ee-8cc7-9f1c66c66a6e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:03.592108 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0582a983-55af-49ee-8cc7-9f1c66c66a6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:03.593500 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0582a983-55af-49ee-8cc7-9f1c66c66a6e None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:03.603013 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 117/244] 10.222.0.43 () {60 vars in 1132 bytes} [Mon Apr 11 16:22:03 2022] POST /identity/v3/users => generated 293 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:22:03.604751 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 128/245] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Apr 11 16:22:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:03.604863 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1872f836-84c6-4ba1-a19b-9b4b664b9bc5 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:03.609901 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0582a983-55af-49ee-8cc7-9f1c66c66a6e None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:03.733301 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0582a983-55af-49ee-8cc7-9f1c66c66a6e None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:03.733690 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1872f836-84c6-4ba1-a19b-9b4b664b9bc5 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:03.771716 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064315c0-8bdc-4609-9321-85476878691b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:03.772629 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064315c0-8bdc-4609-9321-85476878691b None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:03.772918 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064315c0-8bdc-4609-9321-85476878691b None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:03.773200 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064315c0-8bdc-4609-9321-85476878691b None admin] PATH_INFO: `/v3/users/6cd3e7b23740492aa3ce8da932cfee99` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:03.774369 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5630621c-d0e9-4787-b3a5-e38a89dc6f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:03.774578 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064315c0-8bdc-4609-9321-85476878691b None admin] RBAC: Authorizing `identity:get_user(user_id=6cd3e7b23740492aa3ce8da932cfee99)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:03.775370 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5630621c-d0e9-4787-b3a5-e38a89dc6f3b None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:03.775844 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5630621c-d0e9-4787-b3a5-e38a89dc6f3b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:03.776110 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064315c0-8bdc-4609-9321-85476878691b None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:03.776515 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5630621c-d0e9-4787-b3a5-e38a89dc6f3b None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:03.777479 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5630621c-d0e9-4787-b3a5-e38a89dc6f3b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:03.778085 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 129/246] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Apr 11 16:22:03 2022] GET /identity/v3/users/6cd3e7b23740492aa3ce8da932cfee99 => generated 283 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:22:03.778407 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5630621c-d0e9-4787-b3a5-e38a89dc6f3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:03.779207 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e563a-59db-45de-8c49-02466dd89fa5 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:03.779497 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e563a-59db-45de-8c49-02466dd89fa5 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:03.779799 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e563a-59db-45de-8c49-02466dd89fa5 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:03.780454 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5630621c-d0e9-4787-b3a5-e38a89dc6f3b None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:03.781287 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 130/247] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:22:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:22:03.788136 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19006823-1f0a-43ea-95ab-f35ab467225d None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:03.788339 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19006823-1f0a-43ea-95ab-f35ab467225d None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:03.788502 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19006823-1f0a-43ea-95ab-f35ab467225d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:03.793699 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 118/248] 10.222.0.43 () {56 vars in 1101 bytes} [Mon Apr 11 16:22:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:03.801839 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5630621c-d0e9-4787-b3a5-e38a89dc6f3b None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:03.810957 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-19006823-1f0a-43ea-95ab-f35ab467225d None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:22:03.812312 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-19006823-1f0a-43ea-95ab-f35ab467225d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:22:03.889663 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 131/249] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:22:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 16:22:03.891253 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19006823-1f0a-43ea-95ab-f35ab467225d None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:03.930816 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5630621c-d0e9-4787-b3a5-e38a89dc6f3b None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:03.974451 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41964a50-b3b0-4787-9302-2d0f493b5d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:03.975122 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41964a50-b3b0-4787-9302-2d0f493b5d0d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:03.975404 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41964a50-b3b0-4787-9302-2d0f493b5d0d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:03.975718 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41964a50-b3b0-4787-9302-2d0f493b5d0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:04.007260 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19006823-1f0a-43ea-95ab-f35ab467225d None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:04.045213 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e3093-b957-496d-a469-76cc371e4dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:04.046112 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e3093-b957-496d-a469-76cc371e4dda None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:04.046395 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e3093-b957-496d-a469-76cc371e4dda None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:04.046673 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e3093-b957-496d-a469-76cc371e4dda None admin] PATH_INFO: `/v3/users/734aafcac1914aa2831c4dbbf0bb04a4` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:04.059376 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41964a50-b3b0-4787-9302-2d0f493b5d0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:04.060924 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41964a50-b3b0-4787-9302-2d0f493b5d0d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:04.061371 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67e3093-b957-496d-a469-76cc371e4dda None admin] RBAC: Authorizing `identity:get_user(user_id=734aafcac1914aa2831c4dbbf0bb04a4)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:04.062848 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67e3093-b957-496d-a469-76cc371e4dda None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:04.064806 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 132/250] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Apr 11 16:22:03 2022] GET /identity/v3/users/734aafcac1914aa2831c4dbbf0bb04a4 => generated 297 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:04.065397 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e3093-b957-496d-a469-76cc371e4dda None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:04.196260 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 119/251] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Apr 11 16:22:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 16:22:04.197785 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8a42b-d762-4c6d-8574-9cd568d2865e None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:04.198077 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8a42b-d762-4c6d-8574-9cd568d2865e None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:04.198424 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8a42b-d762-4c6d-8574-9cd568d2865e None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:04.200043 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 120/252] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:22:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:22:04.200768 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f8a42b-d762-4c6d-8574-9cd568d2865e None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:04.298074 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e3093-b957-496d-a469-76cc371e4dda None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:04.333592 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c8faf9-f373-46c3-b593-9fd382c131a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:04.334658 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c8faf9-f373-46c3-b593-9fd382c131a3 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:04.335081 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c8faf9-f373-46c3-b593-9fd382c131a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:04.335501 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c8faf9-f373-46c3-b593-9fd382c131a3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:04.338880 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f8a42b-d762-4c6d-8574-9cd568d2865e None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:04.346378 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c8faf9-f373-46c3-b593-9fd382c131a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:22:04.353836 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-61c8faf9-f373-46c3-b593-9fd382c131a3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 16:22:04.355186 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 133/253] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Apr 11 16:22:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:04.356226 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c8faf9-f373-46c3-b593-9fd382c131a3 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:04.381391 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464c11cf-daa5-4f55-9289-ba79cfa12b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:04.382060 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c11cf-daa5-4f55-9289-ba79cfa12b90 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:04.382630 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c11cf-daa5-4f55-9289-ba79cfa12b90 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:04.382931 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c11cf-daa5-4f55-9289-ba79cfa12b90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:04.467779 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464c11cf-daa5-4f55-9289-ba79cfa12b90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:04.472192 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464c11cf-daa5-4f55-9289-ba79cfa12b90 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:04.482803 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c8faf9-f373-46c3-b593-9fd382c131a3 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:04.532755 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b8a54a-f0cc-44cd-951e-1daa116ed1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:04.534175 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b8a54a-f0cc-44cd-951e-1daa116ed1e3 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:04.535232 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b8a54a-f0cc-44cd-951e-1daa116ed1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:04.536129 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b8a54a-f0cc-44cd-951e-1daa116ed1e3 None admin] PATH_INFO: `/v3/projects/3ed98a96ee294394baa1187f4c99252f` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:04.537519 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b8a54a-f0cc-44cd-951e-1daa116ed1e3 None admin] RBAC: Authorizing `identity:get_project(project_id=3ed98a96ee294394baa1187f4c99252f)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:04.539118 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b8a54a-f0cc-44cd-951e-1daa116ed1e3 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:04.541117 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 134/254] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Apr 11 16:22:04 2022] GET /identity/v3/projects/3ed98a96ee294394baa1187f4c99252f => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:04.542617 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb08198-916a-4406-8e8b-3d5565781315 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:04.543089 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb08198-916a-4406-8e8b-3d5565781315 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:04.543577 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb08198-916a-4406-8e8b-3d5565781315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:04.581855 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-6bb08198-916a-4406-8e8b-3d5565781315 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:22:04.584189 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-6bb08198-916a-4406-8e8b-3d5565781315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:22:04.608592 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 121/255] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Apr 11 16:22:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 16:22:04.608592 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464c11cf-daa5-4f55-9289-ba79cfa12b90 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:04.661159 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 135/256] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:22:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:22:04.668321 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb08198-916a-4406-8e8b-3d5565781315 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:04.716614 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464c11cf-daa5-4f55-9289-ba79cfa12b90 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:04.751821 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47484ad9-df73-4bb4-b7fe-0d26579d79cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:04.752581 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47484ad9-df73-4bb4-b7fe-0d26579d79cd None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:04.752866 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47484ad9-df73-4bb4-b7fe-0d26579d79cd None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:04.753146 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47484ad9-df73-4bb4-b7fe-0d26579d79cd None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:04.753971 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47484ad9-df73-4bb4-b7fe-0d26579d79cd None admin] RBAC: Adding query filter params (name=member) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:04.754430 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47484ad9-df73-4bb4-b7fe-0d26579d79cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:04.755884 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47484ad9-df73-4bb4-b7fe-0d26579d79cd None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:04.764430 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 122/257] 10.222.0.43 () {56 vars in 1101 bytes} [Mon Apr 11 16:22:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:04.765134 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47484ad9-df73-4bb4-b7fe-0d26579d79cd None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:04.805948 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb08198-916a-4406-8e8b-3d5565781315 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:04.850019 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c255879-b82a-413b-85db-96895e61b076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:04.851285 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c255879-b82a-413b-85db-96895e61b076 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:04.851807 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c255879-b82a-413b-85db-96895e61b076 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:04.852279 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c255879-b82a-413b-85db-96895e61b076 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:04.853750 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c255879-b82a-413b-85db-96895e61b076 None admin] RBAC: Adding query filter params (role.id=702e5e78b5d744529384b96a390ae92f, scope.project.id=3ed98a96ee294394baa1187f4c99252f, user.id=6cd3e7b23740492aa3ce8da932cfee99) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:04.854419 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c255879-b82a-413b-85db-96895e61b076 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:04.856639 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c255879-b82a-413b-85db-96895e61b076 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:04.864873 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 136/258] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Apr 11 16:22:04 2022] GET /identity/v3/role_assignments?user.id=6cd3e7b23740492aa3ce8da932cfee99&scope.project.id=3ed98a96ee294394baa1187f4c99252f&role.id=702e5e78b5d744529384b96a390ae92f => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:04.865063 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47484ad9-df73-4bb4-b7fe-0d26579d79cd None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:04.866047 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c255879-b82a-413b-85db-96895e61b076 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:04.902408 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79a4827-6075-403b-adfb-0fff658b6255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:04.903380 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a4827-6075-403b-adfb-0fff658b6255 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:04.903754 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a4827-6075-403b-adfb-0fff658b6255 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:04.904144 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a4827-6075-403b-adfb-0fff658b6255 None admin] PATH_INFO: `/v3/projects/3ed98a96ee294394baa1187f4c99252f` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:04.905602 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79a4827-6075-403b-adfb-0fff658b6255 None admin] RBAC: Authorizing `identity:get_project(project_id=3ed98a96ee294394baa1187f4c99252f)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:04.907075 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79a4827-6075-403b-adfb-0fff658b6255 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:04.908858 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 123/259] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Apr 11 16:22:04 2022] GET /identity/v3/projects/3ed98a96ee294394baa1187f4c99252f => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:04.909808 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79a4827-6075-403b-adfb-0fff658b6255 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:04.985945 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c255879-b82a-413b-85db-96895e61b076 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:05.019000 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79a4827-6075-403b-adfb-0fff658b6255 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:05.021701 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6dfeaa-6fac-4eea-8cab-5cc0134dc799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:05.022610 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6dfeaa-6fac-4eea-8cab-5cc0134dc799 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:05.022988 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6dfeaa-6fac-4eea-8cab-5cc0134dc799 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:05.023335 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6dfeaa-6fac-4eea-8cab-5cc0134dc799 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:05.035574 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6dfeaa-6fac-4eea-8cab-5cc0134dc799 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:22:05.043704 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-bb6dfeaa-6fac-4eea-8cab-5cc0134dc799 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 11 16:22:05.050034 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 137/260] 10.222.0.43 () {56 vars in 1114 bytes} [Mon Apr 11 16:22:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:05.051696 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6dfeaa-6fac-4eea-8cab-5cc0134dc799 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:05.063182 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa70d3cc-b135-43c1-8e46-0806ca00a269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:05.064375 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa70d3cc-b135-43c1-8e46-0806ca00a269 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:05.064842 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa70d3cc-b135-43c1-8e46-0806ca00a269 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:05.065290 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa70d3cc-b135-43c1-8e46-0806ca00a269 None admin] PATH_INFO: `/v3/users/8c5cddc0543542bd9811a3f8e2d7bb3a` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:05.067647 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa70d3cc-b135-43c1-8e46-0806ca00a269 None admin] RBAC: Authorizing `identity:get_user(user_id=8c5cddc0543542bd9811a3f8e2d7bb3a)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:05.069400 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa70d3cc-b135-43c1-8e46-0806ca00a269 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:05.071794 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 124/261] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Apr 11 16:22:04 2022] GET /identity/v3/users/8c5cddc0543542bd9811a3f8e2d7bb3a => generated 297 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:05.072953 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa70d3cc-b135-43c1-8e46-0806ca00a269 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:05.158411 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6dfeaa-6fac-4eea-8cab-5cc0134dc799 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:05.179121 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa70d3cc-b135-43c1-8e46-0806ca00a269 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:05.193880 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904f9a29-c5b2-478b-9729-4210142b6b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:05.194522 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f9a29-c5b2-478b-9729-4210142b6b70 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:05.194902 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f9a29-c5b2-478b-9729-4210142b6b70 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:05.195182 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f9a29-c5b2-478b-9729-4210142b6b70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:05.196127 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904f9a29-c5b2-478b-9729-4210142b6b70 None admin] RBAC: Adding query filter params (role.id=282780749a1d4592b823458aecfc5caf, scope.project.id=3ed98a96ee294394baa1187f4c99252f, user.id=734aafcac1914aa2831c4dbbf0bb04a4) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:05.196349 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904f9a29-c5b2-478b-9729-4210142b6b70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:05.197809 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904f9a29-c5b2-478b-9729-4210142b6b70 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:05.204005 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 138/262] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Apr 11 16:22:05 2022] GET /identity/v3/role_assignments?user.id=734aafcac1914aa2831c4dbbf0bb04a4&scope.project.id=3ed98a96ee294394baa1187f4c99252f&role.id=282780749a1d4592b823458aecfc5caf => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:05.205006 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904f9a29-c5b2-478b-9729-4210142b6b70 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:05.220415 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08714df6-24eb-455f-9e26-d75d9ebcc66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:05.221585 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08714df6-24eb-455f-9e26-d75d9ebcc66b None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:05.222067 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08714df6-24eb-455f-9e26-d75d9ebcc66b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:05.223216 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08714df6-24eb-455f-9e26-d75d9ebcc66b None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:05.224268 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08714df6-24eb-455f-9e26-d75d9ebcc66b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:05.224820 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08714df6-24eb-455f-9e26-d75d9ebcc66b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:05.226480 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08714df6-24eb-455f-9e26-d75d9ebcc66b None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:05.236252 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 125/263] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Apr 11 16:22:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:05.244757 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08714df6-24eb-455f-9e26-d75d9ebcc66b None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:05.329878 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904f9a29-c5b2-478b-9729-4210142b6b70 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:05.357944 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08714df6-24eb-455f-9e26-d75d9ebcc66b None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:05.365818 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148e0eb5-6412-4ecf-8cc9-f65235e3bc3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:05.367045 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e0eb5-6412-4ecf-8cc9-f65235e3bc3a None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:05.367045 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e0eb5-6412-4ecf-8cc9-f65235e3bc3a None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:05.367292 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e0eb5-6412-4ecf-8cc9-f65235e3bc3a None admin] PATH_INFO: `/v3/projects/3ed98a96ee294394baa1187f4c99252f` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:05.368531 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148e0eb5-6412-4ecf-8cc9-f65235e3bc3a None admin] RBAC: Authorizing `identity:get_project(project_id=3ed98a96ee294394baa1187f4c99252f)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:05.370001 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148e0eb5-6412-4ecf-8cc9-f65235e3bc3a None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:05.371819 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 139/264] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Apr 11 16:22:05 2022] GET /identity/v3/projects/3ed98a96ee294394baa1187f4c99252f => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:05.380742 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148e0eb5-6412-4ecf-8cc9-f65235e3bc3a None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:05.413148 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7310ecee-a409-4392-a454-f924201037db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:05.413974 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7310ecee-a409-4392-a454-f924201037db None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:05.414263 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7310ecee-a409-4392-a454-f924201037db None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:05.414544 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7310ecee-a409-4392-a454-f924201037db None admin] PATH_INFO: `/v3/users/6cd3e7b23740492aa3ce8da932cfee99` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:05.415854 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7310ecee-a409-4392-a454-f924201037db None admin] RBAC: Authorizing `identity:get_user(user_id=6cd3e7b23740492aa3ce8da932cfee99)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:05.417352 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7310ecee-a409-4392-a454-f924201037db None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:05.419742 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 126/265] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Apr 11 16:22:05 2022] GET /identity/v3/users/6cd3e7b23740492aa3ce8da932cfee99 => generated 283 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:22:05.426692 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7310ecee-a409-4392-a454-f924201037db None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:05.549784 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7310ecee-a409-4392-a454-f924201037db None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:05.563658 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148e0eb5-6412-4ecf-8cc9-f65235e3bc3a None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:05.600447 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71c8e91-d6cf-4c1e-94b0-6df6ded2d7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:05.601113 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71c8e91-d6cf-4c1e-94b0-6df6ded2d7b5 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:05.601401 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71c8e91-d6cf-4c1e-94b0-6df6ded2d7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:05.601682 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71c8e91-d6cf-4c1e-94b0-6df6ded2d7b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:05.610778 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e37926-3ff6-40e0-af3a-aee0634107a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:05.617683 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e37926-3ff6-40e0-af3a-aee0634107a4 None admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:05.618234 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e37926-3ff6-40e0-af3a-aee0634107a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:05.618707 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e37926-3ff6-40e0-af3a-aee0634107a4 None admin] PATH_INFO: `/v3/projects/3ed98a96ee294394baa1187f4c99252f/users/8c5cddc0543542bd9811a3f8e2d7bb3a/roles/0d41da7bec094450b5bff4e4831be52c` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:05.621045 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e37926-3ff6-40e0-af3a-aee0634107a4 None admin] RBAC: Authorizing `identity:create_grant(project_id=3ed98a96ee294394baa1187f4c99252f, user_id=8c5cddc0543542bd9811a3f8e2d7bb3a, role_id=0d41da7bec094450b5bff4e4831be52c)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:05.622695 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e37926-3ff6-40e0-af3a-aee0634107a4 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:05.687808 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71c8e91-d6cf-4c1e-94b0-6df6ded2d7b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:05.689637 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71c8e91-d6cf-4c1e-94b0-6df6ded2d7b5 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:05.708938 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 140/266] 10.222.0.43 () {58 vars in 1439 bytes} [Mon Apr 11 16:22:05 2022] PUT /identity/v3/projects/3ed98a96ee294394baa1187f4c99252f/users/8c5cddc0543542bd9811a3f8e2d7bb3a/roles/0d41da7bec094450b5bff4e4831be52c => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:22:05.842430 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 127/267] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Apr 11 16:22:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 16:22:05.848452 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e37926-3ff6-40e0-af3a-aee0634107a4 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:05.973470 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e37926-3ff6-40e0-af3a-aee0634107a4 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:06.015915 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56023f11-4f1e-4e12-9262-dcc62dd6257f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:06.016788 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56023f11-4f1e-4e12-9262-dcc62dd6257f None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:06.017068 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56023f11-4f1e-4e12-9262-dcc62dd6257f None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:06.017340 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56023f11-4f1e-4e12-9262-dcc62dd6257f None admin] PATH_INFO: `/v3/projects/3ed98a96ee294394baa1187f4c99252f` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:06.018520 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56023f11-4f1e-4e12-9262-dcc62dd6257f None admin] RBAC: Authorizing `identity:get_project(project_id=3ed98a96ee294394baa1187f4c99252f)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:06.020787 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56023f11-4f1e-4e12-9262-dcc62dd6257f None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:06.028397 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71c8e91-d6cf-4c1e-94b0-6df6ded2d7b5 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:06.028949 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 141/268] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Apr 11 16:22:05 2022] GET /identity/v3/projects/3ed98a96ee294394baa1187f4c99252f => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:06.168321 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71c8e91-d6cf-4c1e-94b0-6df6ded2d7b5 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:06.209592 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b013c4bb-bb1e-4103-8e68-83b806c36672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:06.210269 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b013c4bb-bb1e-4103-8e68-83b806c36672 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:06.210567 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b013c4bb-bb1e-4103-8e68-83b806c36672 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:06.210815 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b013c4bb-bb1e-4103-8e68-83b806c36672 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:06.211687 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b013c4bb-bb1e-4103-8e68-83b806c36672 None admin] RBAC: Adding query filter params (role.id=7d3d5d04ca634b3a9b63e7b05bb5d333, scope.project.id=3ed98a96ee294394baa1187f4c99252f, user.id=6cd3e7b23740492aa3ce8da932cfee99) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:06.212002 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b013c4bb-bb1e-4103-8e68-83b806c36672 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:06.213441 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b013c4bb-bb1e-4103-8e68-83b806c36672 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:06.220060 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 128/269] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Apr 11 16:22:06 2022] GET /identity/v3/role_assignments?user.id=6cd3e7b23740492aa3ce8da932cfee99&scope.project.id=3ed98a96ee294394baa1187f4c99252f&role.id=7d3d5d04ca634b3a9b63e7b05bb5d333 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:22:06.627491 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dbd8b9-b0e9-4d30-b964-abc80d5b2199 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:06.628248 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dbd8b9-b0e9-4d30-b964-abc80d5b2199 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:06.628868 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dbd8b9-b0e9-4d30-b964-abc80d5b2199 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:06.630448 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 142/270] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:22:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:22:06.636829 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80239c1-0e38-4adf-b99b-1c551f5e0818 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:06.637365 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80239c1-0e38-4adf-b99b-1c551f5e0818 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:06.637831 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80239c1-0e38-4adf-b99b-1c551f5e0818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:06.655829 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-b80239c1-0e38-4adf-b99b-1c551f5e0818 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:22:06.657756 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b80239c1-0e38-4adf-b99b-1c551f5e0818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:22:06.734102 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 129/271] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:22:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:22:06.761373 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dbd8b9-b0e9-4d30-b964-abc80d5b2199 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:06.830964 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df26c51-1479-4e26-8654-966d6aa51474 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:06.831302 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df26c51-1479-4e26-8654-966d6aa51474 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:06.831594 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df26c51-1479-4e26-8654-966d6aa51474 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:06.833106 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 130/272] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:22:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 16:22:06.837960 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117abf70-3f8c-4d25-b114-7024fed9f938 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:06.838253 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117abf70-3f8c-4d25-b114-7024fed9f938 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:06.838534 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117abf70-3f8c-4d25-b114-7024fed9f938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:06.863726 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-117abf70-3f8c-4d25-b114-7024fed9f938 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:22:06.865300 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-117abf70-3f8c-4d25-b114-7024fed9f938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:22:06.887274 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dbd8b9-b0e9-4d30-b964-abc80d5b2199 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:06.921760 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b02f39-cbc3-4dd5-9ca0-6fcdcea1ffdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:06.922893 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b02f39-cbc3-4dd5-9ca0-6fcdcea1ffdc None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:06.923366 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b02f39-cbc3-4dd5-9ca0-6fcdcea1ffdc None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:06.923873 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b02f39-cbc3-4dd5-9ca0-6fcdcea1ffdc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:06.934366 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b02f39-cbc3-4dd5-9ca0-6fcdcea1ffdc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:22:06.942361 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-f2b02f39-cbc3-4dd5-9ca0-6fcdcea1ffdc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 16:22:06.944167 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 143/273] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Apr 11 16:22:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:06.949969 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b02f39-cbc3-4dd5-9ca0-6fcdcea1ffdc None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:06.950414 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 131/274] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:22:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 16:22:06.975722 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117abf70-3f8c-4d25-b114-7024fed9f938 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:07.079007 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117abf70-3f8c-4d25-b114-7024fed9f938 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:07.079901 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b02f39-cbc3-4dd5-9ca0-6fcdcea1ffdc None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:07.119341 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5396ded-ddbc-4c8f-9ec0-88da9249b33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:07.120566 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5396ded-ddbc-4c8f-9ec0-88da9249b33c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:07.121014 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5396ded-ddbc-4c8f-9ec0-88da9249b33c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:07.121445 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5396ded-ddbc-4c8f-9ec0-88da9249b33c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:07.121836 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6980bf-8833-428e-ba42-96de0f28dfa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:07.122689 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6980bf-8833-428e-ba42-96de0f28dfa0 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:07.123046 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6980bf-8833-428e-ba42-96de0f28dfa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:07.123395 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6980bf-8833-428e-ba42-96de0f28dfa0 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:07.123693 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5396ded-ddbc-4c8f-9ec0-88da9249b33c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:07.124305 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6980bf-8833-428e-ba42-96de0f28dfa0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:07.124712 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6980bf-8833-428e-ba42-96de0f28dfa0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:07.125959 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5396ded-ddbc-4c8f-9ec0-88da9249b33c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:07.126492 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6980bf-8833-428e-ba42-96de0f28dfa0 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:07.128624 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 132/275] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:22:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:22:07.134923 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5396ded-ddbc-4c8f-9ec0-88da9249b33c None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:07.136659 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 144/276] 10.222.0.43 () {56 vars in 1101 bytes} [Mon Apr 11 16:22:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:07.145105 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6980bf-8833-428e-ba42-96de0f28dfa0 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:07.249891 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5396ded-ddbc-4c8f-9ec0-88da9249b33c None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:07.262296 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6980bf-8833-428e-ba42-96de0f28dfa0 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:07.285822 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d84b7c-3adb-4d81-b9d1-c4b713304526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:07.286025 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d84b7c-3adb-4d81-b9d1-c4b713304526 None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:07.286291 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d84b7c-3adb-4d81-b9d1-c4b713304526 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:07.286481 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d84b7c-3adb-4d81-b9d1-c4b713304526 None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:07.287193 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d84b7c-3adb-4d81-b9d1-c4b713304526 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:07.288655 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d84b7c-3adb-4d81-b9d1-c4b713304526 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:07.297857 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd152e2-ddea-43c9-be5c-bd6a44b894fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:07.298843 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd152e2-ddea-43c9-be5c-bd6a44b894fc None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:07.299177 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd152e2-ddea-43c9-be5c-bd6a44b894fc None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:07.299451 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd152e2-ddea-43c9-be5c-bd6a44b894fc None admin] PATH_INFO: `/v3/users/fcac630e149e4b409209d7c6f1b2c0da` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:07.314191 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd152e2-ddea-43c9-be5c-bd6a44b894fc None admin] RBAC: Authorizing `identity:get_user(user_id=fcac630e149e4b409209d7c6f1b2c0da)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:07.319119 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd152e2-ddea-43c9-be5c-bd6a44b894fc None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:07.319119 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 145/277] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Apr 11 16:22:07 2022] GET /identity/v3/users/fcac630e149e4b409209d7c6f1b2c0da => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:07.323290 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd152e2-ddea-43c9-be5c-bd6a44b894fc None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:07.422810 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd152e2-ddea-43c9-be5c-bd6a44b894fc None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:07.427000 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 133/278] 10.222.0.43 () {60 vars in 1132 bytes} [Mon Apr 11 16:22:07 2022] POST /identity/v3/users => generated 293 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:22:07.476404 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fffae8-2b35-4bc5-93d0-a9f413cbce20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:07.477089 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fffae8-2b35-4bc5-93d0-a9f413cbce20 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:07.477432 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fffae8-2b35-4bc5-93d0-a9f413cbce20 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:07.477704 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fffae8-2b35-4bc5-93d0-a9f413cbce20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:07.478556 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fffae8-2b35-4bc5-93d0-a9f413cbce20 None admin] RBAC: Adding query filter params (role.id=0d41da7bec094450b5bff4e4831be52c, user.id=fcac630e149e4b409209d7c6f1b2c0da, scope.system=all) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:07.478876 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fffae8-2b35-4bc5-93d0-a9f413cbce20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:07.480422 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fffae8-2b35-4bc5-93d0-a9f413cbce20 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:07.486687 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 146/279] 10.222.0.43 () {56 vars in 1308 bytes} [Mon Apr 11 16:22:07 2022] GET /identity/v3/role_assignments?user.id=fcac630e149e4b409209d7c6f1b2c0da&scope.system=all&role.id=0d41da7bec094450b5bff4e4831be52c => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:22:08.031421 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a93a34b-4eb8-4128-acf0-ab8712dcea81 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:08.031812 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a93a34b-4eb8-4128-acf0-ab8712dcea81 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:08.032033 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a93a34b-4eb8-4128-acf0-ab8712dcea81 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:08.033649 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 134/280] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:22:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:22:08.039815 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98ee24-e881-409a-85e8-786c61d4240c None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:08.040108 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98ee24-e881-409a-85e8-786c61d4240c None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:08.040391 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98ee24-e881-409a-85e8-786c61d4240c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:08.057395 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-1f98ee24-e881-409a-85e8-786c61d4240c None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:22:08.058589 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-1f98ee24-e881-409a-85e8-786c61d4240c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:22:08.126528 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 147/281] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:22:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:22:08.149384 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a93a34b-4eb8-4128-acf0-ab8712dcea81 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:08.297787 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a93a34b-4eb8-4128-acf0-ab8712dcea81 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:08.356625 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd78ebbb-3d4d-44e8-a4ac-93589030f6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:08.357431 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd78ebbb-3d4d-44e8-a4ac-93589030f6bb None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:08.357714 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd78ebbb-3d4d-44e8-a4ac-93589030f6bb None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:08.357990 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd78ebbb-3d4d-44e8-a4ac-93589030f6bb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:08.380585 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd78ebbb-3d4d-44e8-a4ac-93589030f6bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:22:08.387777 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-bd78ebbb-3d4d-44e8-a4ac-93589030f6bb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 11 16:22:08.389043 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 135/282] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Apr 11 16:22:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:08.397483 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f98ee24-e881-409a-85e8-786c61d4240c None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:08.434025 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6db286-d3b4-43d0-b287-258f0545481b None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:08.434025 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6db286-d3b4-43d0-b287-258f0545481b None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:08.434311 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6db286-d3b4-43d0-b287-258f0545481b None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:08.435556 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 136/283] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:22:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 16:22:08.442549 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b442acf-7a5b-49df-9fc9-b892516edc32 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:08.442848 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b442acf-7a5b-49df-9fc9-b892516edc32 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:08.443097 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b442acf-7a5b-49df-9fc9-b892516edc32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:08.464006 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-2b442acf-7a5b-49df-9fc9-b892516edc32 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:22:08.464006 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-2b442acf-7a5b-49df-9fc9-b892516edc32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:22:08.531225 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f98ee24-e881-409a-85e8-786c61d4240c None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:08.536256 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 137/284] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:22:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 16:22:08.561440 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b442acf-7a5b-49df-9fc9-b892516edc32 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:08.575267 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de37e1aa-7894-4998-8a91-026c999275e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:08.575981 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37e1aa-7894-4998-8a91-026c999275e0 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:08.576270 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37e1aa-7894-4998-8a91-026c999275e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:08.576548 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37e1aa-7894-4998-8a91-026c999275e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:08.577308 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de37e1aa-7894-4998-8a91-026c999275e0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:08.577622 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de37e1aa-7894-4998-8a91-026c999275e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:08.579001 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de37e1aa-7894-4998-8a91-026c999275e0 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:08.595385 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 148/285] 10.222.0.43 () {56 vars in 1101 bytes} [Mon Apr 11 16:22:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:08.602830 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de37e1aa-7894-4998-8a91-026c999275e0 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:08.664554 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b442acf-7a5b-49df-9fc9-b892516edc32 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:08.699715 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccd0f68-20b5-4044-8b05-7e32dfc4a5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:08.700570 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccd0f68-20b5-4044-8b05-7e32dfc4a5e0 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:08.700854 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccd0f68-20b5-4044-8b05-7e32dfc4a5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:08.701126 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccd0f68-20b5-4044-8b05-7e32dfc4a5e0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:08.707632 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de37e1aa-7894-4998-8a91-026c999275e0 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:08.712881 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccd0f68-20b5-4044-8b05-7e32dfc4a5e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:22:08.720326 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-6ccd0f68-20b5-4044-8b05-7e32dfc4a5e0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 16:22:08.722506 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 138/286] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Apr 11 16:22:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:08.728266 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccd0f68-20b5-4044-8b05-7e32dfc4a5e0 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:08.756883 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19255397-93e3-413a-8590-7a64f41b5ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:08.757787 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19255397-93e3-413a-8590-7a64f41b5ad8 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:08.758071 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19255397-93e3-413a-8590-7a64f41b5ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:08.758347 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19255397-93e3-413a-8590-7a64f41b5ad8 None admin] PATH_INFO: `/v3/users/734aafcac1914aa2831c4dbbf0bb04a4` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:08.764283 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19255397-93e3-413a-8590-7a64f41b5ad8 None admin] RBAC: Authorizing `identity:get_user(user_id=734aafcac1914aa2831c4dbbf0bb04a4)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:08.765733 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19255397-93e3-413a-8590-7a64f41b5ad8 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:08.767720 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 149/287] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Apr 11 16:22:08 2022] GET /identity/v3/users/734aafcac1914aa2831c4dbbf0bb04a4 => generated 297 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:22:08.773333 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19255397-93e3-413a-8590-7a64f41b5ad8 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:08.844528 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccd0f68-20b5-4044-8b05-7e32dfc4a5e0 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:08.884567 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6842683f-c78f-4efc-a7b8-e60413dda2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:08.885245 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842683f-c78f-4efc-a7b8-e60413dda2dc None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:08.885524 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842683f-c78f-4efc-a7b8-e60413dda2dc None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:08.885796 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842683f-c78f-4efc-a7b8-e60413dda2dc None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:08.886547 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6842683f-c78f-4efc-a7b8-e60413dda2dc None admin] RBAC: Adding query filter params (name=member) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:08.886856 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6842683f-c78f-4efc-a7b8-e60413dda2dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:08.888350 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6842683f-c78f-4efc-a7b8-e60413dda2dc None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:08.898556 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 139/288] 10.222.0.43 () {56 vars in 1101 bytes} [Mon Apr 11 16:22:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:08.904181 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6842683f-c78f-4efc-a7b8-e60413dda2dc None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:08.917972 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19255397-93e3-413a-8590-7a64f41b5ad8 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:08.951263 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf4eecf-626f-4f77-a726-65ecccff92ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:08.952166 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf4eecf-626f-4f77-a726-65ecccff92ee None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:08.952449 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf4eecf-626f-4f77-a726-65ecccff92ee None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:08.952724 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf4eecf-626f-4f77-a726-65ecccff92ee None admin] PATH_INFO: `/v3/projects/3ed98a96ee294394baa1187f4c99252f` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:08.953915 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf4eecf-626f-4f77-a726-65ecccff92ee None admin] RBAC: Authorizing `identity:get_project(project_id=3ed98a96ee294394baa1187f4c99252f)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:08.955335 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf4eecf-626f-4f77-a726-65ecccff92ee None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:08.957928 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 150/289] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Apr 11 16:22:08 2022] GET /identity/v3/projects/3ed98a96ee294394baa1187f4c99252f => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:22:08.963217 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf4eecf-626f-4f77-a726-65ecccff92ee None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:09.007961 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6842683f-c78f-4efc-a7b8-e60413dda2dc None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:09.043502 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5050611-a78a-441b-9818-49f3c51f10b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:09.044632 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5050611-a78a-441b-9818-49f3c51f10b2 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:09.044913 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5050611-a78a-441b-9818-49f3c51f10b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:09.045232 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5050611-a78a-441b-9818-49f3c51f10b2 None admin] PATH_INFO: `/v3/users/8c5cddc0543542bd9811a3f8e2d7bb3a` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:09.046719 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5050611-a78a-441b-9818-49f3c51f10b2 None admin] RBAC: Authorizing `identity:get_user(user_id=8c5cddc0543542bd9811a3f8e2d7bb3a)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:09.048241 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5050611-a78a-441b-9818-49f3c51f10b2 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:09.050688 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 140/290] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Apr 11 16:22:08 2022] GET /identity/v3/users/8c5cddc0543542bd9811a3f8e2d7bb3a => generated 297 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:22:09.055774 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5050611-a78a-441b-9818-49f3c51f10b2 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:09.067216 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf4eecf-626f-4f77-a726-65ecccff92ee None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:09.101540 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd168e37-7e42-4243-be0c-521387f9bed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:09.102352 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd168e37-7e42-4243-be0c-521387f9bed3 None admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:09.102632 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd168e37-7e42-4243-be0c-521387f9bed3 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:09.102898 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd168e37-7e42-4243-be0c-521387f9bed3 None admin] PATH_INFO: `/v3/projects/3ed98a96ee294394baa1187f4c99252f/users/734aafcac1914aa2831c4dbbf0bb04a4/roles/282780749a1d4592b823458aecfc5caf` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:09.104922 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd168e37-7e42-4243-be0c-521387f9bed3 None admin] RBAC: Authorizing `identity:create_grant(project_id=3ed98a96ee294394baa1187f4c99252f, user_id=734aafcac1914aa2831c4dbbf0bb04a4, role_id=282780749a1d4592b823458aecfc5caf)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:09.106357 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd168e37-7e42-4243-be0c-521387f9bed3 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:09.174598 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5050611-a78a-441b-9818-49f3c51f10b2 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:09.212574 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04593ca1-0a15-4e0b-a53a-dc0626faa4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:09.213287 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04593ca1-0a15-4e0b-a53a-dc0626faa4d8 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:09.213570 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04593ca1-0a15-4e0b-a53a-dc0626faa4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:09.213880 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04593ca1-0a15-4e0b-a53a-dc0626faa4d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:09.217709 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 151/291] 10.222.0.43 () {58 vars in 1439 bytes} [Mon Apr 11 16:22:08 2022] PUT /identity/v3/projects/3ed98a96ee294394baa1187f4c99252f/users/734aafcac1914aa2831c4dbbf0bb04a4/roles/282780749a1d4592b823458aecfc5caf => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:22:09.287948 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04593ca1-0a15-4e0b-a53a-dc0626faa4d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:09.289423 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04593ca1-0a15-4e0b-a53a-dc0626faa4d8 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:09.396774 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 141/292] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Apr 11 16:22:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 11 16:22:09.404649 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd168e37-7e42-4243-be0c-521387f9bed3 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:09.552169 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd168e37-7e42-4243-be0c-521387f9bed3 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:09.598035 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfd4200-1799-437c-b0da-b57bd586754d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:09.598982 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd4200-1799-437c-b0da-b57bd586754d None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:09.599267 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd4200-1799-437c-b0da-b57bd586754d None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:09.599593 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd4200-1799-437c-b0da-b57bd586754d None admin] PATH_INFO: `/v3/projects/3ed98a96ee294394baa1187f4c99252f` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:09.600807 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfd4200-1799-437c-b0da-b57bd586754d None admin] RBAC: Authorizing `identity:get_project(project_id=3ed98a96ee294394baa1187f4c99252f)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:09.602245 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfd4200-1799-437c-b0da-b57bd586754d None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:09.604279 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 152/293] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Apr 11 16:22:09 2022] GET /identity/v3/projects/3ed98a96ee294394baa1187f4c99252f => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:09.609721 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04593ca1-0a15-4e0b-a53a-dc0626faa4d8 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:09.709309 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04593ca1-0a15-4e0b-a53a-dc0626faa4d8 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:09.744511 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c6ee5-fcb8-4044-89c9-34ab442bcc1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:09.745182 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c6ee5-fcb8-4044-89c9-34ab442bcc1f None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:09.745471 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c6ee5-fcb8-4044-89c9-34ab442bcc1f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:09.745752 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c6ee5-fcb8-4044-89c9-34ab442bcc1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:09.746608 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244c6ee5-fcb8-4044-89c9-34ab442bcc1f None admin] RBAC: Adding query filter params (role.id=0d41da7bec094450b5bff4e4831be52c, scope.project.id=3ed98a96ee294394baa1187f4c99252f, user.id=8c5cddc0543542bd9811a3f8e2d7bb3a) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:09.746924 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244c6ee5-fcb8-4044-89c9-34ab442bcc1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:09.748448 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244c6ee5-fcb8-4044-89c9-34ab442bcc1f None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:09.758950 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 142/294] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Apr 11 16:22:09 2022] GET /identity/v3/role_assignments?user.id=8c5cddc0543542bd9811a3f8e2d7bb3a&scope.project.id=3ed98a96ee294394baa1187f4c99252f&role.id=0d41da7bec094450b5bff4e4831be52c => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:22:10.219122 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa696c49-9e50-4c34-8ade-35a039a010cd None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:10.219827 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa696c49-9e50-4c34-8ade-35a039a010cd None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:10.219827 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa696c49-9e50-4c34-8ade-35a039a010cd None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:10.221907 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 153/295] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:22:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:22:10.227423 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a62ec9-d018-4d4a-aee9-c71ff51491f5 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:10.228308 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a62ec9-d018-4d4a-aee9-c71ff51491f5 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:10.228790 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a62ec9-d018-4d4a-aee9-c71ff51491f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:10.246899 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-51a62ec9-d018-4d4a-aee9-c71ff51491f5 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:22:10.248458 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-51a62ec9-d018-4d4a-aee9-c71ff51491f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:22:10.325329 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 143/296] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:22:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:22:10.350951 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa696c49-9e50-4c34-8ade-35a039a010cd None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:10.462100 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa696c49-9e50-4c34-8ade-35a039a010cd None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:10.497409 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f816e6-c5c6-486d-9b17-d78a30ee99b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:10.498225 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f816e6-c5c6-486d-9b17-d78a30ee99b4 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:10.498510 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f816e6-c5c6-486d-9b17-d78a30ee99b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:10.498825 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f816e6-c5c6-486d-9b17-d78a30ee99b4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:10.511540 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f816e6-c5c6-486d-9b17-d78a30ee99b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:22:10.518062 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-81f816e6-c5c6-486d-9b17-d78a30ee99b4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 16:22:10.519646 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 154/297] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Apr 11 16:22:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:10.525533 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a62ec9-d018-4d4a-aee9-c71ff51491f5 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:10.639448 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a62ec9-d018-4d4a-aee9-c71ff51491f5 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:10.675118 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9972790-1a8f-418d-a77a-71f0f5e7cb5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:10.675824 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9972790-1a8f-418d-a77a-71f0f5e7cb5c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:10.676107 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9972790-1a8f-418d-a77a-71f0f5e7cb5c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:10.676384 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9972790-1a8f-418d-a77a-71f0f5e7cb5c None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:10.677144 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9972790-1a8f-418d-a77a-71f0f5e7cb5c None admin] RBAC: Adding query filter params (name=member) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:10.677453 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9972790-1a8f-418d-a77a-71f0f5e7cb5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:10.678818 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9972790-1a8f-418d-a77a-71f0f5e7cb5c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:10.688897 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 144/298] 10.222.0.43 () {56 vars in 1101 bytes} [Mon Apr 11 16:22:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:10.696024 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f816e6-c5c6-486d-9b17-d78a30ee99b4 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:10.722841 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040de6df-ee74-4906-982b-b3444cbb13b2 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:10.723136 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040de6df-ee74-4906-982b-b3444cbb13b2 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:10.723406 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040de6df-ee74-4906-982b-b3444cbb13b2 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:10.725109 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 145/299] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:22:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:22:10.731872 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a642288-68c4-4bbc-82bb-310f18e4453e None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:10.732108 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a642288-68c4-4bbc-82bb-310f18e4453e None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:10.732397 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a642288-68c4-4bbc-82bb-310f18e4453e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:10.754154 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-5a642288-68c4-4bbc-82bb-310f18e4453e None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:22:10.755877 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-5a642288-68c4-4bbc-82bb-310f18e4453e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:22:10.805933 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f816e6-c5c6-486d-9b17-d78a30ee99b4 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:10.822764 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 146/300] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:22:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 16:22:10.824302 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749f6d3-a07f-4833-b300-282f03d30b20 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:10.824807 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749f6d3-a07f-4833-b300-282f03d30b20 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:10.825264 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749f6d3-a07f-4833-b300-282f03d30b20 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:10.826699 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 147/301] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:22:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:22:10.839569 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c86625-8de7-466a-9290-f5901c5bc3f9 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:10.839569 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c86625-8de7-466a-9290-f5901c5bc3f9 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:10.839569 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c86625-8de7-466a-9290-f5901c5bc3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:10.845095 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e997c2-2fa7-4efd-8274-ce67e9f67f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:10.845974 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e997c2-2fa7-4efd-8274-ce67e9f67f32 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:10.846450 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e997c2-2fa7-4efd-8274-ce67e9f67f32 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:10.846835 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e997c2-2fa7-4efd-8274-ce67e9f67f32 None admin] PATH_INFO: `/v3/users/fcac630e149e4b409209d7c6f1b2c0da` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:10.848262 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e997c2-2fa7-4efd-8274-ce67e9f67f32 None admin] RBAC: Authorizing `identity:get_user(user_id=fcac630e149e4b409209d7c6f1b2c0da)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:10.849693 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e997c2-2fa7-4efd-8274-ce67e9f67f32 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:10.851645 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 155/302] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Apr 11 16:22:10 2022] GET /identity/v3/users/fcac630e149e4b409209d7c6f1b2c0da => generated 293 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:10.852380 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e997c2-2fa7-4efd-8274-ce67e9f67f32 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:10.854556 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-e6c86625-8de7-466a-9290-f5901c5bc3f9 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:22:10.855761 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e6c86625-8de7-466a-9290-f5901c5bc3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:22:10.921264 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 148/303] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:22:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:22:10.922089 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c86625-8de7-466a-9290-f5901c5bc3f9 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:10.975009 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e997c2-2fa7-4efd-8274-ce67e9f67f32 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:11.009957 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b5cf39-4b3a-4042-88f5-47da26543c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:11.011055 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5cf39-4b3a-4042-88f5-47da26543c6f None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:11.011609 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5cf39-4b3a-4042-88f5-47da26543c6f None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:11.012066 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5cf39-4b3a-4042-88f5-47da26543c6f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:11.013424 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b5cf39-4b3a-4042-88f5-47da26543c6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:11.015030 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b5cf39-4b3a-4042-88f5-47da26543c6f None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:11.021839 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 156/304] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:22:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:11.022869 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b5cf39-4b3a-4042-88f5-47da26543c6f None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:11.029217 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c86625-8de7-466a-9290-f5901c5bc3f9 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:11.062607 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dfe2ef-3cf6-4459-bdc5-849d064c1f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:11.063472 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dfe2ef-3cf6-4459-bdc5-849d064c1f35 None admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:11.063781 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dfe2ef-3cf6-4459-bdc5-849d064c1f35 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:11.064053 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dfe2ef-3cf6-4459-bdc5-849d064c1f35 None admin] PATH_INFO: `/v3/system/users/fcac630e149e4b409209d7c6f1b2c0da/roles/0d41da7bec094450b5bff4e4831be52c` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:11.066109 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dfe2ef-3cf6-4459-bdc5-849d064c1f35 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=fcac630e149e4b409209d7c6f1b2c0da, role_id=0d41da7bec094450b5bff4e4831be52c)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:11.067491 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dfe2ef-3cf6-4459-bdc5-849d064c1f35 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:11.121960 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b5cf39-4b3a-4042-88f5-47da26543c6f None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:11.154040 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7138ec3-19f5-44d0-b624-40f8bfbf6093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:11.158785 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7138ec3-19f5-44d0-b624-40f8bfbf6093 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:11.158785 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7138ec3-19f5-44d0-b624-40f8bfbf6093 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:11.158785 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7138ec3-19f5-44d0-b624-40f8bfbf6093 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:11.165038 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7138ec3-19f5-44d0-b624-40f8bfbf6093 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:22:11.172048 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-c7138ec3-19f5-44d0-b624-40f8bfbf6093 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 11 16:22:11.173237 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 157/305] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Apr 11 16:22:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:11.173971 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7138ec3-19f5-44d0-b624-40f8bfbf6093 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:11.182366 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 149/306] 10.222.0.43 () {58 vars in 1334 bytes} [Mon Apr 11 16:22:10 2022] PUT /identity/v3/system/users/fcac630e149e4b409209d7c6f1b2c0da/roles/0d41da7bec094450b5bff4e4831be52c => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:22:11.184106 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dfe2ef-3cf6-4459-bdc5-849d064c1f35 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:11.296035 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7138ec3-19f5-44d0-b624-40f8bfbf6093 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:11.303464 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dfe2ef-3cf6-4459-bdc5-849d064c1f35 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:11.333281 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eea79d2-ab84-4e62-922e-ad8a9f47735a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:11.334076 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea79d2-ab84-4e62-922e-ad8a9f47735a None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:11.334429 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea79d2-ab84-4e62-922e-ad8a9f47735a None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:11.334798 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea79d2-ab84-4e62-922e-ad8a9f47735a None admin] PATH_INFO: `/v3/groups` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:11.335613 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eea79d2-ab84-4e62-922e-ad8a9f47735a None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:11.337211 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eea79d2-ab84-4e62-922e-ad8a9f47735a None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:11.344659 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b72151-06bb-4379-be0f-07277e51db21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:11.345368 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b72151-06bb-4379-be0f-07277e51db21 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:11.345629 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b72151-06bb-4379-be0f-07277e51db21 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:11.346072 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b72151-06bb-4379-be0f-07277e51db21 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:11.347477 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b72151-06bb-4379-be0f-07277e51db21 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:11.347813 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b72151-06bb-4379-be0f-07277e51db21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:11.349310 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b72151-06bb-4379-be0f-07277e51db21 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:11.358564 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 150/307] 10.222.0.43 () {56 vars in 1101 bytes} [Mon Apr 11 16:22:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:11.364394 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b72151-06bb-4379-be0f-07277e51db21 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:11.412850 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 158/308] 10.222.0.43 () {60 vars in 1134 bytes} [Mon Apr 11 16:22:11 2022] POST /identity/v3/groups => generated 229 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:22:11.600349 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b72151-06bb-4379-be0f-07277e51db21 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:11.639483 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b5d35-e0fe-4236-82f4-397ef855213e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:11.640400 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b5d35-e0fe-4236-82f4-397ef855213e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:11.640688 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b5d35-e0fe-4236-82f4-397ef855213e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:11.640967 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b5d35-e0fe-4236-82f4-397ef855213e None admin] PATH_INFO: `/v3/users/175ead05a2db44c79d3f2074cffb5b98` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:11.654875 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839b5d35-e0fe-4236-82f4-397ef855213e None admin] RBAC: Authorizing `identity:get_user(user_id=175ead05a2db44c79d3f2074cffb5b98)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:11.656356 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839b5d35-e0fe-4236-82f4-397ef855213e None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:11.658237 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 151/309] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Apr 11 16:22:11 2022] GET /identity/v3/users/175ead05a2db44c79d3f2074cffb5b98 => generated 293 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:11.664115 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eea79d2-ab84-4e62-922e-ad8a9f47735a None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:11.766236 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eea79d2-ab84-4e62-922e-ad8a9f47735a None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:11.800507 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289297f4-4747-470f-b1c3-10a965c400ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:11.801176 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289297f4-4747-470f-b1c3-10a965c400ff None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:11.801463 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289297f4-4747-470f-b1c3-10a965c400ff None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:11.801747 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289297f4-4747-470f-b1c3-10a965c400ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:11.802583 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289297f4-4747-470f-b1c3-10a965c400ff None admin] RBAC: Adding query filter params (role.id=282780749a1d4592b823458aecfc5caf, user.id=175ead05a2db44c79d3f2074cffb5b98, scope.system=all) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:11.802901 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289297f4-4747-470f-b1c3-10a965c400ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:11.804384 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289297f4-4747-470f-b1c3-10a965c400ff None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:11.809988 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 159/310] 10.222.0.43 () {56 vars in 1308 bytes} [Mon Apr 11 16:22:11 2022] GET /identity/v3/role_assignments?user.id=175ead05a2db44c79d3f2074cffb5b98&scope.system=all&role.id=282780749a1d4592b823458aecfc5caf => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:11.985937 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab32948-e645-439c-b072-fdddb67860c7 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:11.986335 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab32948-e645-439c-b072-fdddb67860c7 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:11.986524 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab32948-e645-439c-b072-fdddb67860c7 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:11.988706 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 152/311] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:22:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:22:11.994062 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e44cd0c-e0ce-46d1-aa88-5eaa7db4f411 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:11.994357 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e44cd0c-e0ce-46d1-aa88-5eaa7db4f411 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:11.994639 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e44cd0c-e0ce-46d1-aa88-5eaa7db4f411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:12.013212 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-5e44cd0c-e0ce-46d1-aa88-5eaa7db4f411 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:22:12.014407 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-5e44cd0c-e0ce-46d1-aa88-5eaa7db4f411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:22:12.085703 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 160/312] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:22:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:22:12.110452 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab32948-e645-439c-b072-fdddb67860c7 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:12.220259 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab32948-e645-439c-b072-fdddb67860c7 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:12.255991 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab9af67-76db-40b4-9a3e-8d1c309cae63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:12.257113 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab9af67-76db-40b4-9a3e-8d1c309cae63 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:12.257620 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab9af67-76db-40b4-9a3e-8d1c309cae63 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:12.258067 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab9af67-76db-40b4-9a3e-8d1c309cae63 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:12.269310 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab9af67-76db-40b4-9a3e-8d1c309cae63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:22:12.276996 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-9ab9af67-76db-40b4-9a3e-8d1c309cae63 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 11 16:22:12.278674 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 153/313] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Apr 11 16:22:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:12.284700 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e44cd0c-e0ce-46d1-aa88-5eaa7db4f411 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:12.385581 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e44cd0c-e0ce-46d1-aa88-5eaa7db4f411 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:12.422780 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a409153b-32d4-4de4-bfb2-a9c687828cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:12.423819 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409153b-32d4-4de4-bfb2-a9c687828cc2 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:12.424336 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409153b-32d4-4de4-bfb2-a9c687828cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:12.425013 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409153b-32d4-4de4-bfb2-a9c687828cc2 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:12.425959 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a409153b-32d4-4de4-bfb2-a9c687828cc2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:12.426442 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a409153b-32d4-4de4-bfb2-a9c687828cc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:12.428023 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a409153b-32d4-4de4-bfb2-a9c687828cc2 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:12.437055 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 161/314] 10.222.0.43 () {56 vars in 1101 bytes} [Mon Apr 11 16:22:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:22:12.443341 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab9af67-76db-40b4-9a3e-8d1c309cae63 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:12.550971 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab9af67-76db-40b4-9a3e-8d1c309cae63 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:12.587140 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e956ca-de58-433f-9bcf-73d9afb9164a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:12.588052 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e956ca-de58-433f-9bcf-73d9afb9164a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:12.588334 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e956ca-de58-433f-9bcf-73d9afb9164a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:12.588610 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e956ca-de58-433f-9bcf-73d9afb9164a None admin] PATH_INFO: `/v3/users/734aafcac1914aa2831c4dbbf0bb04a4` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:12.589816 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e956ca-de58-433f-9bcf-73d9afb9164a None admin] RBAC: Authorizing `identity:get_user(user_id=734aafcac1914aa2831c4dbbf0bb04a4)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:12.591254 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e956ca-de58-433f-9bcf-73d9afb9164a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:12.593315 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 154/315] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Apr 11 16:22:12 2022] GET /identity/v3/users/734aafcac1914aa2831c4dbbf0bb04a4 => generated 297 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:12.599065 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a409153b-32d4-4de4-bfb2-a9c687828cc2 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:12.704260 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a409153b-32d4-4de4-bfb2-a9c687828cc2 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:12.738728 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783294be-c8c9-467a-b003-3d01e1c415f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:12.739392 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783294be-c8c9-467a-b003-3d01e1c415f4 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:12.739699 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783294be-c8c9-467a-b003-3d01e1c415f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:12.739976 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783294be-c8c9-467a-b003-3d01e1c415f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:12.808299 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783294be-c8c9-467a-b003-3d01e1c415f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:12.809690 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783294be-c8c9-467a-b003-3d01e1c415f4 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:12.910677 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 162/316] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Apr 11 16:22:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 16:22:12.916218 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e956ca-de58-433f-9bcf-73d9afb9164a None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:13.020629 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e956ca-de58-433f-9bcf-73d9afb9164a None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:13.055629 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db9e5fe-b255-4e0f-bf9a-b386df930ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:13.056490 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9e5fe-b255-4e0f-bf9a-b386df930ac9 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:13.056767 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9e5fe-b255-4e0f-bf9a-b386df930ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:13.057037 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9e5fe-b255-4e0f-bf9a-b386df930ac9 None admin] PATH_INFO: `/v3/projects/3ed98a96ee294394baa1187f4c99252f` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:13.058232 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db9e5fe-b255-4e0f-bf9a-b386df930ac9 None admin] RBAC: Authorizing `identity:get_project(project_id=3ed98a96ee294394baa1187f4c99252f)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:13.059729 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db9e5fe-b255-4e0f-bf9a-b386df930ac9 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:13.061359 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 155/317] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Apr 11 16:22:12 2022] GET /identity/v3/projects/3ed98a96ee294394baa1187f4c99252f => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:13.067274 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783294be-c8c9-467a-b003-3d01e1c415f4 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:13.165043 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783294be-c8c9-467a-b003-3d01e1c415f4 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:13.198959 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7108298-e6aa-4f46-96f9-cd4bdb3b1785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:13.199646 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7108298-e6aa-4f46-96f9-cd4bdb3b1785 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:13.199927 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7108298-e6aa-4f46-96f9-cd4bdb3b1785 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:13.200199 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7108298-e6aa-4f46-96f9-cd4bdb3b1785 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:13.201022 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7108298-e6aa-4f46-96f9-cd4bdb3b1785 None admin] RBAC: Adding query filter params (role.id=282780749a1d4592b823458aecfc5caf, scope.project.id=3ed98a96ee294394baa1187f4c99252f, user.id=734aafcac1914aa2831c4dbbf0bb04a4) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:13.201330 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7108298-e6aa-4f46-96f9-cd4bdb3b1785 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:13.202742 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7108298-e6aa-4f46-96f9-cd4bdb3b1785 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:13.209090 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 163/318] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Apr 11 16:22:13 2022] GET /identity/v3/role_assignments?user.id=734aafcac1914aa2831c4dbbf0bb04a4&scope.project.id=3ed98a96ee294394baa1187f4c99252f&role.id=282780749a1d4592b823458aecfc5caf => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:13.638817 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94537209-7d9f-4068-a643-253d46b2bea0 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:13.639325 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94537209-7d9f-4068-a643-253d46b2bea0 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:13.639399 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94537209-7d9f-4068-a643-253d46b2bea0 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:13.640821 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 156/319] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:22:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:22:13.646642 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b18692-1fe8-482a-b635-50924bc848f2 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:13.647063 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b18692-1fe8-482a-b635-50924bc848f2 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:13.647235 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b18692-1fe8-482a-b635-50924bc848f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:13.664257 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-13b18692-1fe8-482a-b635-50924bc848f2 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:22:13.665440 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-13b18692-1fe8-482a-b635-50924bc848f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:22:13.729676 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 164/320] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:22:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:22:13.755145 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94537209-7d9f-4068-a643-253d46b2bea0 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:13.858595 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94537209-7d9f-4068-a643-253d46b2bea0 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:13.890379 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1910ab-4c42-4a2b-8c1e-0664b8b0d9e6 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:13.890686 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1910ab-4c42-4a2b-8c1e-0664b8b0d9e6 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:13.890937 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1910ab-4c42-4a2b-8c1e-0664b8b0d9e6 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:13.892464 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2073a87-890a-45ff-bd3d-3c0b6f6dc6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:13.892587 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 165/321] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:22:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 16:22:13.893721 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2073a87-890a-45ff-bd3d-3c0b6f6dc6e7 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:13.894075 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2073a87-890a-45ff-bd3d-3c0b6f6dc6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:13.894347 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2073a87-890a-45ff-bd3d-3c0b6f6dc6e7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:13.897562 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb2db5-049b-4bd4-a711-a26ca06a890a None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:13.897847 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb2db5-049b-4bd4-a711-a26ca06a890a None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:13.898119 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb2db5-049b-4bd4-a711-a26ca06a890a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:13.904774 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2073a87-890a-45ff-bd3d-3c0b6f6dc6e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:22:13.912099 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-e2073a87-890a-45ff-bd3d-3c0b6f6dc6e7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 16:22:13.913307 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 157/322] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Apr 11 16:22:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:13.914343 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-4afb2db5-049b-4bd4-a711-a26ca06a890a None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:22:13.915536 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-4afb2db5-049b-4bd4-a711-a26ca06a890a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:22:13.918777 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2073a87-890a-45ff-bd3d-3c0b6f6dc6e7 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:13.979567 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 166/323] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:22:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 16:22:14.003400 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afb2db5-049b-4bd4-a711-a26ca06a890a None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:14.016957 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2073a87-890a-45ff-bd3d-3c0b6f6dc6e7 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:14.051576 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca19f80-2fb0-4322-a285-498ebee80689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:14.053077 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca19f80-2fb0-4322-a285-498ebee80689 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:14.053077 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca19f80-2fb0-4322-a285-498ebee80689 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:14.053077 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca19f80-2fb0-4322-a285-498ebee80689 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:14.054861 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca19f80-2fb0-4322-a285-498ebee80689 None admin] RBAC: Adding query filter params (name=member) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:14.054861 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca19f80-2fb0-4322-a285-498ebee80689 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:14.055196 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca19f80-2fb0-4322-a285-498ebee80689 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:14.069983 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 158/324] 10.222.0.43 () {56 vars in 1101 bytes} [Mon Apr 11 16:22:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:22:14.077738 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca19f80-2fb0-4322-a285-498ebee80689 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:14.104646 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afb2db5-049b-4bd4-a711-a26ca06a890a None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:14.141844 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2853b3-e857-4dfc-87a9-e1c0c5b3759f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:14.142677 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2853b3-e857-4dfc-87a9-e1c0c5b3759f None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:14.143132 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2853b3-e857-4dfc-87a9-e1c0c5b3759f None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:14.143411 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2853b3-e857-4dfc-87a9-e1c0c5b3759f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:14.144638 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2853b3-e857-4dfc-87a9-e1c0c5b3759f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:14.147669 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2853b3-e857-4dfc-87a9-e1c0c5b3759f None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:14.149311 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 167/325] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:22:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:22:14.154541 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2853b3-e857-4dfc-87a9-e1c0c5b3759f None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:14.186324 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca19f80-2fb0-4322-a285-498ebee80689 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:14.217559 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0110249-9fa6-46c9-a70f-6daf76bca778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:14.218421 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0110249-9fa6-46c9-a70f-6daf76bca778 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:14.218701 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0110249-9fa6-46c9-a70f-6daf76bca778 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:14.218975 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0110249-9fa6-46c9-a70f-6daf76bca778 None admin] PATH_INFO: `/v3/users/fcac630e149e4b409209d7c6f1b2c0da` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:14.220158 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0110249-9fa6-46c9-a70f-6daf76bca778 None admin] RBAC: Authorizing `identity:get_user(user_id=fcac630e149e4b409209d7c6f1b2c0da)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:14.221631 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0110249-9fa6-46c9-a70f-6daf76bca778 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:14.223233 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 159/326] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Apr 11 16:22:14 2022] GET /identity/v3/users/fcac630e149e4b409209d7c6f1b2c0da => generated 293 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:22:14.224413 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623af9e-2e67-49a5-ae52-01ce31557178 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:14.224694 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623af9e-2e67-49a5-ae52-01ce31557178 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:14.224966 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623af9e-2e67-49a5-ae52-01ce31557178 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:14.226198 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 160/327] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:22:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:22:14.228805 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b623af9e-2e67-49a5-ae52-01ce31557178 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:14.250759 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2853b3-e857-4dfc-87a9-e1c0c5b3759f None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:14.282697 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b80286d-6063-477b-95b9-be2f3f4765a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:14.283377 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80286d-6063-477b-95b9-be2f3f4765a8 None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:14.283816 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80286d-6063-477b-95b9-be2f3f4765a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:14.284111 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80286d-6063-477b-95b9-be2f3f4765a8 None admin] PATH_INFO: `/v3/groups` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:14.284796 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b80286d-6063-477b-95b9-be2f3f4765a8 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:14.286206 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b80286d-6063-477b-95b9-be2f3f4765a8 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:14.324030 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b623af9e-2e67-49a5-ae52-01ce31557178 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:14.355052 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e623f7-dfc9-4cc6-997c-b92489a3c731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:14.355720 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e623f7-dfc9-4cc6-997c-b92489a3c731 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:14.356004 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e623f7-dfc9-4cc6-997c-b92489a3c731 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:14.356280 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e623f7-dfc9-4cc6-997c-b92489a3c731 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:14.357125 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e623f7-dfc9-4cc6-997c-b92489a3c731 None admin] RBAC: Adding query filter params (role.id=0d41da7bec094450b5bff4e4831be52c, user.id=fcac630e149e4b409209d7c6f1b2c0da, scope.system=all) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:14.357445 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e623f7-dfc9-4cc6-997c-b92489a3c731 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:14.358854 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e623f7-dfc9-4cc6-997c-b92489a3c731 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:14.370176 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 161/328] 10.222.0.43 () {56 vars in 1308 bytes} [Mon Apr 11 16:22:14 2022] GET /identity/v3/role_assignments?user.id=fcac630e149e4b409209d7c6f1b2c0da&scope.system=all&role.id=0d41da7bec094450b5bff4e4831be52c => generated 510 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:22:14.391563 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd99fa-08c9-4800-aa07-a78a383ee58b None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:14.391563 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd99fa-08c9-4800-aa07-a78a383ee58b None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:14.391563 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd99fa-08c9-4800-aa07-a78a383ee58b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:14.391563 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-afcd99fa-08c9-4800-aa07-a78a383ee58b None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:22:14.391563 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-afcd99fa-08c9-4800-aa07-a78a383ee58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:22:14.421540 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 168/329] 10.222.0.43 () {60 vars in 1134 bytes} [Mon Apr 11 16:22:14 2022] POST /identity/v3/groups => generated 226 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:22:14.476298 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 162/330] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:22:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:22:14.498926 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b80286d-6063-477b-95b9-be2f3f4765a8 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:14.619790 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b80286d-6063-477b-95b9-be2f3f4765a8 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:14.655238 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96929e14-15eb-4004-a8c8-ae2bdc90e42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:14.656069 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96929e14-15eb-4004-a8c8-ae2bdc90e42e None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:14.656349 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96929e14-15eb-4004-a8c8-ae2bdc90e42e None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:14.656619 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96929e14-15eb-4004-a8c8-ae2bdc90e42e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:14.667034 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96929e14-15eb-4004-a8c8-ae2bdc90e42e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:22:14.674721 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-96929e14-15eb-4004-a8c8-ae2bdc90e42e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 11 16:22:14.675943 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 169/331] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Apr 11 16:22:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:22:14.681714 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcd99fa-08c9-4800-aa07-a78a383ee58b None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:14.779370 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcd99fa-08c9-4800-aa07-a78a383ee58b None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:14.817115 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc1341-cfd1-46fd-94c2-6fa8ea46bbfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:14.817807 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc1341-cfd1-46fd-94c2-6fa8ea46bbfd None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:14.818091 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc1341-cfd1-46fd-94c2-6fa8ea46bbfd None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:14.818368 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc1341-cfd1-46fd-94c2-6fa8ea46bbfd None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:14.819126 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fc1341-cfd1-46fd-94c2-6fa8ea46bbfd None admin] RBAC: Adding query filter params (name=reader) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:14.819434 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fc1341-cfd1-46fd-94c2-6fa8ea46bbfd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:14.820998 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fc1341-cfd1-46fd-94c2-6fa8ea46bbfd None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:14.829972 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 163/332] 10.222.0.43 () {56 vars in 1101 bytes} [Mon Apr 11 16:22:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:14.838246 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96929e14-15eb-4004-a8c8-ae2bdc90e42e None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:14.943355 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96929e14-15eb-4004-a8c8-ae2bdc90e42e None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:14.977292 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eea919f-2465-4978-94b5-bc4aade1f957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:14.978548 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea919f-2465-4978-94b5-bc4aade1f957 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:14.979031 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea919f-2465-4978-94b5-bc4aade1f957 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:14.979500 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea919f-2465-4978-94b5-bc4aade1f957 None admin] PATH_INFO: `/v3/users/175ead05a2db44c79d3f2074cffb5b98` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:14.984102 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eea919f-2465-4978-94b5-bc4aade1f957 None admin] RBAC: Authorizing `identity:get_user(user_id=175ead05a2db44c79d3f2074cffb5b98)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:14.984102 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eea919f-2465-4978-94b5-bc4aade1f957 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:14.985679 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 170/333] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Apr 11 16:22:14 2022] GET /identity/v3/users/175ead05a2db44c79d3f2074cffb5b98 => generated 293 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:14.991825 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc1341-cfd1-46fd-94c2-6fa8ea46bbfd None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:15.125522 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc1341-cfd1-46fd-94c2-6fa8ea46bbfd None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:15.167776 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1351885a-b37e-4524-9aac-720d2016c6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:15.168691 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351885a-b37e-4524-9aac-720d2016c6e3 None admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:15.168981 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351885a-b37e-4524-9aac-720d2016c6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:15.169259 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351885a-b37e-4524-9aac-720d2016c6e3 None admin] PATH_INFO: `/v3/system/users/175ead05a2db44c79d3f2074cffb5b98/roles/282780749a1d4592b823458aecfc5caf` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:15.172080 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1351885a-b37e-4524-9aac-720d2016c6e3 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=175ead05a2db44c79d3f2074cffb5b98, role_id=282780749a1d4592b823458aecfc5caf)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:15.173447 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1351885a-b37e-4524-9aac-720d2016c6e3 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:15.257024 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 164/334] 10.222.0.43 () {58 vars in 1334 bytes} [Mon Apr 11 16:22:14 2022] PUT /identity/v3/system/users/175ead05a2db44c79d3f2074cffb5b98/roles/282780749a1d4592b823458aecfc5caf => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:22:17.383322 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947a647-86b2-4bb9-91e8-a24ee40b766e None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:17.383879 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947a647-86b2-4bb9-91e8-a24ee40b766e None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:17.383959 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947a647-86b2-4bb9-91e8-a24ee40b766e None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:17.385276 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 171/335] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:22:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:22:17.400916 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c93d8c4-bfa6-4062-9748-453798444274 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:17.401380 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c93d8c4-bfa6-4062-9748-453798444274 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:17.401454 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c93d8c4-bfa6-4062-9748-453798444274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:17.420502 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-3c93d8c4-bfa6-4062-9748-453798444274 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:22:17.421699 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-3c93d8c4-bfa6-4062-9748-453798444274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:22:17.512281 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 165/336] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:22:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:22:17.560575 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6947a647-86b2-4bb9-91e8-a24ee40b766e None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:17.669530 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6947a647-86b2-4bb9-91e8-a24ee40b766e None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:17.711219 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a401d-3672-458a-985a-e17a9f998497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:17.712074 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a401d-3672-458a-985a-e17a9f998497 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:17.712354 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a401d-3672-458a-985a-e17a9f998497 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:17.712634 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a401d-3672-458a-985a-e17a9f998497 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:17.727692 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050a401d-3672-458a-985a-e17a9f998497 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:22:17.735277 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-050a401d-3672-458a-985a-e17a9f998497 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 16:22:17.737497 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 172/337] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Apr 11 16:22:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:17.743133 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c93d8c4-bfa6-4062-9748-453798444274 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:17.858862 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c93d8c4-bfa6-4062-9748-453798444274 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:17.895682 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4c240d-2108-4bb4-8788-d128b8dfd719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:17.896365 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c240d-2108-4bb4-8788-d128b8dfd719 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:17.896645 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c240d-2108-4bb4-8788-d128b8dfd719 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:17.896922 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c240d-2108-4bb4-8788-d128b8dfd719 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:17.897677 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4c240d-2108-4bb4-8788-d128b8dfd719 None admin] RBAC: Adding query filter params (name=member) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:17.897980 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4c240d-2108-4bb4-8788-d128b8dfd719 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:17.899330 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4c240d-2108-4bb4-8788-d128b8dfd719 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:17.912130 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 166/338] 10.222.0.43 () {56 vars in 1101 bytes} [Mon Apr 11 16:22:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:17.917896 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a401d-3672-458a-985a-e17a9f998497 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:18.045940 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a401d-3672-458a-985a-e17a9f998497 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:18.083633 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ecf2c-aa2d-400b-8b39-035788001df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:18.084307 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ecf2c-aa2d-400b-8b39-035788001df4 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:18.084592 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ecf2c-aa2d-400b-8b39-035788001df4 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:18.084870 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ecf2c-aa2d-400b-8b39-035788001df4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:18.171466 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647ecf2c-aa2d-400b-8b39-035788001df4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:18.172943 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647ecf2c-aa2d-400b-8b39-035788001df4 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:18.293035 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 173/339] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Apr 11 16:22:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 16:22:18.299849 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4c240d-2108-4bb4-8788-d128b8dfd719 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:18.312061 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76917f48-f652-4987-956e-25c872608a70 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:18.312947 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76917f48-f652-4987-956e-25c872608a70 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:18.313239 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76917f48-f652-4987-956e-25c872608a70 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:18.315439 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 174/340] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:22:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:22:18.320840 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daffd901-d817-4e51-af22-06663aece2b5 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:18.321135 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daffd901-d817-4e51-af22-06663aece2b5 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:18.321415 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daffd901-d817-4e51-af22-06663aece2b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:18.342007 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-daffd901-d817-4e51-af22-06663aece2b5 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:22:18.343253 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-daffd901-d817-4e51-af22-06663aece2b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:22:18.427622 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 175/341] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:22:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 16:22:18.460672 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daffd901-d817-4e51-af22-06663aece2b5 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:18.484155 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4c240d-2108-4bb4-8788-d128b8dfd719 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:18.535310 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688fdbb2-9267-4656-ac8c-4630949c8264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:18.536220 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688fdbb2-9267-4656-ac8c-4630949c8264 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:18.536504 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688fdbb2-9267-4656-ac8c-4630949c8264 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:18.536781 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688fdbb2-9267-4656-ac8c-4630949c8264 None admin] PATH_INFO: `/v3/projects/5fcfe56fb9bf4cc7b15db190133a1d28` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:18.538881 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688fdbb2-9267-4656-ac8c-4630949c8264 None admin] RBAC: Authorizing `identity:get_project(project_id=5fcfe56fb9bf4cc7b15db190133a1d28)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:18.540344 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688fdbb2-9267-4656-ac8c-4630949c8264 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:18.542592 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 167/342] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Apr 11 16:22:18 2022] GET /identity/v3/projects/5fcfe56fb9bf4cc7b15db190133a1d28 => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:18.544019 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c13d0b-fcc9-4056-bf15-7cc79ffb0d1a None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:18.544489 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c13d0b-fcc9-4056-bf15-7cc79ffb0d1a None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:18.544939 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c13d0b-fcc9-4056-bf15-7cc79ffb0d1a None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:18.546347 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 168/343] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:22:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:22:18.550625 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5e63f-5c1c-4c2e-9d06-f0994c6c0788 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:18.551149 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5e63f-5c1c-4c2e-9d06-f0994c6c0788 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:18.552129 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5e63f-5c1c-4c2e-9d06-f0994c6c0788 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:18.553694 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 169/344] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:22:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:22:18.555013 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012d684-d645-4b24-ab74-9e5bd74f1d5f None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:18.555500 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012d684-d645-4b24-ab74-9e5bd74f1d5f None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:18.555970 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012d684-d645-4b24-ab74-9e5bd74f1d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:18.578794 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-1012d684-d645-4b24-ab74-9e5bd74f1d5f None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:22:18.580629 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-1012d684-d645-4b24-ab74-9e5bd74f1d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:22:18.609867 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daffd901-d817-4e51-af22-06663aece2b5 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:18.656164 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b202d0f4-f151-4881-b411-bf2558da851c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:18.657360 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b202d0f4-f151-4881-b411-bf2558da851c None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:18.658478 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b202d0f4-f151-4881-b411-bf2558da851c None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:18.658947 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b202d0f4-f151-4881-b411-bf2558da851c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:18.666924 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 170/345] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:22:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:22:18.668718 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e4fd0d-28b8-4bc0-88d8-c9edd31c5462 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:18.669442 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e4fd0d-28b8-4bc0-88d8-c9edd31c5462 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:18.669866 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e4fd0d-28b8-4bc0-88d8-c9edd31c5462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:18.672128 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b202d0f4-f151-4881-b411-bf2558da851c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:22:18.681115 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-b202d0f4-f151-4881-b411-bf2558da851c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 11 16:22:18.682937 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 176/346] 10.222.0.43 () {56 vars in 1114 bytes} [Mon Apr 11 16:22:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:22:18.683996 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b202d0f4-f151-4881-b411-bf2558da851c None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:18.688488 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-55e4fd0d-28b8-4bc0-88d8-c9edd31c5462 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:22:18.690869 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-55e4fd0d-28b8-4bc0-88d8-c9edd31c5462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:22:18.791551 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 171/347] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:22:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:22:18.791551 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e4fd0d-28b8-4bc0-88d8-c9edd31c5462 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:18.832579 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b202d0f4-f151-4881-b411-bf2558da851c None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:18.874503 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95120a4-2d46-4ec3-b7c2-44fb62361c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:18.875377 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95120a4-2d46-4ec3-b7c2-44fb62361c9b None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:18.875712 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95120a4-2d46-4ec3-b7c2-44fb62361c9b None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:18.875988 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95120a4-2d46-4ec3-b7c2-44fb62361c9b None admin] PATH_INFO: `/v3/groups/2cade8741bed455d8939dd1ccac8e573` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:18.882770 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95120a4-2d46-4ec3-b7c2-44fb62361c9b None admin] RBAC: Authorizing `identity:get_group(group_id=2cade8741bed455d8939dd1ccac8e573)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:18.884508 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95120a4-2d46-4ec3-b7c2-44fb62361c9b None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:18.886069 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 177/348] 10.222.0.43 () {56 vars in 1180 bytes} [Mon Apr 11 16:22:18 2022] GET /identity/v3/groups/2cade8741bed455d8939dd1ccac8e573 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:18.886753 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95120a4-2d46-4ec3-b7c2-44fb62361c9b None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:18.913886 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e4fd0d-28b8-4bc0-88d8-c9edd31c5462 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:18.971840 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cc2a63-bdb6-4fa5-aaef-8e7c14357c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:18.972533 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cc2a63-bdb6-4fa5-aaef-8e7c14357c9d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:18.972851 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cc2a63-bdb6-4fa5-aaef-8e7c14357c9d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:18.973138 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cc2a63-bdb6-4fa5-aaef-8e7c14357c9d None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:18.973863 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cc2a63-bdb6-4fa5-aaef-8e7c14357c9d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:18.974172 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cc2a63-bdb6-4fa5-aaef-8e7c14357c9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:18.976489 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cc2a63-bdb6-4fa5-aaef-8e7c14357c9d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:18.987012 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 172/349] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Apr 11 16:22:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:18.992661 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cc2a63-bdb6-4fa5-aaef-8e7c14357c9d None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:19.016228 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95120a4-2d46-4ec3-b7c2-44fb62361c9b None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:19.063952 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba284b-e978-4c85-9ee5-fbda518b7eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:19.065121 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba284b-e978-4c85-9ee5-fbda518b7eee None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:19.065548 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba284b-e978-4c85-9ee5-fbda518b7eee None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:19.065971 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba284b-e978-4c85-9ee5-fbda518b7eee None admin] PATH_INFO: `/v3/roles/member` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:19.081987 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dba284b-e978-4c85-9ee5-fbda518b7eee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:22:19.091356 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-8dba284b-e978-4c85-9ee5-fbda518b7eee None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 16:22:19.092996 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 178/350] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Apr 11 16:22:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:19.094253 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23757857-1c87-45be-be48-b3d63151f845 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:19.094540 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23757857-1c87-45be-be48-b3d63151f845 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:19.095550 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23757857-1c87-45be-be48-b3d63151f845 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:19.101033 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 179/351] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:22:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:22:19.101921 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23757857-1c87-45be-be48-b3d63151f845 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:19.109113 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cc2a63-bdb6-4fa5-aaef-8e7c14357c9d None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:19.158529 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a3eb5f-9a33-40ce-a0b6-d16c93df7536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:19.159355 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a3eb5f-9a33-40ce-a0b6-d16c93df7536 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:19.159675 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a3eb5f-9a33-40ce-a0b6-d16c93df7536 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:19.159956 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a3eb5f-9a33-40ce-a0b6-d16c93df7536 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:19.173150 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a3eb5f-9a33-40ce-a0b6-d16c93df7536 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:22:19.181163 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-23a3eb5f-9a33-40ce-a0b6-d16c93df7536 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 11 16:22:19.182579 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 173/352] 10.222.0.43 () {56 vars in 1114 bytes} [Mon Apr 11 16:22:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:19.183493 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a3eb5f-9a33-40ce-a0b6-d16c93df7536 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:19.241662 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23757857-1c87-45be-be48-b3d63151f845 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:19.289850 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359991e1-5718-4070-ba7c-e54079c6e40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:19.293290 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359991e1-5718-4070-ba7c-e54079c6e40e None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:19.293290 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359991e1-5718-4070-ba7c-e54079c6e40e None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:19.293290 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359991e1-5718-4070-ba7c-e54079c6e40e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:19.293290 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359991e1-5718-4070-ba7c-e54079c6e40e None admin] RBAC: Adding query filter params (group.id=2cade8741bed455d8939dd1ccac8e573, role.id=0d41da7bec094450b5bff4e4831be52c, scope.project.id=5fcfe56fb9bf4cc7b15db190133a1d28) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:19.293651 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359991e1-5718-4070-ba7c-e54079c6e40e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:19.295016 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359991e1-5718-4070-ba7c-e54079c6e40e None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:19.304486 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 180/353] 10.222.0.43 () {56 vars in 1376 bytes} [Mon Apr 11 16:22:19 2022] GET /identity/v3/role_assignments?group.id=2cade8741bed455d8939dd1ccac8e573&scope.project.id=5fcfe56fb9bf4cc7b15db190133a1d28&role.id=0d41da7bec094450b5bff4e4831be52c => generated 260 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:19.305546 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359991e1-5718-4070-ba7c-e54079c6e40e None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:19.305978 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a3eb5f-9a33-40ce-a0b6-d16c93df7536 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:19.348836 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fbc970-ef36-461d-a856-0cdde7b2c34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:19.349763 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fbc970-ef36-461d-a856-0cdde7b2c34b None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:19.350199 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fbc970-ef36-461d-a856-0cdde7b2c34b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:19.350625 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fbc970-ef36-461d-a856-0cdde7b2c34b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:19.425312 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359991e1-5718-4070-ba7c-e54079c6e40e None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:19.430410 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fbc970-ef36-461d-a856-0cdde7b2c34b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:19.432162 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fbc970-ef36-461d-a856-0cdde7b2c34b None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:19.465954 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07992a13-c94e-47df-b500-4e9e342a2379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:19.466515 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07992a13-c94e-47df-b500-4e9e342a2379 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:19.466756 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07992a13-c94e-47df-b500-4e9e342a2379 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:19.467037 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07992a13-c94e-47df-b500-4e9e342a2379 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:19.467924 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07992a13-c94e-47df-b500-4e9e342a2379 None admin] RBAC: Adding query filter params (name=member) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:19.468227 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07992a13-c94e-47df-b500-4e9e342a2379 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:19.475505 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07992a13-c94e-47df-b500-4e9e342a2379 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:19.485280 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 181/354] 10.222.0.43 () {56 vars in 1101 bytes} [Mon Apr 11 16:22:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:19.487543 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed128d-e0d1-42fe-a0a0-c64c678b5138 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:19.487749 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed128d-e0d1-42fe-a0a0-c64c678b5138 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:19.488092 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed128d-e0d1-42fe-a0a0-c64c678b5138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:19.508504 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-38ed128d-e0d1-42fe-a0a0-c64c678b5138 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:22:19.511186 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-38ed128d-e0d1-42fe-a0a0-c64c678b5138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:22:19.562271 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 174/355] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Apr 11 16:22:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 16:22:19.563291 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fbc970-ef36-461d-a856-0cdde7b2c34b None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:19.598147 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 182/356] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:22:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:22:19.599925 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064fbcda-681f-4278-9a42-5afde7f55226 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:19.600425 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064fbcda-681f-4278-9a42-5afde7f55226 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:19.600892 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064fbcda-681f-4278-9a42-5afde7f55226 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:19.602616 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 183/357] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:22:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:22:19.607435 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064fbcda-681f-4278-9a42-5afde7f55226 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:19.697902 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fbc970-ef36-461d-a856-0cdde7b2c34b None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:19.743955 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064fbcda-681f-4278-9a42-5afde7f55226 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:19.748323 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ccf517-0f0e-486f-a437-9810c259174a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:19.749274 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ccf517-0f0e-486f-a437-9810c259174a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:19.749557 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ccf517-0f0e-486f-a437-9810c259174a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:19.749889 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ccf517-0f0e-486f-a437-9810c259174a None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:19.750674 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ccf517-0f0e-486f-a437-9810c259174a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:19.751037 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ccf517-0f0e-486f-a437-9810c259174a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:19.752616 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ccf517-0f0e-486f-a437-9810c259174a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:19.761722 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 175/358] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Apr 11 16:22:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:19.762900 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ccf517-0f0e-486f-a437-9810c259174a None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:19.797575 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd77f4ae-f1f4-4335-9e3f-c945ab077550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:19.799787 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd77f4ae-f1f4-4335-9e3f-c945ab077550 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:19.800076 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd77f4ae-f1f4-4335-9e3f-c945ab077550 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:19.800360 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd77f4ae-f1f4-4335-9e3f-c945ab077550 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:19.886481 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd77f4ae-f1f4-4335-9e3f-c945ab077550 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:19.888312 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd77f4ae-f1f4-4335-9e3f-c945ab077550 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:19.897637 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ccf517-0f0e-486f-a437-9810c259174a None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:19.935698 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff30287-ddb5-4d47-970e-15957fcf2738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:19.936572 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff30287-ddb5-4d47-970e-15957fcf2738 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:19.936859 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff30287-ddb5-4d47-970e-15957fcf2738 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:19.937133 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff30287-ddb5-4d47-970e-15957fcf2738 None admin] PATH_INFO: `/v3/projects/5fcfe56fb9bf4cc7b15db190133a1d28` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:19.938497 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff30287-ddb5-4d47-970e-15957fcf2738 None admin] RBAC: Authorizing `identity:get_project(project_id=5fcfe56fb9bf4cc7b15db190133a1d28)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:19.940622 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff30287-ddb5-4d47-970e-15957fcf2738 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:19.942410 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 176/359] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Apr 11 16:22:19 2022] GET /identity/v3/projects/5fcfe56fb9bf4cc7b15db190133a1d28 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:19.944250 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed00a992-8631-489c-9658-977951a1ed4a None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:19.945464 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed00a992-8631-489c-9658-977951a1ed4a None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:19.946077 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed00a992-8631-489c-9658-977951a1ed4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:19.968036 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-ed00a992-8631-489c-9658-977951a1ed4a None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:22:19.969437 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ed00a992-8631-489c-9658-977951a1ed4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:22:20.017814 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 184/360] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Apr 11 16:22:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 16:22:20.018602 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd77f4ae-f1f4-4335-9e3f-c945ab077550 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:20.058378 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 177/361] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:22:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:22:20.059441 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed00a992-8631-489c-9658-977951a1ed4a None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:20.163662 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd77f4ae-f1f4-4335-9e3f-c945ab077550 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:20.194569 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed00a992-8631-489c-9658-977951a1ed4a None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:20.213710 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d3e495-7e21-4044-ae46-b0420f05b160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:20.214817 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3e495-7e21-4044-ae46-b0420f05b160 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:20.215106 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3e495-7e21-4044-ae46-b0420f05b160 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:20.215381 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3e495-7e21-4044-ae46-b0420f05b160 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:20.226977 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d3e495-7e21-4044-ae46-b0420f05b160 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:22:20.234230 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-92d3e495-7e21-4044-ae46-b0420f05b160 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 11 16:22:20.238978 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 185/362] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Apr 11 16:22:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:20.238978 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d3e495-7e21-4044-ae46-b0420f05b160 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:20.244516 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc30278-c79e-45dd-b14f-ff07b2fffc38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:20.245444 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc30278-c79e-45dd-b14f-ff07b2fffc38 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:20.245985 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc30278-c79e-45dd-b14f-ff07b2fffc38 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:20.246467 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc30278-c79e-45dd-b14f-ff07b2fffc38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:20.325465 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc30278-c79e-45dd-b14f-ff07b2fffc38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:20.327140 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc30278-c79e-45dd-b14f-ff07b2fffc38 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:20.362207 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d3e495-7e21-4044-ae46-b0420f05b160 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:20.414332 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c525dac-3be9-4293-bee2-12d6e0e1c2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:20.415916 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c525dac-3be9-4293-bee2-12d6e0e1c2e2 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:20.416333 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c525dac-3be9-4293-bee2-12d6e0e1c2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:20.416749 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c525dac-3be9-4293-bee2-12d6e0e1c2e2 None admin] PATH_INFO: `/v3/groups/2cade8741bed455d8939dd1ccac8e573` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:20.418133 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c525dac-3be9-4293-bee2-12d6e0e1c2e2 None admin] RBAC: Authorizing `identity:get_group(group_id=2cade8741bed455d8939dd1ccac8e573)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:20.419763 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c525dac-3be9-4293-bee2-12d6e0e1c2e2 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:20.421569 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 186/363] 10.222.0.43 () {56 vars in 1180 bytes} [Mon Apr 11 16:22:20 2022] GET /identity/v3/groups/2cade8741bed455d8939dd1ccac8e573 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:20.422540 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c525dac-3be9-4293-bee2-12d6e0e1c2e2 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:20.444282 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 178/364] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Apr 11 16:22:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 16:22:20.445208 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc30278-c79e-45dd-b14f-ff07b2fffc38 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:20.526763 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c525dac-3be9-4293-bee2-12d6e0e1c2e2 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:20.566031 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc30278-c79e-45dd-b14f-ff07b2fffc38 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:20.573315 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd92547-d88d-4f7e-8028-31cbd824dabd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:20.574191 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd92547-d88d-4f7e-8028-31cbd824dabd None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:20.574475 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd92547-d88d-4f7e-8028-31cbd824dabd None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:20.574749 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd92547-d88d-4f7e-8028-31cbd824dabd None admin] PATH_INFO: `/v3/projects/3ed98a96ee294394baa1187f4c99252f` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:20.575973 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd92547-d88d-4f7e-8028-31cbd824dabd None admin] RBAC: Authorizing `identity:get_project(project_id=3ed98a96ee294394baa1187f4c99252f)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:20.577575 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd92547-d88d-4f7e-8028-31cbd824dabd None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:20.579862 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 187/365] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Apr 11 16:22:20 2022] GET /identity/v3/projects/3ed98a96ee294394baa1187f4c99252f => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:20.580983 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd92547-d88d-4f7e-8028-31cbd824dabd None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:20.614418 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e1909-2fd8-4843-b3d2-8930958ed9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:20.615229 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e1909-2fd8-4843-b3d2-8930958ed9ad None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:20.615561 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e1909-2fd8-4843-b3d2-8930958ed9ad None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:20.615848 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e1909-2fd8-4843-b3d2-8930958ed9ad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:20.628876 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84e1909-2fd8-4843-b3d2-8930958ed9ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:22:20.635897 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-f84e1909-2fd8-4843-b3d2-8930958ed9ad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 16:22:20.637279 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 179/366] 10.222.0.43 () {56 vars in 1096 bytes} [Mon Apr 11 16:22:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:20.642897 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e1909-2fd8-4843-b3d2-8930958ed9ad None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:20.687133 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd92547-d88d-4f7e-8028-31cbd824dabd None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:20.734953 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812b84d4-b3b3-4a58-b24e-08b82109aad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:20.736282 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b84d4-b3b3-4a58-b24e-08b82109aad1 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:20.736567 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b84d4-b3b3-4a58-b24e-08b82109aad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:20.736843 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b84d4-b3b3-4a58-b24e-08b82109aad1 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:20.737597 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812b84d4-b3b3-4a58-b24e-08b82109aad1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:20.737905 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812b84d4-b3b3-4a58-b24e-08b82109aad1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:20.739299 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812b84d4-b3b3-4a58-b24e-08b82109aad1 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:20.749524 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 188/367] 10.222.0.43 () {56 vars in 1101 bytes} [Mon Apr 11 16:22:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:20.754843 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812b84d4-b3b3-4a58-b24e-08b82109aad1 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:20.769106 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e1909-2fd8-4843-b3d2-8930958ed9ad None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:20.803532 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d7bc11-02be-4a1c-89ea-7ae678f13c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:20.804203 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7bc11-02be-4a1c-89ea-7ae678f13c43 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:20.804484 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7bc11-02be-4a1c-89ea-7ae678f13c43 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:20.804755 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7bc11-02be-4a1c-89ea-7ae678f13c43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:20.805580 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d7bc11-02be-4a1c-89ea-7ae678f13c43 None admin] RBAC: Adding query filter params (group.id=2cade8741bed455d8939dd1ccac8e573, role.id=7d3d5d04ca634b3a9b63e7b05bb5d333, scope.project.id=5fcfe56fb9bf4cc7b15db190133a1d28) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:20.805889 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d7bc11-02be-4a1c-89ea-7ae678f13c43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:20.807310 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d7bc11-02be-4a1c-89ea-7ae678f13c43 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:20.812477 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 180/368] 10.222.0.43 () {56 vars in 1376 bytes} [Mon Apr 11 16:22:20 2022] GET /identity/v3/role_assignments?group.id=2cade8741bed455d8939dd1ccac8e573&scope.project.id=5fcfe56fb9bf4cc7b15db190133a1d28&role.id=7d3d5d04ca634b3a9b63e7b05bb5d333 => generated 260 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:20.813245 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d7bc11-02be-4a1c-89ea-7ae678f13c43 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:20.886894 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812b84d4-b3b3-4a58-b24e-08b82109aad1 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:20.924577 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d7bc11-02be-4a1c-89ea-7ae678f13c43 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:20.932300 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4acc52a-4529-4dc5-a5f7-54e671fcdb2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:20.933202 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4acc52a-4529-4dc5-a5f7-54e671fcdb2f None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:20.933488 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4acc52a-4529-4dc5-a5f7-54e671fcdb2f None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:20.934273 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4acc52a-4529-4dc5-a5f7-54e671fcdb2f None admin] PATH_INFO: `/v3/projects/3ed98a96ee294394baa1187f4c99252f` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:20.935191 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4acc52a-4529-4dc5-a5f7-54e671fcdb2f None admin] RBAC: Authorizing `identity:get_project(project_id=3ed98a96ee294394baa1187f4c99252f)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:20.936963 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4acc52a-4529-4dc5-a5f7-54e671fcdb2f None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:20.939042 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 189/369] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Apr 11 16:22:20 2022] GET /identity/v3/projects/3ed98a96ee294394baa1187f4c99252f => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:20.940116 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4acc52a-4529-4dc5-a5f7-54e671fcdb2f None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:20.973174 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c58615-28d2-431d-a748-833bd98796d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:20.975049 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c58615-28d2-431d-a748-833bd98796d0 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:20.975596 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c58615-28d2-431d-a748-833bd98796d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:20.976201 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c58615-28d2-431d-a748-833bd98796d0 None admin] PATH_INFO: `/v3/groups/2cade8741bed455d8939dd1ccac8e573` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:20.978349 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c58615-28d2-431d-a748-833bd98796d0 None admin] RBAC: Authorizing `identity:get_group(group_id=2cade8741bed455d8939dd1ccac8e573)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:20.980546 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c58615-28d2-431d-a748-833bd98796d0 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:20.982832 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 181/370] 10.222.0.43 () {56 vars in 1180 bytes} [Mon Apr 11 16:22:20 2022] GET /identity/v3/groups/2cade8741bed455d8939dd1ccac8e573 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:20.984201 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c58615-28d2-431d-a748-833bd98796d0 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:21.061378 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4acc52a-4529-4dc5-a5f7-54e671fcdb2f None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:21.101586 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663b7332-51b3-4330-a1ee-1438de466e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:21.102511 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b7332-51b3-4330-a1ee-1438de466e79 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:21.102935 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b7332-51b3-4330-a1ee-1438de466e79 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:21.103438 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b7332-51b3-4330-a1ee-1438de466e79 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:21.104421 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663b7332-51b3-4330-a1ee-1438de466e79 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:21.104952 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663b7332-51b3-4330-a1ee-1438de466e79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:21.106516 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663b7332-51b3-4330-a1ee-1438de466e79 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:21.112629 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c58615-28d2-431d-a748-833bd98796d0 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:21.115376 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 190/371] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Apr 11 16:22:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:21.116459 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663b7332-51b3-4330-a1ee-1438de466e79 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:21.152175 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaa02f8-7a51-4700-905b-d1dec134ab51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:21.153437 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa02f8-7a51-4700-905b-d1dec134ab51 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:21.153935 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa02f8-7a51-4700-905b-d1dec134ab51 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:21.154409 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa02f8-7a51-4700-905b-d1dec134ab51 None admin] PATH_INFO: `/v3/users/175ead05a2db44c79d3f2074cffb5b98` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:21.155858 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaa02f8-7a51-4700-905b-d1dec134ab51 None admin] RBAC: Authorizing `identity:get_user(user_id=175ead05a2db44c79d3f2074cffb5b98)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:21.158246 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaa02f8-7a51-4700-905b-d1dec134ab51 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:21.160269 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 182/372] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Apr 11 16:22:20 2022] GET /identity/v3/users/175ead05a2db44c79d3f2074cffb5b98 => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:21.161248 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaa02f8-7a51-4700-905b-d1dec134ab51 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:21.249584 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663b7332-51b3-4330-a1ee-1438de466e79 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:21.272931 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaa02f8-7a51-4700-905b-d1dec134ab51 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:21.297414 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be36e45d-4425-45ae-ae32-a3e9b58f2f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:21.299111 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be36e45d-4425-45ae-ae32-a3e9b58f2f7f None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:21.299403 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be36e45d-4425-45ae-ae32-a3e9b58f2f7f None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:21.299733 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be36e45d-4425-45ae-ae32-a3e9b58f2f7f None admin] PATH_INFO: `/v3/groups/2cade8741bed455d8939dd1ccac8e573` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:21.301355 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be36e45d-4425-45ae-ae32-a3e9b58f2f7f None admin] RBAC: Authorizing `identity:get_group(group_id=2cade8741bed455d8939dd1ccac8e573)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:21.303061 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be36e45d-4425-45ae-ae32-a3e9b58f2f7f None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:21.305947 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 191/373] 10.222.0.43 () {56 vars in 1180 bytes} [Mon Apr 11 16:22:21 2022] GET /identity/v3/groups/2cade8741bed455d8939dd1ccac8e573 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:21.306964 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be36e45d-4425-45ae-ae32-a3e9b58f2f7f None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:21.309203 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba21819-7dd5-4d24-9096-e09cdb0e8b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:21.310083 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba21819-7dd5-4d24-9096-e09cdb0e8b76 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:21.310555 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba21819-7dd5-4d24-9096-e09cdb0e8b76 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:21.311049 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba21819-7dd5-4d24-9096-e09cdb0e8b76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:21.312114 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba21819-7dd5-4d24-9096-e09cdb0e8b76 None admin] RBAC: Adding query filter params (group.id=2cade8741bed455d8939dd1ccac8e573, role.id=0d41da7bec094450b5bff4e4831be52c, scope.project.id=3ed98a96ee294394baa1187f4c99252f) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:21.312620 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba21819-7dd5-4d24-9096-e09cdb0e8b76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:21.315389 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba21819-7dd5-4d24-9096-e09cdb0e8b76 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:21.321906 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 183/374] 10.222.0.43 () {56 vars in 1376 bytes} [Mon Apr 11 16:22:21 2022] GET /identity/v3/role_assignments?group.id=2cade8741bed455d8939dd1ccac8e573&scope.project.id=3ed98a96ee294394baa1187f4c99252f&role.id=0d41da7bec094450b5bff4e4831be52c => generated 260 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:21.322910 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba21819-7dd5-4d24-9096-e09cdb0e8b76 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:21.498510 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba21819-7dd5-4d24-9096-e09cdb0e8b76 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:21.511947 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be36e45d-4425-45ae-ae32-a3e9b58f2f7f None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:21.556350 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db12085-a1f7-4f15-8454-b049b1f30de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:21.557864 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db12085-a1f7-4f15-8454-b049b1f30de7 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:21.558154 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330639fb-fee8-4fbd-a45b-cc1f013d10d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:21.558584 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db12085-a1f7-4f15-8454-b049b1f30de7 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:21.559053 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db12085-a1f7-4f15-8454-b049b1f30de7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:21.559306 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330639fb-fee8-4fbd-a45b-cc1f013d10d9 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:21.559763 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330639fb-fee8-4fbd-a45b-cc1f013d10d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:21.560304 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330639fb-fee8-4fbd-a45b-cc1f013d10d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:21.561757 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330639fb-fee8-4fbd-a45b-cc1f013d10d9 None admin] RBAC: Adding query filter params (role.id=282780749a1d4592b823458aecfc5caf, user.id=175ead05a2db44c79d3f2074cffb5b98, scope.system=all) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:21.562304 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330639fb-fee8-4fbd-a45b-cc1f013d10d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:21.564812 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330639fb-fee8-4fbd-a45b-cc1f013d10d9 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:21.592709 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 184/375] 10.222.0.43 () {56 vars in 1308 bytes} [Mon Apr 11 16:22:21 2022] GET /identity/v3/role_assignments?user.id=175ead05a2db44c79d3f2074cffb5b98&scope.system=all&role.id=282780749a1d4592b823458aecfc5caf => generated 510 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:21.595920 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330639fb-fee8-4fbd-a45b-cc1f013d10d9 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:21.676429 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db12085-a1f7-4f15-8454-b049b1f30de7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:21.678251 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db12085-a1f7-4f15-8454-b049b1f30de7 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:21.825976 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330639fb-fee8-4fbd-a45b-cc1f013d10d9 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:21.876223 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5a55c3-c58f-40ed-8229-4c0d3587b4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:21.876897 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a55c3-c58f-40ed-8229-4c0d3587b4e9 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:21.877185 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a55c3-c58f-40ed-8229-4c0d3587b4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:21.877464 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a55c3-c58f-40ed-8229-4c0d3587b4e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:21.878300 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5a55c3-c58f-40ed-8229-4c0d3587b4e9 None admin] RBAC: Adding query filter params (group.id=2cade8741bed455d8939dd1ccac8e573, role.id=7d3d5d04ca634b3a9b63e7b05bb5d333, scope.project.id=3ed98a96ee294394baa1187f4c99252f) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:21.878618 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5a55c3-c58f-40ed-8229-4c0d3587b4e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:21.880113 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5a55c3-c58f-40ed-8229-4c0d3587b4e9 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:21.887305 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 185/376] 10.222.0.43 () {56 vars in 1376 bytes} [Mon Apr 11 16:22:21 2022] GET /identity/v3/role_assignments?group.id=2cade8741bed455d8939dd1ccac8e573&scope.project.id=3ed98a96ee294394baa1187f4c99252f&role.id=7d3d5d04ca634b3a9b63e7b05bb5d333 => generated 260 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:21.887598 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f7b5f-e6a6-491d-ae41-b1dfcc912407 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:21.887819 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f7b5f-e6a6-491d-ae41-b1dfcc912407 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:21.888099 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f7b5f-e6a6-491d-ae41-b1dfcc912407 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:21.889383 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 186/377] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:22:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:22:21.890805 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 192/378] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Apr 11 16:22:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 584 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 16:22:21.898418 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04744da6-e936-4d5f-8491-219bf116be1d None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:21.898418 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04744da6-e936-4d5f-8491-219bf116be1d None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:21.898418 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04744da6-e936-4d5f-8491-219bf116be1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:21.900092 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db12085-a1f7-4f15-8454-b049b1f30de7 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:21.932626 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-04744da6-e936-4d5f-8491-219bf116be1d None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:22:21.933934 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-04744da6-e936-4d5f-8491-219bf116be1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:22:22.009349 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 187/379] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:22:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:22:22.010746 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db12085-a1f7-4f15-8454-b049b1f30de7 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:22.031995 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04744da6-e936-4d5f-8491-219bf116be1d None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:22.047383 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc5ca6d-fbd5-4119-850a-37174d70407a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:22.048738 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5ca6d-fbd5-4119-850a-37174d70407a None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:22.049220 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5ca6d-fbd5-4119-850a-37174d70407a None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:22.049696 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5ca6d-fbd5-4119-850a-37174d70407a None admin] PATH_INFO: `/v3/projects/33d6863ead1548128e611dffc8b01410` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:22.051106 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc5ca6d-fbd5-4119-850a-37174d70407a None admin] RBAC: Authorizing `identity:get_project(project_id=33d6863ead1548128e611dffc8b01410)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:22.052770 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc5ca6d-fbd5-4119-850a-37174d70407a None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:22.054690 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 193/380] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Apr 11 16:22:21 2022] GET /identity/v3/projects/33d6863ead1548128e611dffc8b01410 => generated 344 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:22.060310 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc5ca6d-fbd5-4119-850a-37174d70407a None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:22.159101 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04744da6-e936-4d5f-8491-219bf116be1d None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:22.211393 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72855936-5913-4d14-a219-7e3079ce260b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:22.212237 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72855936-5913-4d14-a219-7e3079ce260b None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:22.212522 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72855936-5913-4d14-a219-7e3079ce260b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:22.212799 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72855936-5913-4d14-a219-7e3079ce260b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:22.223905 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72855936-5913-4d14-a219-7e3079ce260b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:22:22.231241 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-72855936-5913-4d14-a219-7e3079ce260b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 16:22:22.238883 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 188/381] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Apr 11 16:22:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:22:22.239906 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72855936-5913-4d14-a219-7e3079ce260b None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:22.240446 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc5ca6d-fbd5-4119-850a-37174d70407a None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:22.288888 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c14d6-bfbb-4d0c-aa59-dc0ff5b89f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:22.289828 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c14d6-bfbb-4d0c-aa59-dc0ff5b89f02 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:22.290117 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c14d6-bfbb-4d0c-aa59-dc0ff5b89f02 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:22.290395 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c14d6-bfbb-4d0c-aa59-dc0ff5b89f02 None admin] PATH_INFO: `/v3/groups/13193ec22aa744f49a874e3385b7277e` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:22.299434 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410c14d6-bfbb-4d0c-aa59-dc0ff5b89f02 None admin] RBAC: Authorizing `identity:get_group(group_id=13193ec22aa744f49a874e3385b7277e)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:22.300914 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410c14d6-bfbb-4d0c-aa59-dc0ff5b89f02 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:22.306790 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 194/382] 10.222.0.43 () {56 vars in 1180 bytes} [Mon Apr 11 16:22:22 2022] GET /identity/v3/groups/13193ec22aa744f49a874e3385b7277e => generated 229 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:22.308858 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c14d6-bfbb-4d0c-aa59-dc0ff5b89f02 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:22.342278 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72855936-5913-4d14-a219-7e3079ce260b None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:22.377667 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c018da-e958-41b6-95bc-36f1ce329e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:22.378349 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c018da-e958-41b6-95bc-36f1ce329e3c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:22.378638 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c018da-e958-41b6-95bc-36f1ce329e3c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:22.378923 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c018da-e958-41b6-95bc-36f1ce329e3c None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:22.379711 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c018da-e958-41b6-95bc-36f1ce329e3c None admin] RBAC: Adding query filter params (name=member) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:22.380102 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c018da-e958-41b6-95bc-36f1ce329e3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:22.381477 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c018da-e958-41b6-95bc-36f1ce329e3c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:22.389900 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 189/383] 10.222.0.43 () {56 vars in 1101 bytes} [Mon Apr 11 16:22:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:22.411836 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c018da-e958-41b6-95bc-36f1ce329e3c None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:22.483363 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c14d6-bfbb-4d0c-aa59-dc0ff5b89f02 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:22.524764 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c018da-e958-41b6-95bc-36f1ce329e3c None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:22.530046 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01493e41-26ab-4a4c-8c92-44cd0e04379f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:22.530721 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01493e41-26ab-4a4c-8c92-44cd0e04379f None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:22.531002 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01493e41-26ab-4a4c-8c92-44cd0e04379f None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:22.531275 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01493e41-26ab-4a4c-8c92-44cd0e04379f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:22.540252 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01493e41-26ab-4a4c-8c92-44cd0e04379f None admin] RBAC: Adding query filter params (group.id=13193ec22aa744f49a874e3385b7277e, role.id=702e5e78b5d744529384b96a390ae92f, scope.project.id=33d6863ead1548128e611dffc8b01410) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:22.540579 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01493e41-26ab-4a4c-8c92-44cd0e04379f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:22.542040 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01493e41-26ab-4a4c-8c92-44cd0e04379f None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:22.548710 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 195/384] 10.222.0.43 () {56 vars in 1376 bytes} [Mon Apr 11 16:22:22 2022] GET /identity/v3/role_assignments?group.id=13193ec22aa744f49a874e3385b7277e&scope.project.id=33d6863ead1548128e611dffc8b01410&role.id=702e5e78b5d744529384b96a390ae92f => generated 260 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:22.559362 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc87bd99-27c3-43de-ae8d-cb427151e4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:22.560270 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc87bd99-27c3-43de-ae8d-cb427151e4b1 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:22.560559 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc87bd99-27c3-43de-ae8d-cb427151e4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:22.560839 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc87bd99-27c3-43de-ae8d-cb427151e4b1 None admin] PATH_INFO: `/v3/groups/2cade8741bed455d8939dd1ccac8e573` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:22.562069 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc87bd99-27c3-43de-ae8d-cb427151e4b1 None admin] RBAC: Authorizing `identity:get_group(group_id=2cade8741bed455d8939dd1ccac8e573)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:22.564154 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc87bd99-27c3-43de-ae8d-cb427151e4b1 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:22.566010 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 190/385] 10.222.0.43 () {56 vars in 1180 bytes} [Mon Apr 11 16:22:22 2022] GET /identity/v3/groups/2cade8741bed455d8939dd1ccac8e573 => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:22:22.571563 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01493e41-26ab-4a4c-8c92-44cd0e04379f None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:22.678149 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01493e41-26ab-4a4c-8c92-44cd0e04379f None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:22.714721 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f96369-7d26-4941-bdda-2de2650020f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:22.715614 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f96369-7d26-4941-bdda-2de2650020f0 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:22.715892 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f96369-7d26-4941-bdda-2de2650020f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:22.716159 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f96369-7d26-4941-bdda-2de2650020f0 None admin] PATH_INFO: `/v3/projects/5fcfe56fb9bf4cc7b15db190133a1d28` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:22.717344 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f96369-7d26-4941-bdda-2de2650020f0 None admin] RBAC: Authorizing `identity:get_project(project_id=5fcfe56fb9bf4cc7b15db190133a1d28)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:22.718788 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f96369-7d26-4941-bdda-2de2650020f0 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:22.721300 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 196/386] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Apr 11 16:22:22 2022] GET /identity/v3/projects/5fcfe56fb9bf4cc7b15db190133a1d28 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:22.731104 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc87bd99-27c3-43de-ae8d-cb427151e4b1 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:22.868912 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc87bd99-27c3-43de-ae8d-cb427151e4b1 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:22.904703 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf04ff9-923d-4b9d-bb5c-5df3d3f26bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:22.905601 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf04ff9-923d-4b9d-bb5c-5df3d3f26bc2 None admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:22.905885 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf04ff9-923d-4b9d-bb5c-5df3d3f26bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:22.906162 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf04ff9-923d-4b9d-bb5c-5df3d3f26bc2 None admin] PATH_INFO: `/v3/projects/5fcfe56fb9bf4cc7b15db190133a1d28/groups/2cade8741bed455d8939dd1ccac8e573/roles/0d41da7bec094450b5bff4e4831be52c` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:22.908225 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf04ff9-923d-4b9d-bb5c-5df3d3f26bc2 None admin] RBAC: Authorizing `identity:create_grant(project_id=5fcfe56fb9bf4cc7b15db190133a1d28, group_id=2cade8741bed455d8939dd1ccac8e573, role_id=0d41da7bec094450b5bff4e4831be52c)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:22.909661 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf04ff9-923d-4b9d-bb5c-5df3d3f26bc2 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:22.997681 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 191/387] 10.222.0.43 () {58 vars in 1442 bytes} [Mon Apr 11 16:22:22 2022] PUT /identity/v3/projects/5fcfe56fb9bf4cc7b15db190133a1d28/groups/2cade8741bed455d8939dd1ccac8e573/roles/0d41da7bec094450b5bff4e4831be52c => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:22:23.654192 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8950452f-bb08-4709-a18d-f6b3e5f3e1fe None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:23.654697 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8950452f-bb08-4709-a18d-f6b3e5f3e1fe None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:23.654769 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8950452f-bb08-4709-a18d-f6b3e5f3e1fe None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:23.656356 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 197/388] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:22:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:22:23.662513 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f76a7-ccba-41f6-a51d-bdd7e397a580 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:23.662802 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f76a7-ccba-41f6-a51d-bdd7e397a580 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:23.663130 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f76a7-ccba-41f6-a51d-bdd7e397a580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:23.680278 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-ca7f76a7-ccba-41f6-a51d-bdd7e397a580 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:22:23.681456 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ca7f76a7-ccba-41f6-a51d-bdd7e397a580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:22:23.756138 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 192/389] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:22:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:22:23.779039 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8950452f-bb08-4709-a18d-f6b3e5f3e1fe None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:23.883370 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8950452f-bb08-4709-a18d-f6b3e5f3e1fe None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:23.918880 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a8ca04-5e48-49a5-913c-8f27133b5ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:23.919722 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8ca04-5e48-49a5-913c-8f27133b5ae3 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:23.920003 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8ca04-5e48-49a5-913c-8f27133b5ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:23.920277 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8ca04-5e48-49a5-913c-8f27133b5ae3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:23.930534 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a8ca04-5e48-49a5-913c-8f27133b5ae3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:22:23.938196 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-33a8ca04-5e48-49a5-913c-8f27133b5ae3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 11 16:22:23.943757 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 198/390] 10.222.0.43 () {56 vars in 1114 bytes} [Mon Apr 11 16:22:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:23.945428 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7f76a7-ccba-41f6-a51d-bdd7e397a580 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:24.069657 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7f76a7-ccba-41f6-a51d-bdd7e397a580 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:24.110531 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b5de7a-a9a8-48f2-99aa-e00b27373b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:24.111288 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5de7a-a9a8-48f2-99aa-e00b27373b7e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:24.111593 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5de7a-a9a8-48f2-99aa-e00b27373b7e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:24.111873 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5de7a-a9a8-48f2-99aa-e00b27373b7e None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:24.112620 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b5de7a-a9a8-48f2-99aa-e00b27373b7e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:24.112924 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b5de7a-a9a8-48f2-99aa-e00b27373b7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:24.114288 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b5de7a-a9a8-48f2-99aa-e00b27373b7e None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:24.127425 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 193/391] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Apr 11 16:22:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:24.134283 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a8ca04-5e48-49a5-913c-8f27133b5ae3 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:24.283478 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a8ca04-5e48-49a5-913c-8f27133b5ae3 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:24.332614 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dee20e-482f-4ad5-86ce-2edbdcf2f7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:24.333809 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dee20e-482f-4ad5-86ce-2edbdcf2f7cf None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:24.334282 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dee20e-482f-4ad5-86ce-2edbdcf2f7cf None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:24.334772 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dee20e-482f-4ad5-86ce-2edbdcf2f7cf None admin] PATH_INFO: `/v3/groups/2cade8741bed455d8939dd1ccac8e573` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:24.340258 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dee20e-482f-4ad5-86ce-2edbdcf2f7cf None admin] RBAC: Authorizing `identity:get_group(group_id=2cade8741bed455d8939dd1ccac8e573)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:24.341905 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dee20e-482f-4ad5-86ce-2edbdcf2f7cf None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:24.343750 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 199/392] 10.222.0.43 () {56 vars in 1180 bytes} [Mon Apr 11 16:22:24 2022] GET /identity/v3/groups/2cade8741bed455d8939dd1ccac8e573 => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:24.349288 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b5de7a-a9a8-48f2-99aa-e00b27373b7e None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:24.368296 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a29f862-cd1c-4690-9609-ed65a1613231 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:24.368920 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a29f862-cd1c-4690-9609-ed65a1613231 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:24.369471 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a29f862-cd1c-4690-9609-ed65a1613231 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:24.371279 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 200/393] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:22:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 16:22:24.378161 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc44e3-d64b-47b7-bd1d-46083bcddac3 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:24.378449 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc44e3-d64b-47b7-bd1d-46083bcddac3 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:24.378730 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc44e3-d64b-47b7-bd1d-46083bcddac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:24.405625 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-4edc44e3-d64b-47b7-bd1d-46083bcddac3 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:22:24.406869 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-4edc44e3-d64b-47b7-bd1d-46083bcddac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:22:24.468548 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b5de7a-a9a8-48f2-99aa-e00b27373b7e None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:24.506080 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b0ba90-6522-4335-9d67-9443fd9eab6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:24.507365 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b0ba90-6522-4335-9d67-9443fd9eab6d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:24.508099 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b0ba90-6522-4335-9d67-9443fd9eab6d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:24.508379 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b0ba90-6522-4335-9d67-9443fd9eab6d None admin] PATH_INFO: `/v3/projects/5fcfe56fb9bf4cc7b15db190133a1d28` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:24.509891 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b0ba90-6522-4335-9d67-9443fd9eab6d None admin] RBAC: Authorizing `identity:get_project(project_id=5fcfe56fb9bf4cc7b15db190133a1d28)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:24.511641 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b0ba90-6522-4335-9d67-9443fd9eab6d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:24.519537 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 194/394] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Apr 11 16:22:24 2022] GET /identity/v3/projects/5fcfe56fb9bf4cc7b15db190133a1d28 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:24.520239 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b0ba90-6522-4335-9d67-9443fd9eab6d None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:24.580802 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 201/395] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:22:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 16:22:24.613649 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc44e3-d64b-47b7-bd1d-46083bcddac3 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:24.645237 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b0ba90-6522-4335-9d67-9443fd9eab6d None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:24.684310 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a7db67-3efe-4046-a14f-2d2a8cb3e88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:24.685216 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a7db67-3efe-4046-a14f-2d2a8cb3e88c None admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:24.685640 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a7db67-3efe-4046-a14f-2d2a8cb3e88c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:24.685924 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a7db67-3efe-4046-a14f-2d2a8cb3e88c None admin] PATH_INFO: `/v3/projects/5fcfe56fb9bf4cc7b15db190133a1d28/groups/2cade8741bed455d8939dd1ccac8e573/roles/7d3d5d04ca634b3a9b63e7b05bb5d333` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:24.688973 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a7db67-3efe-4046-a14f-2d2a8cb3e88c None admin] RBAC: Authorizing `identity:create_grant(project_id=5fcfe56fb9bf4cc7b15db190133a1d28, group_id=2cade8741bed455d8939dd1ccac8e573, role_id=7d3d5d04ca634b3a9b63e7b05bb5d333)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:24.691343 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a7db67-3efe-4046-a14f-2d2a8cb3e88c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:24.761928 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc44e3-d64b-47b7-bd1d-46083bcddac3 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:24.773942 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 195/396] 10.222.0.43 () {58 vars in 1442 bytes} [Mon Apr 11 16:22:24 2022] PUT /identity/v3/projects/5fcfe56fb9bf4cc7b15db190133a1d28/groups/2cade8741bed455d8939dd1ccac8e573/roles/7d3d5d04ca634b3a9b63e7b05bb5d333 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:22:24.804509 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadde077-4169-4117-9f32-463b273b27df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:24.805322 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadde077-4169-4117-9f32-463b273b27df None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:24.805608 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadde077-4169-4117-9f32-463b273b27df None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:24.805880 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadde077-4169-4117-9f32-463b273b27df None admin] PATH_INFO: `/v3/roles/member` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:24.818311 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadde077-4169-4117-9f32-463b273b27df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:22:24.825704 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-cadde077-4169-4117-9f32-463b273b27df None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 16:22:24.827299 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 202/397] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Apr 11 16:22:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:22:24.836701 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a7db67-3efe-4046-a14f-2d2a8cb3e88c None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:24.977553 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a7db67-3efe-4046-a14f-2d2a8cb3e88c None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:25.019216 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f3ec6-93a2-415f-90eb-54f6d6b965bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:25.020337 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f3ec6-93a2-415f-90eb-54f6d6b965bd None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:25.020832 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f3ec6-93a2-415f-90eb-54f6d6b965bd None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:25.021312 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f3ec6-93a2-415f-90eb-54f6d6b965bd None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:25.022263 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749f3ec6-93a2-415f-90eb-54f6d6b965bd None admin] RBAC: Adding query filter params (name=member) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:25.022820 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749f3ec6-93a2-415f-90eb-54f6d6b965bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:25.028880 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749f3ec6-93a2-415f-90eb-54f6d6b965bd None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:25.040993 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 196/398] 10.222.0.43 () {56 vars in 1101 bytes} [Mon Apr 11 16:22:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:25.048823 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadde077-4169-4117-9f32-463b273b27df None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:25.155829 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadde077-4169-4117-9f32-463b273b27df None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:25.208257 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2b7fc8-09f7-4457-92b0-3ea9e2c33068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:25.209147 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2b7fc8-09f7-4457-92b0-3ea9e2c33068 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:25.209436 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2b7fc8-09f7-4457-92b0-3ea9e2c33068 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:25.209716 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2b7fc8-09f7-4457-92b0-3ea9e2c33068 None admin] PATH_INFO: `/v3/groups/2cade8741bed455d8939dd1ccac8e573` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:25.210958 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2b7fc8-09f7-4457-92b0-3ea9e2c33068 None admin] RBAC: Authorizing `identity:get_group(group_id=2cade8741bed455d8939dd1ccac8e573)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:25.212431 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2b7fc8-09f7-4457-92b0-3ea9e2c33068 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:25.214359 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 203/399] 10.222.0.43 () {56 vars in 1180 bytes} [Mon Apr 11 16:22:25 2022] GET /identity/v3/groups/2cade8741bed455d8939dd1ccac8e573 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:25.220587 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f3ec6-93a2-415f-90eb-54f6d6b965bd None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:25.329406 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa51e36-8bef-4c11-80aa-24d84845d4f5 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:25.329696 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa51e36-8bef-4c11-80aa-24d84845d4f5 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:25.329895 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa51e36-8bef-4c11-80aa-24d84845d4f5 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:25.331472 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 204/400] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:22:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 16:22:25.336811 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9107b816-3990-4d8f-a6e9-1608997410cd None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:25.337101 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9107b816-3990-4d8f-a6e9-1608997410cd None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:25.337202 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f3ec6-93a2-415f-90eb-54f6d6b965bd None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:25.337374 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9107b816-3990-4d8f-a6e9-1608997410cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:25.354656 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-9107b816-3990-4d8f-a6e9-1608997410cd None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:22:25.355886 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-9107b816-3990-4d8f-a6e9-1608997410cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:22:25.394542 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6294eb3-4af9-4681-900a-d876f89438fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:25.395413 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6294eb3-4af9-4681-900a-d876f89438fd None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:25.395727 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6294eb3-4af9-4681-900a-d876f89438fd None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:25.396014 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6294eb3-4af9-4681-900a-d876f89438fd None admin] PATH_INFO: `/v3/projects/3ed98a96ee294394baa1187f4c99252f` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:25.397243 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6294eb3-4af9-4681-900a-d876f89438fd None admin] RBAC: Authorizing `identity:get_project(project_id=3ed98a96ee294394baa1187f4c99252f)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:25.398675 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6294eb3-4af9-4681-900a-d876f89438fd None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:25.400586 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 197/401] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Apr 11 16:22:25 2022] GET /identity/v3/projects/3ed98a96ee294394baa1187f4c99252f => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:25.406133 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6294eb3-4af9-4681-900a-d876f89438fd None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:25.436724 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 205/402] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:22:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:22:25.473358 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9107b816-3990-4d8f-a6e9-1608997410cd None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:25.536604 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6294eb3-4af9-4681-900a-d876f89438fd None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:25.574399 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0687a98f-78b7-4583-b91d-159ef9ff7c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:25.575612 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0687a98f-78b7-4583-b91d-159ef9ff7c1b None admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:25.575909 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0687a98f-78b7-4583-b91d-159ef9ff7c1b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:25.576190 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0687a98f-78b7-4583-b91d-159ef9ff7c1b None admin] PATH_INFO: `/v3/projects/3ed98a96ee294394baa1187f4c99252f/groups/2cade8741bed455d8939dd1ccac8e573/roles/0d41da7bec094450b5bff4e4831be52c` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:25.578178 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0687a98f-78b7-4583-b91d-159ef9ff7c1b None admin] RBAC: Authorizing `identity:create_grant(project_id=3ed98a96ee294394baa1187f4c99252f, group_id=2cade8741bed455d8939dd1ccac8e573, role_id=0d41da7bec094450b5bff4e4831be52c)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:25.583642 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0687a98f-78b7-4583-b91d-159ef9ff7c1b None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:25.639759 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9107b816-3990-4d8f-a6e9-1608997410cd None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:25.675448 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ec18e-7676-4c8d-a998-566c81a21b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:25.676673 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ec18e-7676-4c8d-a998-566c81a21b7a None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:25.677168 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ec18e-7676-4c8d-a998-566c81a21b7a None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:25.677630 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ec18e-7676-4c8d-a998-566c81a21b7a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:25.688474 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00ec18e-7676-4c8d-a998-566c81a21b7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:22:25.696226 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-c00ec18e-7676-4c8d-a998-566c81a21b7a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 11 16:22:25.697932 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 206/403] 10.222.0.43 () {56 vars in 1114 bytes} [Mon Apr 11 16:22:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:22:25.704197 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ec18e-7676-4c8d-a998-566c81a21b7a None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:25.758403 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 198/404] 10.222.0.43 () {58 vars in 1442 bytes} [Mon Apr 11 16:22:25 2022] PUT /identity/v3/projects/3ed98a96ee294394baa1187f4c99252f/groups/2cade8741bed455d8939dd1ccac8e573/roles/0d41da7bec094450b5bff4e4831be52c => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:22:25.758403 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1480ccb-53e8-4b1f-bc5b-bd32d902c592 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:25.758403 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1480ccb-53e8-4b1f-bc5b-bd32d902c592 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:25.758403 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1480ccb-53e8-4b1f-bc5b-bd32d902c592 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:25.758403 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 199/405] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:22:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:22:25.763450 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75590ee2-e736-4922-b26e-9ff66c2b858e None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:25.763765 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75590ee2-e736-4922-b26e-9ff66c2b858e None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:25.764048 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75590ee2-e736-4922-b26e-9ff66c2b858e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:25.785201 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-75590ee2-e736-4922-b26e-9ff66c2b858e None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:22:25.788656 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-75590ee2-e736-4922-b26e-9ff66c2b858e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:22:25.867965 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 200/406] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:22:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:22:25.883551 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ec18e-7676-4c8d-a998-566c81a21b7a None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:25.893787 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75590ee2-e736-4922-b26e-9ff66c2b858e None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:25.978164 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b2522-2317-4353-99df-cea593329dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:25.978869 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b2522-2317-4353-99df-cea593329dd7 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:25.979153 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b2522-2317-4353-99df-cea593329dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:25.979431 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b2522-2317-4353-99df-cea593329dd7 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:25.980222 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65b2522-2317-4353-99df-cea593329dd7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:25.980544 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65b2522-2317-4353-99df-cea593329dd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:25.981923 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65b2522-2317-4353-99df-cea593329dd7 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:25.999893 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 207/407] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Apr 11 16:22:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:26.008970 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75590ee2-e736-4922-b26e-9ff66c2b858e None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:26.009883 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b2522-2317-4353-99df-cea593329dd7 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:26.048987 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc84d3b-7d11-4804-b7f9-5ea94be32c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:26.049847 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc84d3b-7d11-4804-b7f9-5ea94be32c1d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:26.050138 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc84d3b-7d11-4804-b7f9-5ea94be32c1d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:26.050605 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc84d3b-7d11-4804-b7f9-5ea94be32c1d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:26.061680 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc84d3b-7d11-4804-b7f9-5ea94be32c1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:22:26.068990 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-7dc84d3b-7d11-4804-b7f9-5ea94be32c1d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 16:22:26.070513 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 201/408] 10.222.0.43 () {56 vars in 1096 bytes} [Mon Apr 11 16:22:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:26.075227 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e006fb04-475e-49eb-888b-618990912da1 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:26.075546 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e006fb04-475e-49eb-888b-618990912da1 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:26.075817 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e006fb04-475e-49eb-888b-618990912da1 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:26.077224 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 202/409] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:22:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:22:26.081148 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e006fb04-475e-49eb-888b-618990912da1 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:26.126565 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b2522-2317-4353-99df-cea593329dd7 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:26.170813 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b863b4da-111a-41b8-a74b-6a1e32370b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:26.172108 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b863b4da-111a-41b8-a74b-6a1e32370b1f None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:26.172813 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b863b4da-111a-41b8-a74b-6a1e32370b1f None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:26.173719 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b863b4da-111a-41b8-a74b-6a1e32370b1f None admin] PATH_INFO: `/v3/groups/2cade8741bed455d8939dd1ccac8e573` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:26.175603 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b863b4da-111a-41b8-a74b-6a1e32370b1f None admin] RBAC: Authorizing `identity:get_group(group_id=2cade8741bed455d8939dd1ccac8e573)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:26.177890 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b863b4da-111a-41b8-a74b-6a1e32370b1f None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:26.180665 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 208/410] 10.222.0.43 () {56 vars in 1180 bytes} [Mon Apr 11 16:22:26 2022] GET /identity/v3/groups/2cade8741bed455d8939dd1ccac8e573 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:22:26.185314 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac98daa-a59d-40cc-a669-7d87f19cc0ad None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:26.185314 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac98daa-a59d-40cc-a669-7d87f19cc0ad None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:26.185491 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac98daa-a59d-40cc-a669-7d87f19cc0ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:26.207000 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e006fb04-475e-49eb-888b-618990912da1 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:26.207783 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-3ac98daa-a59d-40cc-a669-7d87f19cc0ad None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:22:26.210212 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-3ac98daa-a59d-40cc-a669-7d87f19cc0ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:22:26.248686 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af7189f-23ec-4c15-9355-c9dc4ebb5e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:26.249730 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7189f-23ec-4c15-9355-c9dc4ebb5e6e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:26.250688 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7189f-23ec-4c15-9355-c9dc4ebb5e6e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:26.251171 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7189f-23ec-4c15-9355-c9dc4ebb5e6e None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:26.252880 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af7189f-23ec-4c15-9355-c9dc4ebb5e6e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:26.253388 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af7189f-23ec-4c15-9355-c9dc4ebb5e6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:26.254907 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af7189f-23ec-4c15-9355-c9dc4ebb5e6e None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:26.270195 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 203/411] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Apr 11 16:22:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:26.270195 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af7189f-23ec-4c15-9355-c9dc4ebb5e6e None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:26.291545 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 209/412] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:22:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:22:26.292609 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac98daa-a59d-40cc-a669-7d87f19cc0ad None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:26.398952 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af7189f-23ec-4c15-9355-c9dc4ebb5e6e None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:26.402903 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac98daa-a59d-40cc-a669-7d87f19cc0ad None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:26.432565 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b396e59-4c32-4708-b6df-74a7c6c9dd20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:26.433452 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b396e59-4c32-4708-b6df-74a7c6c9dd20 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:26.433703 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b396e59-4c32-4708-b6df-74a7c6c9dd20 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:26.433978 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b396e59-4c32-4708-b6df-74a7c6c9dd20 None admin] PATH_INFO: `/v3/projects/3ed98a96ee294394baa1187f4c99252f` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:26.435151 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b396e59-4c32-4708-b6df-74a7c6c9dd20 None admin] RBAC: Authorizing `identity:get_project(project_id=3ed98a96ee294394baa1187f4c99252f)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:26.436597 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b396e59-4c32-4708-b6df-74a7c6c9dd20 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:26.438657 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 204/413] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Apr 11 16:22:26 2022] GET /identity/v3/projects/3ed98a96ee294394baa1187f4c99252f => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:26.439370 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b396e59-4c32-4708-b6df-74a7c6c9dd20 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:26.446788 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d2519e-4328-498c-91e7-39872b062d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:26.448040 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d2519e-4328-498c-91e7-39872b062d01 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:26.448917 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d2519e-4328-498c-91e7-39872b062d01 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:26.449398 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d2519e-4328-498c-91e7-39872b062d01 None admin] PATH_INFO: `/v3/groups/13193ec22aa744f49a874e3385b7277e` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:26.451183 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d2519e-4328-498c-91e7-39872b062d01 None admin] RBAC: Authorizing `identity:get_group(group_id=13193ec22aa744f49a874e3385b7277e)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:26.453462 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d2519e-4328-498c-91e7-39872b062d01 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:26.456503 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 210/414] 10.222.0.43 () {56 vars in 1180 bytes} [Mon Apr 11 16:22:26 2022] GET /identity/v3/groups/13193ec22aa744f49a874e3385b7277e => generated 229 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:26.457444 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d2519e-4328-498c-91e7-39872b062d01 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:26.562864 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b396e59-4c32-4708-b6df-74a7c6c9dd20 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:26.571539 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d2519e-4328-498c-91e7-39872b062d01 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:26.605814 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176143b7-e3fe-4c6c-85b6-09e283ee8ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:26.606015 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5430b034-9eb3-45ad-9031-95a7995ab583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:26.606894 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430b034-9eb3-45ad-9031-95a7995ab583 None admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:26.607170 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430b034-9eb3-45ad-9031-95a7995ab583 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:26.607438 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430b034-9eb3-45ad-9031-95a7995ab583 None admin] PATH_INFO: `/v3/projects/3ed98a96ee294394baa1187f4c99252f/groups/2cade8741bed455d8939dd1ccac8e573/roles/7d3d5d04ca634b3a9b63e7b05bb5d333` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:26.607736 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176143b7-e3fe-4c6c-85b6-09e283ee8ce4 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:26.608206 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176143b7-e3fe-4c6c-85b6-09e283ee8ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:26.608688 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176143b7-e3fe-4c6c-85b6-09e283ee8ce4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:26.609743 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5430b034-9eb3-45ad-9031-95a7995ab583 None admin] RBAC: Authorizing `identity:create_grant(project_id=3ed98a96ee294394baa1187f4c99252f, group_id=2cade8741bed455d8939dd1ccac8e573, role_id=7d3d5d04ca634b3a9b63e7b05bb5d333)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:26.611787 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5430b034-9eb3-45ad-9031-95a7995ab583 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:26.621156 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176143b7-e3fe-4c6c-85b6-09e283ee8ce4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:22:26.628887 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-176143b7-e3fe-4c6c-85b6-09e283ee8ce4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 16:22:26.630329 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 205/415] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Apr 11 16:22:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:26.630923 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176143b7-e3fe-4c6c-85b6-09e283ee8ce4 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:26.728341 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176143b7-e3fe-4c6c-85b6-09e283ee8ce4 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:26.748297 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 211/416] 10.222.0.43 () {58 vars in 1442 bytes} [Mon Apr 11 16:22:26 2022] PUT /identity/v3/projects/3ed98a96ee294394baa1187f4c99252f/groups/2cade8741bed455d8939dd1ccac8e573/roles/7d3d5d04ca634b3a9b63e7b05bb5d333 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:22:26.749655 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5430b034-9eb3-45ad-9031-95a7995ab583 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:26.773990 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd808182-c0f4-4653-af6b-67811d115bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:26.774930 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd808182-c0f4-4653-af6b-67811d115bc0 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:26.782481 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd808182-c0f4-4653-af6b-67811d115bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:26.782481 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd808182-c0f4-4653-af6b-67811d115bc0 None admin] PATH_INFO: `/v3/projects/33d6863ead1548128e611dffc8b01410` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:26.782481 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd808182-c0f4-4653-af6b-67811d115bc0 None admin] RBAC: Authorizing `identity:get_project(project_id=33d6863ead1548128e611dffc8b01410)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:26.782481 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd808182-c0f4-4653-af6b-67811d115bc0 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:26.782481 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 206/417] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Apr 11 16:22:26 2022] GET /identity/v3/projects/33d6863ead1548128e611dffc8b01410 => generated 344 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:26.788247 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd808182-c0f4-4653-af6b-67811d115bc0 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:26.907744 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd808182-c0f4-4653-af6b-67811d115bc0 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:26.946359 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffb0669-504c-4c02-8282-edf6a5c49f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:26.947372 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb0669-504c-4c02-8282-edf6a5c49f36 None admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:26.947752 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb0669-504c-4c02-8282-edf6a5c49f36 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:26.948117 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb0669-504c-4c02-8282-edf6a5c49f36 None admin] PATH_INFO: `/v3/projects/33d6863ead1548128e611dffc8b01410/groups/13193ec22aa744f49a874e3385b7277e/roles/702e5e78b5d744529384b96a390ae92f` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:26.955550 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffb0669-504c-4c02-8282-edf6a5c49f36 None admin] RBAC: Authorizing `identity:create_grant(project_id=33d6863ead1548128e611dffc8b01410, group_id=13193ec22aa744f49a874e3385b7277e, role_id=702e5e78b5d744529384b96a390ae92f)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:26.955550 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffb0669-504c-4c02-8282-edf6a5c49f36 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:26.986558 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5430b034-9eb3-45ad-9031-95a7995ab583 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:27.025011 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0c8ec8-9c64-4732-86f2-c48109ba5079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:27.025686 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c8ec8-9c64-4732-86f2-c48109ba5079 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:27.026023 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c8ec8-9c64-4732-86f2-c48109ba5079 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:27.026283 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c8ec8-9c64-4732-86f2-c48109ba5079 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:27.026835 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 207/418] 10.222.0.43 () {58 vars in 1442 bytes} [Mon Apr 11 16:22:26 2022] PUT /identity/v3/projects/33d6863ead1548128e611dffc8b01410/groups/13193ec22aa744f49a874e3385b7277e/roles/702e5e78b5d744529384b96a390ae92f => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:22:27.027159 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0c8ec8-9c64-4732-86f2-c48109ba5079 None admin] RBAC: Adding query filter params (name=member) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:27.027467 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0c8ec8-9c64-4732-86f2-c48109ba5079 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:27.029029 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0c8ec8-9c64-4732-86f2-c48109ba5079 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:27.039000 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 212/419] 10.222.0.43 () {56 vars in 1101 bytes} [Mon Apr 11 16:22:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:27.045266 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffb0669-504c-4c02-8282-edf6a5c49f36 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:27.178684 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffb0669-504c-4c02-8282-edf6a5c49f36 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:27.226274 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cae60d-a30a-4e29-b228-99f54f177af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:27.227354 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cae60d-a30a-4e29-b228-99f54f177af9 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:27.227855 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cae60d-a30a-4e29-b228-99f54f177af9 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:27.228361 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cae60d-a30a-4e29-b228-99f54f177af9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:27.335451 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cae60d-a30a-4e29-b228-99f54f177af9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:27.337448 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cae60d-a30a-4e29-b228-99f54f177af9 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:27.445355 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 208/420] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Apr 11 16:22:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 16:22:27.451183 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0c8ec8-9c64-4732-86f2-c48109ba5079 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:27.594476 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0c8ec8-9c64-4732-86f2-c48109ba5079 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:27.671188 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b01f7-d608-4bd3-b8e0-11f3a96d3b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:27.673112 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b01f7-d608-4bd3-b8e0-11f3a96d3b30 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:27.673751 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b01f7-d608-4bd3-b8e0-11f3a96d3b30 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:27.674226 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b01f7-d608-4bd3-b8e0-11f3a96d3b30 None admin] PATH_INFO: `/v3/projects/5fcfe56fb9bf4cc7b15db190133a1d28` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:27.680413 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603b01f7-d608-4bd3-b8e0-11f3a96d3b30 None admin] RBAC: Authorizing `identity:get_project(project_id=5fcfe56fb9bf4cc7b15db190133a1d28)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:27.682215 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603b01f7-d608-4bd3-b8e0-11f3a96d3b30 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:27.685764 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 213/421] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Apr 11 16:22:27 2022] GET /identity/v3/projects/5fcfe56fb9bf4cc7b15db190133a1d28 => generated 298 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:27.691722 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cae60d-a30a-4e29-b228-99f54f177af9 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:27.765178 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35759e0f-af32-43cf-b0a5-64f39d1eb3aa None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:27.766395 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35759e0f-af32-43cf-b0a5-64f39d1eb3aa None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:27.766914 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35759e0f-af32-43cf-b0a5-64f39d1eb3aa None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:27.768780 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 214/422] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:22:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 16:22:27.774867 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a1ac17-9684-40ba-af94-92d0c775b4f3 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:27.775434 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a1ac17-9684-40ba-af94-92d0c775b4f3 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:27.775942 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a1ac17-9684-40ba-af94-92d0c775b4f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:27.811267 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-63a1ac17-9684-40ba-af94-92d0c775b4f3 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:22:27.812819 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cae60d-a30a-4e29-b228-99f54f177af9 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:27.813913 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-63a1ac17-9684-40ba-af94-92d0c775b4f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:22:27.854874 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e2a89f-e899-4a46-93fe-5e9ca7b0333d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:27.856763 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e2a89f-e899-4a46-93fe-5e9ca7b0333d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:27.856763 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e2a89f-e899-4a46-93fe-5e9ca7b0333d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:27.856763 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e2a89f-e899-4a46-93fe-5e9ca7b0333d None admin] PATH_INFO: `/v3/groups/2cade8741bed455d8939dd1ccac8e573` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:27.860757 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e2a89f-e899-4a46-93fe-5e9ca7b0333d None admin] RBAC: Authorizing `identity:get_group(group_id=2cade8741bed455d8939dd1ccac8e573)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:27.862458 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e2a89f-e899-4a46-93fe-5e9ca7b0333d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:27.864823 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 209/423] 10.222.0.43 () {56 vars in 1180 bytes} [Mon Apr 11 16:22:27 2022] GET /identity/v3/groups/2cade8741bed455d8939dd1ccac8e573 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:27.879612 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e2a89f-e899-4a46-93fe-5e9ca7b0333d None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:27.952838 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 215/424] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:22:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 16:22:27.982469 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a1ac17-9684-40ba-af94-92d0c775b4f3 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:28.060815 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e2a89f-e899-4a46-93fe-5e9ca7b0333d None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:28.106171 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a1ac17-9684-40ba-af94-92d0c775b4f3 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:28.133350 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a7a479-7556-4263-984b-ac8699155f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:28.134028 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7a479-7556-4263-984b-ac8699155f57 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:28.134323 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7a479-7556-4263-984b-ac8699155f57 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:28.134604 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7a479-7556-4263-984b-ac8699155f57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:28.135444 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a7a479-7556-4263-984b-ac8699155f57 None admin] RBAC: Adding query filter params (group.id=2cade8741bed455d8939dd1ccac8e573, role.id=0d41da7bec094450b5bff4e4831be52c, scope.project.id=5fcfe56fb9bf4cc7b15db190133a1d28) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:28.135791 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a7a479-7556-4263-984b-ac8699155f57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:28.137216 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a7a479-7556-4263-984b-ac8699155f57 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:28.143880 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 210/425] 10.222.0.43 () {56 vars in 1376 bytes} [Mon Apr 11 16:22:27 2022] GET /identity/v3/role_assignments?group.id=2cade8741bed455d8939dd1ccac8e573&scope.project.id=5fcfe56fb9bf4cc7b15db190133a1d28&role.id=0d41da7bec094450b5bff4e4831be52c => generated 611 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:28.173200 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39aaeb1-5d6c-475f-ba82-d14c88f52284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:28.174072 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39aaeb1-5d6c-475f-ba82-d14c88f52284 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:28.174353 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39aaeb1-5d6c-475f-ba82-d14c88f52284 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:28.174627 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39aaeb1-5d6c-475f-ba82-d14c88f52284 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:28.194094 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39aaeb1-5d6c-475f-ba82-d14c88f52284 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:22:28.202620 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-c39aaeb1-5d6c-475f-ba82-d14c88f52284 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 11 16:22:28.208072 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 216/426] 10.222.0.43 () {56 vars in 1114 bytes} [Mon Apr 11 16:22:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:22:28.214750 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a7a479-7556-4263-984b-ac8699155f57 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:28.341508 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a7a479-7556-4263-984b-ac8699155f57 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:28.386979 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e528ab7-2642-4bea-ac3b-e329ae3f647c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:28.387625 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e528ab7-2642-4bea-ac3b-e329ae3f647c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:28.387915 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e528ab7-2642-4bea-ac3b-e329ae3f647c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:28.388198 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e528ab7-2642-4bea-ac3b-e329ae3f647c None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:28.388996 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e528ab7-2642-4bea-ac3b-e329ae3f647c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:28.389311 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e528ab7-2642-4bea-ac3b-e329ae3f647c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:28.390869 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e528ab7-2642-4bea-ac3b-e329ae3f647c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:28.400737 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 211/427] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Apr 11 16:22:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:22:28.408687 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39aaeb1-5d6c-475f-ba82-d14c88f52284 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:28.535443 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39aaeb1-5d6c-475f-ba82-d14c88f52284 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:28.574591 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f637299-bfef-4197-8594-c54d9137482d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:28.575667 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f637299-bfef-4197-8594-c54d9137482d None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:28.576145 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f637299-bfef-4197-8594-c54d9137482d None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:28.576611 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f637299-bfef-4197-8594-c54d9137482d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:28.650549 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb00ae-85b5-4552-a284-38bbd62562d3 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:28.650856 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb00ae-85b5-4552-a284-38bbd62562d3 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:28.651035 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb00ae-85b5-4552-a284-38bbd62562d3 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:28.651634 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f637299-bfef-4197-8594-c54d9137482d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:28.653276 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f637299-bfef-4197-8594-c54d9137482d None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:28.653707 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 212/428] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:22:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 16:22:28.658279 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1cd31c-8bb4-4f80-a7fc-c649fb928499 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:28.660401 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1cd31c-8bb4-4f80-a7fc-c649fb928499 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:28.660691 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1cd31c-8bb4-4f80-a7fc-c649fb928499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:28.688208 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-8f1cd31c-8bb4-4f80-a7fc-c649fb928499 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:22:28.689619 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-8f1cd31c-8bb4-4f80-a7fc-c649fb928499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:22:28.785402 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 213/429] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:22:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 16:22:28.786392 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 217/430] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Apr 11 16:22:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 16:22:28.791665 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1cd31c-8bb4-4f80-a7fc-c649fb928499 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:28.814036 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f637299-bfef-4197-8594-c54d9137482d None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:28.912717 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1cd31c-8bb4-4f80-a7fc-c649fb928499 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:28.951688 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc351dbb-dcba-449b-ab25-c9fdb1c2f30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:28.952980 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc351dbb-dcba-449b-ab25-c9fdb1c2f30c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:28.953961 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc351dbb-dcba-449b-ab25-c9fdb1c2f30c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:28.954434 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc351dbb-dcba-449b-ab25-c9fdb1c2f30c None admin] PATH_INFO: `/v3/projects/5fcfe56fb9bf4cc7b15db190133a1d28` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:28.955558 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f637299-bfef-4197-8594-c54d9137482d None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:28.956100 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc351dbb-dcba-449b-ab25-c9fdb1c2f30c None admin] RBAC: Authorizing `identity:get_project(project_id=5fcfe56fb9bf4cc7b15db190133a1d28)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:28.957738 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc351dbb-dcba-449b-ab25-c9fdb1c2f30c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:28.959651 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 214/431] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Apr 11 16:22:28 2022] GET /identity/v3/projects/5fcfe56fb9bf4cc7b15db190133a1d28 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:22:28.971625 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc351dbb-dcba-449b-ab25-c9fdb1c2f30c None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:28.993554 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eb2006-1a47-439f-b7ef-1cd57ad764cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:28.994359 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb2006-1a47-439f-b7ef-1cd57ad764cd None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:28.994642 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb2006-1a47-439f-b7ef-1cd57ad764cd None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:28.994914 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb2006-1a47-439f-b7ef-1cd57ad764cd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:29.013131 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eb2006-1a47-439f-b7ef-1cd57ad764cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:22:29.022407 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-78eb2006-1a47-439f-b7ef-1cd57ad764cd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 16:22:29.027635 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 218/432] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Apr 11 16:22:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:22:29.031545 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eb2006-1a47-439f-b7ef-1cd57ad764cd None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:29.099709 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc351dbb-dcba-449b-ab25-c9fdb1c2f30c None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:29.141972 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c828b5-8867-4435-b1fe-a3b9f74dfd59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:29.143076 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c828b5-8867-4435-b1fe-a3b9f74dfd59 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:29.143675 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c828b5-8867-4435-b1fe-a3b9f74dfd59 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:29.144099 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c828b5-8867-4435-b1fe-a3b9f74dfd59 None admin] PATH_INFO: `/v3/groups/2cade8741bed455d8939dd1ccac8e573` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:29.145504 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c828b5-8867-4435-b1fe-a3b9f74dfd59 None admin] RBAC: Authorizing `identity:get_group(group_id=2cade8741bed455d8939dd1ccac8e573)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:29.147372 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c828b5-8867-4435-b1fe-a3b9f74dfd59 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:29.149995 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 215/433] 10.222.0.43 () {56 vars in 1180 bytes} [Mon Apr 11 16:22:28 2022] GET /identity/v3/groups/2cade8741bed455d8939dd1ccac8e573 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:29.163964 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c828b5-8867-4435-b1fe-a3b9f74dfd59 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:29.176911 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eb2006-1a47-439f-b7ef-1cd57ad764cd None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:29.217285 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e126da72-92d6-455b-9d18-a1cc9374bbaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:29.218112 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e126da72-92d6-455b-9d18-a1cc9374bbaa None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:29.219207 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e126da72-92d6-455b-9d18-a1cc9374bbaa None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:29.219968 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e126da72-92d6-455b-9d18-a1cc9374bbaa None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:29.220728 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e126da72-92d6-455b-9d18-a1cc9374bbaa None admin] RBAC: Adding query filter params (name=member) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:29.221038 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e126da72-92d6-455b-9d18-a1cc9374bbaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:29.222814 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e126da72-92d6-455b-9d18-a1cc9374bbaa None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:29.234000 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 219/434] 10.222.0.43 () {56 vars in 1101 bytes} [Mon Apr 11 16:22:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:29.239167 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e126da72-92d6-455b-9d18-a1cc9374bbaa None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:29.294900 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c828b5-8867-4435-b1fe-a3b9f74dfd59 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:29.332220 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8febcb-57f3-488b-9300-e8eb693313dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:29.332888 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8febcb-57f3-488b-9300-e8eb693313dc None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:29.333176 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8febcb-57f3-488b-9300-e8eb693313dc None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:29.333455 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8febcb-57f3-488b-9300-e8eb693313dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:29.334362 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8febcb-57f3-488b-9300-e8eb693313dc None admin] RBAC: Adding query filter params (group.id=2cade8741bed455d8939dd1ccac8e573, role.id=7d3d5d04ca634b3a9b63e7b05bb5d333, scope.project.id=5fcfe56fb9bf4cc7b15db190133a1d28) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:29.334683 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8febcb-57f3-488b-9300-e8eb693313dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:29.336176 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8febcb-57f3-488b-9300-e8eb693313dc None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:29.342167 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 216/435] 10.222.0.43 () {56 vars in 1376 bytes} [Mon Apr 11 16:22:29 2022] GET /identity/v3/role_assignments?group.id=2cade8741bed455d8939dd1ccac8e573&scope.project.id=5fcfe56fb9bf4cc7b15db190133a1d28&role.id=7d3d5d04ca634b3a9b63e7b05bb5d333 => generated 611 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:29.366825 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e126da72-92d6-455b-9d18-a1cc9374bbaa None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:29.404045 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499866d8-faa2-459a-baa0-3f207b4b1bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:29.404730 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499866d8-faa2-459a-baa0-3f207b4b1bfb None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:29.405016 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499866d8-faa2-459a-baa0-3f207b4b1bfb None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:29.405292 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499866d8-faa2-459a-baa0-3f207b4b1bfb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:29.479867 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499866d8-faa2-459a-baa0-3f207b4b1bfb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:29.481360 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499866d8-faa2-459a-baa0-3f207b4b1bfb None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:29.591436 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 220/436] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Apr 11 16:22:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 16:22:29.592843 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8febcb-57f3-488b-9300-e8eb693313dc None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:29.682068 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd31bef-0a21-4946-a8ae-9fc7a9d515ef None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:29.682439 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd31bef-0a21-4946-a8ae-9fc7a9d515ef None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:29.682636 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd31bef-0a21-4946-a8ae-9fc7a9d515ef None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:29.684432 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 221/437] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:22:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:22:29.692504 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e5792a-a862-483b-9815-4500f10646b5 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:29.692795 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e5792a-a862-483b-9815-4500f10646b5 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:29.693074 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e5792a-a862-483b-9815-4500f10646b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:29.704488 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8febcb-57f3-488b-9300-e8eb693313dc None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:29.717015 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-14e5792a-a862-483b-9815-4500f10646b5 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:22:29.718225 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-14e5792a-a862-483b-9815-4500f10646b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:22:29.742932 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f43933-61f0-4b8a-8903-35765351dffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:29.743769 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f43933-61f0-4b8a-8903-35765351dffb None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:29.744051 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f43933-61f0-4b8a-8903-35765351dffb None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:29.744327 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f43933-61f0-4b8a-8903-35765351dffb None admin] PATH_INFO: `/v3/projects/3ed98a96ee294394baa1187f4c99252f` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:29.746080 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f43933-61f0-4b8a-8903-35765351dffb None admin] RBAC: Authorizing `identity:get_project(project_id=3ed98a96ee294394baa1187f4c99252f)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:29.747818 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f43933-61f0-4b8a-8903-35765351dffb None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:29.749520 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 217/438] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Apr 11 16:22:29 2022] GET /identity/v3/projects/3ed98a96ee294394baa1187f4c99252f => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:29.756082 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f43933-61f0-4b8a-8903-35765351dffb None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:29.804773 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 222/439] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:22:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 16:22:29.830227 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e5792a-a862-483b-9815-4500f10646b5 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:29.876691 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f43933-61f0-4b8a-8903-35765351dffb None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:29.908991 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f08ecba-c47a-4ddb-8eba-b81fed00cb9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:29.909852 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f08ecba-c47a-4ddb-8eba-b81fed00cb9f None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:29.910134 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f08ecba-c47a-4ddb-8eba-b81fed00cb9f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:29.910406 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f08ecba-c47a-4ddb-8eba-b81fed00cb9f None admin] PATH_INFO: `/v3/groups/2cade8741bed455d8939dd1ccac8e573` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:29.911625 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f08ecba-c47a-4ddb-8eba-b81fed00cb9f None admin] RBAC: Authorizing `identity:get_group(group_id=2cade8741bed455d8939dd1ccac8e573)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:29.913051 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f08ecba-c47a-4ddb-8eba-b81fed00cb9f None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:29.914661 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 218/440] 10.222.0.43 () {56 vars in 1180 bytes} [Mon Apr 11 16:22:29 2022] GET /identity/v3/groups/2cade8741bed455d8939dd1ccac8e573 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:22:29.920302 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f08ecba-c47a-4ddb-8eba-b81fed00cb9f None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:29.938993 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e5792a-a862-483b-9815-4500f10646b5 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:29.972733 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc0fb3-29c6-47c9-bb11-5a504d78ec5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:29.973558 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc0fb3-29c6-47c9-bb11-5a504d78ec5f None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:29.973840 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc0fb3-29c6-47c9-bb11-5a504d78ec5f None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:29.974114 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc0fb3-29c6-47c9-bb11-5a504d78ec5f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:29.984657 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fc0fb3-29c6-47c9-bb11-5a504d78ec5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:22:29.992760 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-96fc0fb3-29c6-47c9-bb11-5a504d78ec5f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 11 16:22:29.994181 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 223/441] 10.222.0.43 () {56 vars in 1114 bytes} [Mon Apr 11 16:22:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:22:30.000369 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc0fb3-29c6-47c9-bb11-5a504d78ec5f None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:30.018151 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f08ecba-c47a-4ddb-8eba-b81fed00cb9f None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:30.051154 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b968b1ba-ac5f-4d82-b5b0-141aa09008fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:30.052136 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b968b1ba-ac5f-4d82-b5b0-141aa09008fb None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:30.052424 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b968b1ba-ac5f-4d82-b5b0-141aa09008fb None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:30.052708 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b968b1ba-ac5f-4d82-b5b0-141aa09008fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:30.054396 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b968b1ba-ac5f-4d82-b5b0-141aa09008fb None admin] RBAC: Adding query filter params (group.id=2cade8741bed455d8939dd1ccac8e573, role.id=0d41da7bec094450b5bff4e4831be52c, scope.project.id=3ed98a96ee294394baa1187f4c99252f) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:30.054396 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b968b1ba-ac5f-4d82-b5b0-141aa09008fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:30.055266 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b968b1ba-ac5f-4d82-b5b0-141aa09008fb None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:30.063647 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 219/442] 10.222.0.43 () {56 vars in 1376 bytes} [Mon Apr 11 16:22:29 2022] GET /identity/v3/role_assignments?group.id=2cade8741bed455d8939dd1ccac8e573&scope.project.id=3ed98a96ee294394baa1187f4c99252f&role.id=0d41da7bec094450b5bff4e4831be52c => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:22:30.065006 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa05ac77-9598-4ced-b5de-a958ba94d7aa None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:30.065301 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa05ac77-9598-4ced-b5de-a958ba94d7aa None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:30.065581 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa05ac77-9598-4ced-b5de-a958ba94d7aa None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:30.067199 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 220/443] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:22:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:22:30.077642 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e5e663-ee24-4d79-94c0-aff691ef1b11 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:30.078561 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e5e663-ee24-4d79-94c0-aff691ef1b11 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:30.078842 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e5e663-ee24-4d79-94c0-aff691ef1b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:30.097770 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-a7e5e663-ee24-4d79-94c0-aff691ef1b11 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:22:30.099021 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a7e5e663-ee24-4d79-94c0-aff691ef1b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:22:30.108449 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc0fb3-29c6-47c9-bb11-5a504d78ec5f None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:30.144499 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d190c4-ca20-4638-84a8-cafcd0304077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:30.145494 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d190c4-ca20-4638-84a8-cafcd0304077 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:30.145917 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d190c4-ca20-4638-84a8-cafcd0304077 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:30.146362 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d190c4-ca20-4638-84a8-cafcd0304077 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:30.147265 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d190c4-ca20-4638-84a8-cafcd0304077 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:30.147766 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d190c4-ca20-4638-84a8-cafcd0304077 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:30.149321 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d190c4-ca20-4638-84a8-cafcd0304077 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:30.158840 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 224/444] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Apr 11 16:22:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:22:30.165245 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d190c4-ca20-4638-84a8-cafcd0304077 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:30.172510 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 221/445] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:22:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 16:22:30.197684 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e5e663-ee24-4d79-94c0-aff691ef1b11 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:30.280748 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d190c4-ca20-4638-84a8-cafcd0304077 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:30.306938 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e5e663-ee24-4d79-94c0-aff691ef1b11 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:30.315657 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cad5e59-a168-48bb-a08a-639af4e0e9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:30.316319 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad5e59-a168-48bb-a08a-639af4e0e9dd None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:30.316604 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad5e59-a168-48bb-a08a-639af4e0e9dd None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:30.316883 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad5e59-a168-48bb-a08a-639af4e0e9dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:30.348996 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc5e8a-4cfc-402c-9262-d20ccbe58c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:30.348996 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc5e8a-4cfc-402c-9262-d20ccbe58c71 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:30.348996 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc5e8a-4cfc-402c-9262-d20ccbe58c71 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:30.348996 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc5e8a-4cfc-402c-9262-d20ccbe58c71 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:30.360920 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bc5e8a-4cfc-402c-9262-d20ccbe58c71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:22:30.368294 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-81bc5e8a-4cfc-402c-9262-d20ccbe58c71 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 16:22:30.369671 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 222/446] 10.222.0.43 () {56 vars in 1096 bytes} [Mon Apr 11 16:22:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:22:30.375906 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc5e8a-4cfc-402c-9262-d20ccbe58c71 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:30.397284 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cad5e59-a168-48bb-a08a-639af4e0e9dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:30.398742 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cad5e59-a168-48bb-a08a-639af4e0e9dd None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:30.484405 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc5e8a-4cfc-402c-9262-d20ccbe58c71 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:30.506747 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 225/447] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Apr 11 16:22:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 16:22:30.512199 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cad5e59-a168-48bb-a08a-639af4e0e9dd None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:30.517931 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d13120-0e0c-4829-9781-940485a711ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:30.518602 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d13120-0e0c-4829-9781-940485a711ba None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:30.518889 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d13120-0e0c-4829-9781-940485a711ba None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:30.519169 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d13120-0e0c-4829-9781-940485a711ba None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:30.519952 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d13120-0e0c-4829-9781-940485a711ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:30.520359 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d13120-0e0c-4829-9781-940485a711ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:30.521820 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d13120-0e0c-4829-9781-940485a711ba None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:30.529796 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 223/448] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Apr 11 16:22:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:30.537113 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d13120-0e0c-4829-9781-940485a711ba None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:30.605838 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cad5e59-a168-48bb-a08a-639af4e0e9dd None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:30.630434 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d13120-0e0c-4829-9781-940485a711ba None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:30.639331 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dace83-7c48-46bc-8700-dd32e5df3560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:30.640259 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dace83-7c48-46bc-8700-dd32e5df3560 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:30.640534 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dace83-7c48-46bc-8700-dd32e5df3560 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:30.640906 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dace83-7c48-46bc-8700-dd32e5df3560 None admin] PATH_INFO: `/v3/projects/3ed98a96ee294394baa1187f4c99252f` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:30.642070 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dace83-7c48-46bc-8700-dd32e5df3560 None admin] RBAC: Authorizing `identity:get_project(project_id=3ed98a96ee294394baa1187f4c99252f)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:30.643483 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dace83-7c48-46bc-8700-dd32e5df3560 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:30.645216 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 226/449] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Apr 11 16:22:30 2022] GET /identity/v3/projects/3ed98a96ee294394baa1187f4c99252f => generated 302 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:22:30.650489 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dace83-7c48-46bc-8700-dd32e5df3560 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:30.663108 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0922d8e4-490c-4388-881b-8e0fad0f5e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:30.663793 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922d8e4-490c-4388-881b-8e0fad0f5e7d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:30.664079 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922d8e4-490c-4388-881b-8e0fad0f5e7d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:30.664359 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922d8e4-490c-4388-881b-8e0fad0f5e7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:30.726654 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0922d8e4-490c-4388-881b-8e0fad0f5e7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:30.728117 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0922d8e4-490c-4388-881b-8e0fad0f5e7d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:30.742030 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dace83-7c48-46bc-8700-dd32e5df3560 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:30.774786 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f058962-2f07-421e-820a-23cfcc584ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:30.775665 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f058962-2f07-421e-820a-23cfcc584ebe None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:30.775948 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f058962-2f07-421e-820a-23cfcc584ebe None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:30.776223 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f058962-2f07-421e-820a-23cfcc584ebe None admin] PATH_INFO: `/v3/groups/2cade8741bed455d8939dd1ccac8e573` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:30.777390 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f058962-2f07-421e-820a-23cfcc584ebe None admin] RBAC: Authorizing `identity:get_group(group_id=2cade8741bed455d8939dd1ccac8e573)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:30.778805 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f058962-2f07-421e-820a-23cfcc584ebe None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:30.780445 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 227/450] 10.222.0.43 () {56 vars in 1180 bytes} [Mon Apr 11 16:22:30 2022] GET /identity/v3/groups/2cade8741bed455d8939dd1ccac8e573 => generated 226 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:22:30.786131 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f058962-2f07-421e-820a-23cfcc584ebe None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:30.821457 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 224/451] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Apr 11 16:22:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 11 16:22:30.826996 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0922d8e4-490c-4388-881b-8e0fad0f5e7d None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:30.880931 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f058962-2f07-421e-820a-23cfcc584ebe None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:30.913356 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62979fa0-903a-4e7a-bf61-d0d06a858944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:30.914006 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62979fa0-903a-4e7a-bf61-d0d06a858944 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:30.914290 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62979fa0-903a-4e7a-bf61-d0d06a858944 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:30.914573 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62979fa0-903a-4e7a-bf61-d0d06a858944 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:30.915398 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62979fa0-903a-4e7a-bf61-d0d06a858944 None admin] RBAC: Adding query filter params (group.id=2cade8741bed455d8939dd1ccac8e573, role.id=7d3d5d04ca634b3a9b63e7b05bb5d333, scope.project.id=3ed98a96ee294394baa1187f4c99252f) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:30.915741 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62979fa0-903a-4e7a-bf61-d0d06a858944 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:30.917180 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62979fa0-903a-4e7a-bf61-d0d06a858944 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:30.919684 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0922d8e4-490c-4388-881b-8e0fad0f5e7d None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:30.923472 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 228/452] 10.222.0.43 () {56 vars in 1376 bytes} [Mon Apr 11 16:22:30 2022] GET /identity/v3/role_assignments?group.id=2cade8741bed455d8939dd1ccac8e573&scope.project.id=3ed98a96ee294394baa1187f4c99252f&role.id=7d3d5d04ca634b3a9b63e7b05bb5d333 => generated 611 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:22:30.955821 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e447471-7f1f-4c0e-a866-9e7569985026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:30.956818 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e447471-7f1f-4c0e-a866-9e7569985026 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:30.957205 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e447471-7f1f-4c0e-a866-9e7569985026 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:30.957477 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e447471-7f1f-4c0e-a866-9e7569985026 None admin] PATH_INFO: `/v3/projects/33d6863ead1548128e611dffc8b01410` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:30.958819 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e447471-7f1f-4c0e-a866-9e7569985026 None admin] RBAC: Authorizing `identity:get_project(project_id=33d6863ead1548128e611dffc8b01410)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:30.960463 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e447471-7f1f-4c0e-a866-9e7569985026 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:30.962228 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 225/453] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Apr 11 16:22:30 2022] GET /identity/v3/projects/33d6863ead1548128e611dffc8b01410 => generated 344 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:22:30.967899 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62979fa0-903a-4e7a-bf61-d0d06a858944 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:31.072046 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62979fa0-903a-4e7a-bf61-d0d06a858944 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:31.106015 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef918bb3-b50b-493b-aa27-5ab94aafa7b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:31.106880 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef918bb3-b50b-493b-aa27-5ab94aafa7b2 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:31.107159 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef918bb3-b50b-493b-aa27-5ab94aafa7b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:31.107431 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef918bb3-b50b-493b-aa27-5ab94aafa7b2 None admin] PATH_INFO: `/v3/groups/13193ec22aa744f49a874e3385b7277e` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:31.108632 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef918bb3-b50b-493b-aa27-5ab94aafa7b2 None admin] RBAC: Authorizing `identity:get_group(group_id=13193ec22aa744f49a874e3385b7277e)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:31.110619 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef918bb3-b50b-493b-aa27-5ab94aafa7b2 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:31.112342 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 229/454] 10.222.0.43 () {56 vars in 1180 bytes} [Mon Apr 11 16:22:30 2022] GET /identity/v3/groups/13193ec22aa744f49a874e3385b7277e => generated 229 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:31.118321 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e447471-7f1f-4c0e-a866-9e7569985026 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:31.215905 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e447471-7f1f-4c0e-a866-9e7569985026 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:31.249387 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58f999c-9134-4ff7-8440-6248ef41b808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:31.250230 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f999c-9134-4ff7-8440-6248ef41b808 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:31.250522 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f999c-9134-4ff7-8440-6248ef41b808 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:31.250795 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f999c-9134-4ff7-8440-6248ef41b808 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:31.251672 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58f999c-9134-4ff7-8440-6248ef41b808 None admin] RBAC: Adding query filter params (group.id=13193ec22aa744f49a874e3385b7277e, role.id=702e5e78b5d744529384b96a390ae92f, scope.project.id=33d6863ead1548128e611dffc8b01410) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:31.251993 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58f999c-9134-4ff7-8440-6248ef41b808 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:31.253417 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58f999c-9134-4ff7-8440-6248ef41b808 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:31.259251 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 226/455] 10.222.0.43 () {56 vars in 1376 bytes} [Mon Apr 11 16:22:31 2022] GET /identity/v3/role_assignments?group.id=13193ec22aa744f49a874e3385b7277e&scope.project.id=33d6863ead1548128e611dffc8b01410&role.id=702e5e78b5d744529384b96a390ae92f => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:34.016791 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f3f3d-3319-43df-8093-b20bfc72df8c None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:34.017369 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f3f3d-3319-43df-8093-b20bfc72df8c None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:34.017369 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f3f3d-3319-43df-8093-b20bfc72df8c None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:34.018978 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 230/456] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:22:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:22:34.024615 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d48cfd9-778d-401c-9f08-3b076d745e47 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:34.025026 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d48cfd9-778d-401c-9f08-3b076d745e47 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:34.025196 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d48cfd9-778d-401c-9f08-3b076d745e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:34.048925 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-0d48cfd9-778d-401c-9f08-3b076d745e47 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:22:34.050131 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0d48cfd9-778d-401c-9f08-3b076d745e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:22:34.139697 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 227/457] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:22:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:22:34.181816 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f3f3d-3319-43df-8093-b20bfc72df8c None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:34.224388 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f005a50-ea13-48b4-95e0-9db593c81729 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:34.225054 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f005a50-ea13-48b4-95e0-9db593c81729 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:34.225538 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f005a50-ea13-48b4-95e0-9db593c81729 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:34.227348 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 228/458] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:22:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 16:22:34.236017 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e6429-db66-4a83-81e0-cab860b41dcb None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:34.236571 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e6429-db66-4a83-81e0-cab860b41dcb None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:34.237069 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e6429-db66-4a83-81e0-cab860b41dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:34.272643 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-2b4e6429-db66-4a83-81e0-cab860b41dcb None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:22:34.276597 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-2b4e6429-db66-4a83-81e0-cab860b41dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:22:34.369172 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f3f3d-3319-43df-8093-b20bfc72df8c None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:34.389133 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 229/459] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:22:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:22:34.423860 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7616e636-b3d8-4863-ac26-230aecc4cc88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:34.424671 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616e636-b3d8-4863-ac26-230aecc4cc88 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:34.424960 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616e636-b3d8-4863-ac26-230aecc4cc88 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:34.425239 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616e636-b3d8-4863-ac26-230aecc4cc88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:34.436130 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7616e636-b3d8-4863-ac26-230aecc4cc88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:34.438322 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7616e636-b3d8-4863-ac26-230aecc4cc88 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:34.440800 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4e6429-db66-4a83-81e0-cab860b41dcb None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:34.455550 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-7616e636-b3d8-4863-ac26-230aecc4cc88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:22:34.457091 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 231/460] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:22:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:34.463537 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5884e20-4a41-4fa5-98f5-052dc057062d None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:34.463537 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5884e20-4a41-4fa5-98f5-052dc057062d None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:34.463537 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5884e20-4a41-4fa5-98f5-052dc057062d None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:34.463537 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 232/461] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:22:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 16:22:34.463537 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5884e20-4a41-4fa5-98f5-052dc057062d None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:34.573491 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5884e20-4a41-4fa5-98f5-052dc057062d None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:34.588755 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4e6429-db66-4a83-81e0-cab860b41dcb None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:34.609397 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb10dd9b-8295-4a70-ba90-cbbab3a036b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:34.610496 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb10dd9b-8295-4a70-ba90-cbbab3a036b1 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:34.610983 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb10dd9b-8295-4a70-ba90-cbbab3a036b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:34.611499 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb10dd9b-8295-4a70-ba90-cbbab3a036b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:34.612457 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb10dd9b-8295-4a70-ba90-cbbab3a036b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:34.612958 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb10dd9b-8295-4a70-ba90-cbbab3a036b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:34.614601 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb10dd9b-8295-4a70-ba90-cbbab3a036b1 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:34.628460 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 233/462] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Apr 11 16:22:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:34.629957 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b484366-2276-4d30-be17-8aec8f0bcda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:34.630422 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253574a-4fb9-45b8-9c76-448f1364f860 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:34.630761 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b484366-2276-4d30-be17-8aec8f0bcda7 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:34.631051 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b484366-2276-4d30-be17-8aec8f0bcda7 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:34.631332 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b484366-2276-4d30-be17-8aec8f0bcda7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:34.631603 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253574a-4fb9-45b8-9c76-448f1364f860 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:34.632097 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253574a-4fb9-45b8-9c76-448f1364f860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:34.643533 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b484366-2276-4d30-be17-8aec8f0bcda7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:34.645140 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b484366-2276-4d30-be17-8aec8f0bcda7 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:34.649469 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-b253574a-4fb9-45b8-9c76-448f1364f860 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:22:34.650878 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-b253574a-4fb9-45b8-9c76-448f1364f860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:22:34.664101 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-7b484366-2276-4d30-be17-8aec8f0bcda7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:22:34.665897 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 230/463] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:22:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:22:34.666907 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b484366-2276-4d30-be17-8aec8f0bcda7 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:34.740553 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 234/464] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:22:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:22:34.748394 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b253574a-4fb9-45b8-9c76-448f1364f860 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:34.782533 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b484366-2276-4d30-be17-8aec8f0bcda7 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:34.818753 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c9050a-1e9e-42e8-a8a0-93064d48cee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:34.819439 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c9050a-1e9e-42e8-a8a0-93064d48cee3 None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:34.819751 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c9050a-1e9e-42e8-a8a0-93064d48cee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:34.820035 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c9050a-1e9e-42e8-a8a0-93064d48cee3 None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:34.820751 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c9050a-1e9e-42e8-a8a0-93064d48cee3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:34.822180 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c9050a-1e9e-42e8-a8a0-93064d48cee3 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:34.852177 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b253574a-4fb9-45b8-9c76-448f1364f860 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:34.885532 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5340af6e-0c54-4e82-b6d4-e0d4d4397d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:34.886638 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5340af6e-0c54-4e82-b6d4-e0d4d4397d54 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:34.886638 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5340af6e-0c54-4e82-b6d4-e0d4d4397d54 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:34.886813 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5340af6e-0c54-4e82-b6d4-e0d4d4397d54 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:34.887439 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5340af6e-0c54-4e82-b6d4-e0d4d4397d54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:34.887769 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5340af6e-0c54-4e82-b6d4-e0d4d4397d54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:34.889138 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5340af6e-0c54-4e82-b6d4-e0d4d4397d54 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:34.901366 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 235/465] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Apr 11 16:22:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:34.903027 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5340af6e-0c54-4e82-b6d4-e0d4d4397d54 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:34.959902 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 231/466] 10.222.0.43 () {60 vars in 1132 bytes} [Mon Apr 11 16:22:34 2022] POST /identity/v3/users => generated 246 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:22:34.959902 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c9050a-1e9e-42e8-a8a0-93064d48cee3 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:35.027241 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5340af6e-0c54-4e82-b6d4-e0d4d4397d54 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:35.072175 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7205c9d7-bae0-450b-bc0f-4d1f49a168b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:35.072996 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7205c9d7-bae0-450b-bc0f-4d1f49a168b0 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:35.073274 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7205c9d7-bae0-450b-bc0f-4d1f49a168b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:35.073545 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7205c9d7-bae0-450b-bc0f-4d1f49a168b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:35.073842 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c9050a-1e9e-42e8-a8a0-93064d48cee3 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:35.086026 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7205c9d7-bae0-450b-bc0f-4d1f49a168b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:35.087543 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7205c9d7-bae0-450b-bc0f-4d1f49a168b0 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:35.105914 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-7205c9d7-bae0-450b-bc0f-4d1f49a168b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:22:35.107463 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 236/467] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:22:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:35.109084 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596a50d7-120e-4857-8d18-7e6b3e7f48ee None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:35.109372 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596a50d7-120e-4857-8d18-7e6b3e7f48ee None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:35.109652 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596a50d7-120e-4857-8d18-7e6b3e7f48ee None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:35.115212 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 237/468] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:22:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:22:35.116344 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596a50d7-120e-4857-8d18-7e6b3e7f48ee None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:35.118264 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfae7ba-b477-46a4-8f1c-9e4d61173964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:35.118974 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfae7ba-b477-46a4-8f1c-9e4d61173964 None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:35.119261 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfae7ba-b477-46a4-8f1c-9e4d61173964 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:35.119565 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfae7ba-b477-46a4-8f1c-9e4d61173964 None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:35.120292 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfae7ba-b477-46a4-8f1c-9e4d61173964 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:35.122106 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfae7ba-b477-46a4-8f1c-9e4d61173964 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:35.205284 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 232/469] 10.222.0.43 () {60 vars in 1132 bytes} [Mon Apr 11 16:22:34 2022] POST /identity/v3/users => generated 248 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:22:35.206628 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce890695-3e45-45ac-98c4-511c921ecdaf None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:35.206920 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce890695-3e45-45ac-98c4-511c921ecdaf None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:35.207222 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce890695-3e45-45ac-98c4-511c921ecdaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:35.225985 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-ce890695-3e45-45ac-98c4-511c921ecdaf None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:22:35.227264 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ce890695-3e45-45ac-98c4-511c921ecdaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:22:35.234695 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596a50d7-120e-4857-8d18-7e6b3e7f48ee None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:35.277577 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d11d2d4-4149-4cae-97c8-deb94fadfe71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:35.278672 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d11d2d4-4149-4cae-97c8-deb94fadfe71 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:35.279231 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d11d2d4-4149-4cae-97c8-deb94fadfe71 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:35.279775 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d11d2d4-4149-4cae-97c8-deb94fadfe71 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:35.281404 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d11d2d4-4149-4cae-97c8-deb94fadfe71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:35.281997 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d11d2d4-4149-4cae-97c8-deb94fadfe71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:35.283799 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d11d2d4-4149-4cae-97c8-deb94fadfe71 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:35.299136 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 238/470] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Apr 11 16:22:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:35.305753 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d11d2d4-4149-4cae-97c8-deb94fadfe71 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:35.308702 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 233/471] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:22:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:22:35.335888 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce890695-3e45-45ac-98c4-511c921ecdaf None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:35.429227 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d11d2d4-4149-4cae-97c8-deb94fadfe71 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:35.455274 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce890695-3e45-45ac-98c4-511c921ecdaf None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:35.483805 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1866ff5c-a50b-4fc9-914b-4d608f29d83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:35.484496 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866ff5c-a50b-4fc9-914b-4d608f29d83d None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:35.484781 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866ff5c-a50b-4fc9-914b-4d608f29d83d None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:35.485056 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866ff5c-a50b-4fc9-914b-4d608f29d83d None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:35.485759 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1866ff5c-a50b-4fc9-914b-4d608f29d83d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:35.487295 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1866ff5c-a50b-4fc9-914b-4d608f29d83d None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:35.490520 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f0e8f-e66b-4d82-af13-a99f8375199b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:35.491318 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f0e8f-e66b-4d82-af13-a99f8375199b None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:35.491667 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f0e8f-e66b-4d82-af13-a99f8375199b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:35.492045 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f0e8f-e66b-4d82-af13-a99f8375199b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:35.504733 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720f0e8f-e66b-4d82-af13-a99f8375199b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:35.506189 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720f0e8f-e66b-4d82-af13-a99f8375199b None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:35.524050 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-720f0e8f-e66b-4d82-af13-a99f8375199b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:22:35.525581 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 234/472] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:22:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:22:35.531459 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f0e8f-e66b-4d82-af13-a99f8375199b None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:35.640164 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f0e8f-e66b-4d82-af13-a99f8375199b None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:35.673200 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d8c885-5a65-4231-ad05-5c370fc50d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:35.673869 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d8c885-5a65-4231-ad05-5c370fc50d66 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:35.674185 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d8c885-5a65-4231-ad05-5c370fc50d66 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:35.674456 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d8c885-5a65-4231-ad05-5c370fc50d66 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:35.675177 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d8c885-5a65-4231-ad05-5c370fc50d66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:35.675496 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d8c885-5a65-4231-ad05-5c370fc50d66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:35.676870 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d8c885-5a65-4231-ad05-5c370fc50d66 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:35.693526 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 239/473] 10.222.0.43 () {60 vars in 1132 bytes} [Mon Apr 11 16:22:35 2022] POST /identity/v3/users => generated 248 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:22:35.693526 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa976340-26ce-41ae-9f04-8e1d359e4855 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:35.693526 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa976340-26ce-41ae-9f04-8e1d359e4855 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:35.693526 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa976340-26ce-41ae-9f04-8e1d359e4855 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:35.693889 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 235/474] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Apr 11 16:22:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:35.695103 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 240/475] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:22:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:22:35.700347 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d8c885-5a65-4231-ad05-5c370fc50d66 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:35.700886 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e78819a-dfe6-4b27-b257-86a6f6c21634 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:35.701185 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e78819a-dfe6-4b27-b257-86a6f6c21634 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:35.701564 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e78819a-dfe6-4b27-b257-86a6f6c21634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:35.732857 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-1e78819a-dfe6-4b27-b257-86a6f6c21634 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:22:35.741822 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-1e78819a-dfe6-4b27-b257-86a6f6c21634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:22:35.880592 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d8c885-5a65-4231-ad05-5c370fc50d66 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:35.886878 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 241/476] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:22:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:22:35.909606 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e78819a-dfe6-4b27-b257-86a6f6c21634 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:35.938767 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86a370f-4c3e-4964-a3d5-7c7c27cfa5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:35.939457 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a370f-4c3e-4964-a3d5-7c7c27cfa5da None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:35.939818 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a370f-4c3e-4964-a3d5-7c7c27cfa5da None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:35.940096 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a370f-4c3e-4964-a3d5-7c7c27cfa5da None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:35.940814 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86a370f-4c3e-4964-a3d5-7c7c27cfa5da None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:35.942239 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86a370f-4c3e-4964-a3d5-7c7c27cfa5da None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:36.017821 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e78819a-dfe6-4b27-b257-86a6f6c21634 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:36.048039 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 236/477] 10.222.0.43 () {60 vars in 1132 bytes} [Mon Apr 11 16:22:35 2022] POST /identity/v3/users => generated 249 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:22:36.053898 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3685d3ef-c7db-45e6-9acd-e10fccace2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:36.054595 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3685d3ef-c7db-45e6-9acd-e10fccace2a2 None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:36.054879 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3685d3ef-c7db-45e6-9acd-e10fccace2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:36.055158 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3685d3ef-c7db-45e6-9acd-e10fccace2a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:36.055965 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3685d3ef-c7db-45e6-9acd-e10fccace2a2 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:36.057381 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3685d3ef-c7db-45e6-9acd-e10fccace2a2 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:36.104044 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.sql.core [None req-3685d3ef-c7db-45e6-9acd-e10fccace2a2 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Apr 11 16:22:36.104044 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Apr 11 16:22:36.104044 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [parameters: {'id': 'ba30cdbfb5c24989853442a9a4406b71', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Apr 11 16:22:36.104044 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80241) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Apr 11 16:22:36.119181 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-3685d3ef-c7db-45e6-9acd-e10fccace2a2 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Apr 11 16:22:36.126101 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 242/478] 10.222.0.43 () {60 vars in 1131 bytes} [Mon Apr 11 16:22:35 2022] POST /identity/v3/roles => generated 144 bytes in 217 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:36.127130 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86a370f-4c3e-4964-a3d5-7c7c27cfa5da None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:36.281681 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86a370f-4c3e-4964-a3d5-7c7c27cfa5da None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:36.328639 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c29be-6814-4682-a84a-3f434ea49aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:36.329688 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c29be-6814-4682-a84a-3f434ea49aa2 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:36.329969 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c29be-6814-4682-a84a-3f434ea49aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:36.330243 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c29be-6814-4682-a84a-3f434ea49aa2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:36.348055 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9c29be-6814-4682-a84a-3f434ea49aa2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:22:36.355496 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-6a9c29be-6814-4682-a84a-3f434ea49aa2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 11 16:22:36.357045 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 237/479] 10.222.0.43 () {56 vars in 1114 bytes} [Mon Apr 11 16:22:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:36.365325 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3685d3ef-c7db-45e6-9acd-e10fccace2a2 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:36.504629 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3685d3ef-c7db-45e6-9acd-e10fccace2a2 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:36.546225 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94aa118-0195-4507-80c6-0492bf062f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:36.546225 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94aa118-0195-4507-80c6-0492bf062f36 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:36.546225 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94aa118-0195-4507-80c6-0492bf062f36 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:36.546225 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94aa118-0195-4507-80c6-0492bf062f36 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:36.546719 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94aa118-0195-4507-80c6-0492bf062f36 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:36.546719 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94aa118-0195-4507-80c6-0492bf062f36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:36.546719 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94aa118-0195-4507-80c6-0492bf062f36 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:36.553279 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 243/480] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Apr 11 16:22:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:37.692105 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb029464-18e3-4d81-a7e0-a9ba71c7d64c None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:37.692631 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb029464-18e3-4d81-a7e0-a9ba71c7d64c None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:37.692719 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb029464-18e3-4d81-a7e0-a9ba71c7d64c None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:37.694311 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 238/481] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:22:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:22:37.699496 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b063fdb-24d7-48ab-94eb-903510e2e63c None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:37.699896 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b063fdb-24d7-48ab-94eb-903510e2e63c None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:37.700085 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b063fdb-24d7-48ab-94eb-903510e2e63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:37.717051 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-4b063fdb-24d7-48ab-94eb-903510e2e63c None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:22:37.718849 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-4b063fdb-24d7-48ab-94eb-903510e2e63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:22:37.797785 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 244/482] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:22:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:22:37.821840 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb029464-18e3-4d81-a7e0-a9ba71c7d64c None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:37.956792 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb029464-18e3-4d81-a7e0-a9ba71c7d64c None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:38.005622 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23396ed5-8d35-49c6-aa88-db0e26d289d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:38.006440 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23396ed5-8d35-49c6-aa88-db0e26d289d0 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:38.006727 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23396ed5-8d35-49c6-aa88-db0e26d289d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:38.007007 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23396ed5-8d35-49c6-aa88-db0e26d289d0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:38.020501 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23396ed5-8d35-49c6-aa88-db0e26d289d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:22:38.027774 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-23396ed5-8d35-49c6-aa88-db0e26d289d0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 16:22:38.029295 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 239/483] 10.222.0.43 () {56 vars in 1102 bytes} [Mon Apr 11 16:22:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:38.035805 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b063fdb-24d7-48ab-94eb-903510e2e63c None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:38.139864 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b063fdb-24d7-48ab-94eb-903510e2e63c None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:38.174689 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097322ee-6bce-4605-9a7e-12e77f70ef86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:38.175368 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097322ee-6bce-4605-9a7e-12e77f70ef86 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:38.175694 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097322ee-6bce-4605-9a7e-12e77f70ef86 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:38.175964 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097322ee-6bce-4605-9a7e-12e77f70ef86 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:38.176720 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097322ee-6bce-4605-9a7e-12e77f70ef86 None admin] RBAC: Adding query filter params (name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:38.177030 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097322ee-6bce-4605-9a7e-12e77f70ef86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:38.178393 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097322ee-6bce-4605-9a7e-12e77f70ef86 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:38.187192 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 245/484] 10.222.0.43 () {56 vars in 1103 bytes} [Mon Apr 11 16:22:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:38.192574 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23396ed5-8d35-49c6-aa88-db0e26d289d0 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:38.263117 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ca9b2-eff7-4644-acb3-1efdc0022361 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:38.263435 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ca9b2-eff7-4644-acb3-1efdc0022361 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:38.263702 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ca9b2-eff7-4644-acb3-1efdc0022361 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:38.265881 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 246/485] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:22:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 16:22:38.271078 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65249c16-caed-463b-ab09-e22f84787a22 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:38.271644 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65249c16-caed-463b-ab09-e22f84787a22 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:38.272124 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65249c16-caed-463b-ab09-e22f84787a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:38.299370 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23396ed5-8d35-49c6-aa88-db0e26d289d0 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:38.307436 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-65249c16-caed-463b-ab09-e22f84787a22 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:22:38.308913 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-65249c16-caed-463b-ab09-e22f84787a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:22:38.353832 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ce7d6a-bb40-4c29-8ada-56e0a1cebca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:38.354634 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce7d6a-bb40-4c29-8ada-56e0a1cebca6 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:38.354922 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce7d6a-bb40-4c29-8ada-56e0a1cebca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:38.355202 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce7d6a-bb40-4c29-8ada-56e0a1cebca6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:38.369323 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ce7d6a-bb40-4c29-8ada-56e0a1cebca6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:38.370943 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ce7d6a-bb40-4c29-8ada-56e0a1cebca6 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:38.391252 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-d9ce7d6a-bb40-4c29-8ada-56e0a1cebca6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:22:38.393558 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 240/486] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:22:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:38.402951 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ce7d6a-bb40-4c29-8ada-56e0a1cebca6 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:38.456922 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 247/487] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:22:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:22:38.512880 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65249c16-caed-463b-ab09-e22f84787a22 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:38.562626 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ce7d6a-bb40-4c29-8ada-56e0a1cebca6 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:38.607505 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceb8fd3-c7c6-44f6-98a8-5da4040042b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:38.608969 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb8fd3-c7c6-44f6-98a8-5da4040042b2 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:38.609262 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb8fd3-c7c6-44f6-98a8-5da4040042b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:38.609866 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb8fd3-c7c6-44f6-98a8-5da4040042b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:38.610875 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceb8fd3-c7c6-44f6-98a8-5da4040042b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:38.611190 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceb8fd3-c7c6-44f6-98a8-5da4040042b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:38.613217 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceb8fd3-c7c6-44f6-98a8-5da4040042b2 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:38.617854 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65249c16-caed-463b-ab09-e22f84787a22 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:38.628318 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 241/488] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Apr 11 16:22:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:38.632259 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939eff40-f058-4e87-8178-502881c02408 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:38.632551 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939eff40-f058-4e87-8178-502881c02408 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:38.632833 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939eff40-f058-4e87-8178-502881c02408 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:38.634208 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 242/489] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:22:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:22:38.635957 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939eff40-f058-4e87-8178-502881c02408 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:38.661920 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da94f4a7-d582-4227-84cb-c2b0aa0ee64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:38.662702 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94f4a7-d582-4227-84cb-c2b0aa0ee64c None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:38.662994 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94f4a7-d582-4227-84cb-c2b0aa0ee64c None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:38.663274 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94f4a7-d582-4227-84cb-c2b0aa0ee64c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:38.675646 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da94f4a7-d582-4227-84cb-c2b0aa0ee64c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:22:38.683096 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-da94f4a7-d582-4227-84cb-c2b0aa0ee64c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 16:22:38.684747 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 248/490] 10.222.0.43 () {56 vars in 1102 bytes} [Mon Apr 11 16:22:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:22:38.686254 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56669a6c-8814-48bd-b76a-dbe5a98eb690 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:38.686595 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56669a6c-8814-48bd-b76a-dbe5a98eb690 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:38.686878 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56669a6c-8814-48bd-b76a-dbe5a98eb690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:38.703951 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-56669a6c-8814-48bd-b76a-dbe5a98eb690 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:22:38.705172 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-56669a6c-8814-48bd-b76a-dbe5a98eb690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:22:38.738452 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939eff40-f058-4e87-8178-502881c02408 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:38.773677 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9660febc-989b-4948-84f6-10ad016a97cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:38.774478 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9660febc-989b-4948-84f6-10ad016a97cd None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:38.774759 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9660febc-989b-4948-84f6-10ad016a97cd None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:38.775034 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9660febc-989b-4948-84f6-10ad016a97cd None admin] PATH_INFO: `/v3/users/nova` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:38.775399 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 249/491] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:22:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:22:38.776368 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56669a6c-8814-48bd-b76a-dbe5a98eb690 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:38.790897 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9660febc-989b-4948-84f6-10ad016a97cd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:38.792384 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9660febc-989b-4948-84f6-10ad016a97cd None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:38.822415 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-9660febc-989b-4948-84f6-10ad016a97cd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 11 16:22:38.823843 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 243/492] 10.222.0.43 () {56 vars in 1093 bytes} [Mon Apr 11 16:22:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:38.829108 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9660febc-989b-4948-84f6-10ad016a97cd None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:38.880164 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56669a6c-8814-48bd-b76a-dbe5a98eb690 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:38.914752 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c1e301-9850-4e4e-9074-f88f9fedb639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:38.915357 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c1e301-9850-4e4e-9074-f88f9fedb639 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:38.915682 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c1e301-9850-4e4e-9074-f88f9fedb639 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:38.915965 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c1e301-9850-4e4e-9074-f88f9fedb639 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:38.916792 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c1e301-9850-4e4e-9074-f88f9fedb639 None admin] RBAC: Adding query filter params (name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:38.917104 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c1e301-9850-4e4e-9074-f88f9fedb639 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:38.918631 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c1e301-9850-4e4e-9074-f88f9fedb639 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:38.928704 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 250/493] 10.222.0.43 () {56 vars in 1103 bytes} [Mon Apr 11 16:22:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:38.929658 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c1e301-9850-4e4e-9074-f88f9fedb639 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:38.930828 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9660febc-989b-4948-84f6-10ad016a97cd None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:38.969667 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77612611-b141-4cfa-b35d-d91e9174848d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:38.970346 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77612611-b141-4cfa-b35d-d91e9174848d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:38.970633 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77612611-b141-4cfa-b35d-d91e9174848d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:38.970907 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77612611-b141-4cfa-b35d-d91e9174848d None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:38.971787 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77612611-b141-4cfa-b35d-d91e9174848d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:38.972095 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77612611-b141-4cfa-b35d-d91e9174848d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:38.973525 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77612611-b141-4cfa-b35d-d91e9174848d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:39.011621 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 244/494] 10.222.0.43 () {56 vars in 1133 bytes} [Mon Apr 11 16:22:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:22:39.012310 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77612611-b141-4cfa-b35d-d91e9174848d None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:39.038008 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c1e301-9850-4e4e-9074-f88f9fedb639 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:39.071921 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc6e76b-e3de-4c30-95d6-66dccd3b079a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:39.072781 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc6e76b-e3de-4c30-95d6-66dccd3b079a None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:39.073067 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc6e76b-e3de-4c30-95d6-66dccd3b079a None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:39.073346 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc6e76b-e3de-4c30-95d6-66dccd3b079a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:39.084492 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc6e76b-e3de-4c30-95d6-66dccd3b079a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:22:39.091770 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-adc6e76b-e3de-4c30-95d6-66dccd3b079a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 16:22:39.094207 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 251/495] 10.222.0.43 () {56 vars in 1102 bytes} [Mon Apr 11 16:22:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:39.094902 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc6e76b-e3de-4c30-95d6-66dccd3b079a None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:39.123067 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77612611-b141-4cfa-b35d-d91e9174848d None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:39.158108 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562ac813-b6a3-4878-bf75-7b66dc43c4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:39.158963 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ac813-b6a3-4878-bf75-7b66dc43c4e8 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:39.159253 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ac813-b6a3-4878-bf75-7b66dc43c4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:39.159547 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ac813-b6a3-4878-bf75-7b66dc43c4e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:39.171005 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562ac813-b6a3-4878-bf75-7b66dc43c4e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:39.172450 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562ac813-b6a3-4878-bf75-7b66dc43c4e8 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:39.191606 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-562ac813-b6a3-4878-bf75-7b66dc43c4e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:22:39.193000 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 245/496] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:22:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:39.193700 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562ac813-b6a3-4878-bf75-7b66dc43c4e8 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:39.202395 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc6e76b-e3de-4c30-95d6-66dccd3b079a None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:39.236462 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b1d1b6-d4fb-4db1-8f41-648636568bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:39.237130 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b1d1b6-d4fb-4db1-8f41-648636568bab None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:39.237419 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b1d1b6-d4fb-4db1-8f41-648636568bab None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:39.237701 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b1d1b6-d4fb-4db1-8f41-648636568bab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:39.297681 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562ac813-b6a3-4878-bf75-7b66dc43c4e8 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:39.308268 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b1d1b6-d4fb-4db1-8f41-648636568bab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:39.309729 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b1d1b6-d4fb-4db1-8f41-648636568bab None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:39.333572 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc47bf3-efb0-4a93-a1ec-d450b0acbdfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:39.334247 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc47bf3-efb0-4a93-a1ec-d450b0acbdfc None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:39.334522 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc47bf3-efb0-4a93-a1ec-d450b0acbdfc None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:39.334801 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc47bf3-efb0-4a93-a1ec-d450b0acbdfc None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:39.335573 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc47bf3-efb0-4a93-a1ec-d450b0acbdfc None admin] RBAC: Adding query filter params (name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:39.335961 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc47bf3-efb0-4a93-a1ec-d450b0acbdfc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:39.337257 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc47bf3-efb0-4a93-a1ec-d450b0acbdfc None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:39.345320 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 246/497] 10.222.0.43 () {56 vars in 1103 bytes} [Mon Apr 11 16:22:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:39.346429 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc47bf3-efb0-4a93-a1ec-d450b0acbdfc None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:39.417097 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 252/498] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Apr 11 16:22:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 16:22:39.418471 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be2d9d-08bb-4158-85fd-f7915220888a None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:39.418758 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be2d9d-08bb-4158-85fd-f7915220888a None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:39.419033 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be2d9d-08bb-4158-85fd-f7915220888a None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:39.422140 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 253/499] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:22:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:22:39.422889 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be2d9d-08bb-4158-85fd-f7915220888a None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:39.449407 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc47bf3-efb0-4a93-a1ec-d450b0acbdfc None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:39.484862 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464942da-0505-41ce-ab7d-d6553b93c933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:39.485823 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464942da-0505-41ce-ab7d-d6553b93c933 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:39.486116 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464942da-0505-41ce-ab7d-d6553b93c933 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:39.486390 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464942da-0505-41ce-ab7d-d6553b93c933 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:39.487119 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464942da-0505-41ce-ab7d-d6553b93c933 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:39.487429 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464942da-0505-41ce-ab7d-d6553b93c933 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:39.488886 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464942da-0505-41ce-ab7d-d6553b93c933 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:39.506704 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 247/500] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Apr 11 16:22:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:39.507588 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464942da-0505-41ce-ab7d-d6553b93c933 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:39.535566 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be2d9d-08bb-4158-85fd-f7915220888a None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:39.571445 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2e59c6-88b0-46e4-a5ef-1e64abe96608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:39.572276 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e59c6-88b0-46e4-a5ef-1e64abe96608 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:39.572561 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e59c6-88b0-46e4-a5ef-1e64abe96608 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:39.572857 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e59c6-88b0-46e4-a5ef-1e64abe96608 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:39.582901 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2e59c6-88b0-46e4-a5ef-1e64abe96608 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:39.584403 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2e59c6-88b0-46e4-a5ef-1e64abe96608 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:39.601919 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-ff2e59c6-88b0-46e4-a5ef-1e64abe96608 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:22:39.603140 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 254/501] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:22:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:39.604442 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60113426-5f0c-424d-b24a-ef55dd188c1a None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:39.604739 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60113426-5f0c-424d-b24a-ef55dd188c1a None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:39.605012 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60113426-5f0c-424d-b24a-ef55dd188c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:39.608204 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464942da-0505-41ce-ab7d-d6553b93c933 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:39.623872 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-60113426-5f0c-424d-b24a-ef55dd188c1a None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:22:39.625193 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-60113426-5f0c-424d-b24a-ef55dd188c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:22:39.640688 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bee2f29-be6b-4793-9f6e-5c6f71594d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:39.641474 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee2f29-be6b-4793-9f6e-5c6f71594d9b None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:39.641755 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee2f29-be6b-4793-9f6e-5c6f71594d9b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:39.642027 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee2f29-be6b-4793-9f6e-5c6f71594d9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:39.651850 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bee2f29-be6b-4793-9f6e-5c6f71594d9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:39.653335 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bee2f29-be6b-4793-9f6e-5c6f71594d9b None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:39.669605 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-2bee2f29-be6b-4793-9f6e-5c6f71594d9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:22:39.671480 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 248/502] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:22:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:39.672315 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bee2f29-be6b-4793-9f6e-5c6f71594d9b None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:39.688627 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 255/503] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:22:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:22:39.689937 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb66594-0480-492f-8c93-da4df10d0a87 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:39.690223 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb66594-0480-492f-8c93-da4df10d0a87 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:39.690498 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb66594-0480-492f-8c93-da4df10d0a87 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:39.691917 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 256/504] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:22:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:22:39.692437 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb66594-0480-492f-8c93-da4df10d0a87 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:39.774944 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bee2f29-be6b-4793-9f6e-5c6f71594d9b None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:39.790557 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb66594-0480-492f-8c93-da4df10d0a87 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:39.813300 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a629188-e6b5-4f05-8008-46781f1469b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:39.814091 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a629188-e6b5-4f05-8008-46781f1469b5 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:39.814370 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a629188-e6b5-4f05-8008-46781f1469b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:39.814638 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a629188-e6b5-4f05-8008-46781f1469b5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:39.821445 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a629188-e6b5-4f05-8008-46781f1469b5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:39.822868 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a629188-e6b5-4f05-8008-46781f1469b5 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:39.823690 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95cb266-623b-41ef-9bf1-c6431137fc26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:39.824359 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95cb266-623b-41ef-9bf1-c6431137fc26 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:39.824642 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95cb266-623b-41ef-9bf1-c6431137fc26 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:39.824918 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95cb266-623b-41ef-9bf1-c6431137fc26 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:39.825635 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95cb266-623b-41ef-9bf1-c6431137fc26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:39.825945 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95cb266-623b-41ef-9bf1-c6431137fc26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:39.827351 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95cb266-623b-41ef-9bf1-c6431137fc26 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:39.836478 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-5a629188-e6b5-4f05-8008-46781f1469b5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Apr 11 16:22:39.837639 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 249/505] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Apr 11 16:22:39 2022] GET /identity/v3/users/glance => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:39.842775 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 257/506] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Apr 11 16:22:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:39.842909 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a629188-e6b5-4f05-8008-46781f1469b5 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:39.843017 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36484df6-f2b6-4f1f-b49c-2b810c127cf4 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:39.843017 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36484df6-f2b6-4f1f-b49c-2b810c127cf4 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:39.843017 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36484df6-f2b6-4f1f-b49c-2b810c127cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:39.856822 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-36484df6-f2b6-4f1f-b49c-2b810c127cf4 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:22:39.858652 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-36484df6-f2b6-4f1f-b49c-2b810c127cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:22:39.921892 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 258/507] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:22:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:22:39.922757 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36484df6-f2b6-4f1f-b49c-2b810c127cf4 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:39.935724 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a629188-e6b5-4f05-8008-46781f1469b5 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:39.968867 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48134d0-e29c-48ef-a68a-378617e92fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:39.969537 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48134d0-e29c-48ef-a68a-378617e92fb3 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:39.969823 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48134d0-e29c-48ef-a68a-378617e92fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:39.970102 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48134d0-e29c-48ef-a68a-378617e92fb3 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:39.970860 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48134d0-e29c-48ef-a68a-378617e92fb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:39.971173 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48134d0-e29c-48ef-a68a-378617e92fb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:39.972570 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48134d0-e29c-48ef-a68a-378617e92fb3 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:39.983974 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 250/508] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Apr 11 16:22:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:39.984595 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48134d0-e29c-48ef-a68a-378617e92fb3 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:40.020252 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36484df6-f2b6-4f1f-b49c-2b810c127cf4 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:40.052579 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc548620-862a-4ad5-89da-bb6e20bfb714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:40.053365 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc548620-862a-4ad5-89da-bb6e20bfb714 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:40.053642 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc548620-862a-4ad5-89da-bb6e20bfb714 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:40.053912 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc548620-862a-4ad5-89da-bb6e20bfb714 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:40.066935 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc548620-862a-4ad5-89da-bb6e20bfb714 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:22:40.074827 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-dc548620-862a-4ad5-89da-bb6e20bfb714 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 16:22:40.076322 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 259/509] 10.222.0.43 () {56 vars in 1102 bytes} [Mon Apr 11 16:22:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:40.077091 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc548620-862a-4ad5-89da-bb6e20bfb714 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:40.078891 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48134d0-e29c-48ef-a68a-378617e92fb3 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:40.115036 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3843602d-16b8-4139-8e39-03253d5fa885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:40.115736 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843602d-16b8-4139-8e39-03253d5fa885 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:40.116025 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843602d-16b8-4139-8e39-03253d5fa885 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:40.116331 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843602d-16b8-4139-8e39-03253d5fa885 None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:40.117167 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3843602d-16b8-4139-8e39-03253d5fa885 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:40.117499 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3843602d-16b8-4139-8e39-03253d5fa885 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:40.118887 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3843602d-16b8-4139-8e39-03253d5fa885 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:40.135724 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 251/510] 10.222.0.43 () {56 vars in 1137 bytes} [Mon Apr 11 16:22:39 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:40.136529 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3843602d-16b8-4139-8e39-03253d5fa885 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:40.186161 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc548620-862a-4ad5-89da-bb6e20bfb714 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:40.217710 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252fab7d-5e10-4888-a8b5-4b5df159969f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:40.218502 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252fab7d-5e10-4888-a8b5-4b5df159969f None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:40.218782 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252fab7d-5e10-4888-a8b5-4b5df159969f None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:40.219053 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252fab7d-5e10-4888-a8b5-4b5df159969f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:40.226233 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252fab7d-5e10-4888-a8b5-4b5df159969f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:40.227717 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252fab7d-5e10-4888-a8b5-4b5df159969f None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:40.228375 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3843602d-16b8-4139-8e39-03253d5fa885 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:40.241247 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-252fab7d-5e10-4888-a8b5-4b5df159969f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 11 16:22:40.242414 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 260/511] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Apr 11 16:22:40 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:40.243176 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252fab7d-5e10-4888-a8b5-4b5df159969f None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:40.260994 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9080a26-63f2-479c-9f5a-cf1b8c82fc4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:40.261811 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9080a26-63f2-479c-9f5a-cf1b8c82fc4c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:40.262099 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9080a26-63f2-479c-9f5a-cf1b8c82fc4c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:40.262377 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9080a26-63f2-479c-9f5a-cf1b8c82fc4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:40.272691 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9080a26-63f2-479c-9f5a-cf1b8c82fc4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:40.274111 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9080a26-63f2-479c-9f5a-cf1b8c82fc4c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:40.291084 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-e9080a26-63f2-479c-9f5a-cf1b8c82fc4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:22:40.292294 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 252/512] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:22:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:40.293068 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9080a26-63f2-479c-9f5a-cf1b8c82fc4c None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:40.338390 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252fab7d-5e10-4888-a8b5-4b5df159969f None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:40.371327 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8215d077-9d2d-4b9c-8276-7669f9c598e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:40.372148 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215d077-9d2d-4b9c-8276-7669f9c598e1 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:40.372429 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215d077-9d2d-4b9c-8276-7669f9c598e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:40.372700 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215d077-9d2d-4b9c-8276-7669f9c598e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:40.379697 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8215d077-9d2d-4b9c-8276-7669f9c598e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:40.381154 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8215d077-9d2d-4b9c-8276-7669f9c598e1 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:40.393919 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9080a26-63f2-479c-9f5a-cf1b8c82fc4c None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:40.395710 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-8215d077-9d2d-4b9c-8276-7669f9c598e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 16:22:40.396895 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 261/513] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Apr 11 16:22:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:40.397656 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8215d077-9d2d-4b9c-8276-7669f9c598e1 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:40.431458 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934a1286-81dd-4f6e-aff8-4c53024cc7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:40.432158 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a1286-81dd-4f6e-aff8-4c53024cc7f3 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:40.432448 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a1286-81dd-4f6e-aff8-4c53024cc7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:40.432728 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a1286-81dd-4f6e-aff8-4c53024cc7f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:40.433494 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934a1286-81dd-4f6e-aff8-4c53024cc7f3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:40.433805 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934a1286-81dd-4f6e-aff8-4c53024cc7f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:40.435191 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934a1286-81dd-4f6e-aff8-4c53024cc7f3 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:40.443321 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 253/514] 10.222.0.43 () {56 vars in 1103 bytes} [Mon Apr 11 16:22:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:40.444113 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934a1286-81dd-4f6e-aff8-4c53024cc7f3 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:40.504383 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8215d077-9d2d-4b9c-8276-7669f9c598e1 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:40.537660 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8587f42-390c-48f2-8909-79e28b419427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:40.538310 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8587f42-390c-48f2-8909-79e28b419427 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:40.538593 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8587f42-390c-48f2-8909-79e28b419427 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:40.538868 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8587f42-390c-48f2-8909-79e28b419427 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:40.541768 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934a1286-81dd-4f6e-aff8-4c53024cc7f3 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:40.574183 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6faf06-c7b4-4813-a8d5-6987155a76c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:40.574846 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6faf06-c7b4-4813-a8d5-6987155a76c8 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:40.575129 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6faf06-c7b4-4813-a8d5-6987155a76c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:40.575407 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6faf06-c7b4-4813-a8d5-6987155a76c8 None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:40.577052 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6faf06-c7b4-4813-a8d5-6987155a76c8 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:40.577360 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6faf06-c7b4-4813-a8d5-6987155a76c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:40.578867 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6faf06-c7b4-4813-a8d5-6987155a76c8 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:40.595914 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 254/515] 10.222.0.43 () {56 vars in 1137 bytes} [Mon Apr 11 16:22:40 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:40.596704 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6faf06-c7b4-4813-a8d5-6987155a76c8 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:40.603491 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8587f42-390c-48f2-8909-79e28b419427 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:40.604976 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8587f42-390c-48f2-8909-79e28b419427 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:40.689535 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6faf06-c7b4-4813-a8d5-6987155a76c8 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:40.699301 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 262/516] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Apr 11 16:22:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 16:22:40.699932 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8587f42-390c-48f2-8909-79e28b419427 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:40.725412 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec6efe7-0e6a-4821-a28b-08ef3b3c9116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:40.726071 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec6efe7-0e6a-4821-a28b-08ef3b3c9116 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:40.726354 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec6efe7-0e6a-4821-a28b-08ef3b3c9116 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:40.726632 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec6efe7-0e6a-4821-a28b-08ef3b3c9116 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:40.727352 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec6efe7-0e6a-4821-a28b-08ef3b3c9116 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:40.727693 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec6efe7-0e6a-4821-a28b-08ef3b3c9116 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:40.729053 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec6efe7-0e6a-4821-a28b-08ef3b3c9116 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:40.739878 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 255/517] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Apr 11 16:22:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:40.740706 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec6efe7-0e6a-4821-a28b-08ef3b3c9116 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:40.805174 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8587f42-390c-48f2-8909-79e28b419427 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:40.834438 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec6efe7-0e6a-4821-a28b-08ef3b3c9116 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:40.837995 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea581d-24e5-44e7-92e8-3a32c6a82fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:40.838656 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea581d-24e5-44e7-92e8-3a32c6a82fe7 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:40.838942 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea581d-24e5-44e7-92e8-3a32c6a82fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:40.839217 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea581d-24e5-44e7-92e8-3a32c6a82fe7 None admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:40.840064 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ea581d-24e5-44e7-92e8-3a32c6a82fe7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:40.840375 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ea581d-24e5-44e7-92e8-3a32c6a82fe7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:40.841848 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ea581d-24e5-44e7-92e8-3a32c6a82fe7 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:40.859464 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 263/518] 10.222.0.43 () {56 vars in 1148 bytes} [Mon Apr 11 16:22:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:40.860288 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea581d-24e5-44e7-92e8-3a32c6a82fe7 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:40.865608 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a150e8ed-a9e5-46cd-8a65-e9becf617bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:40.866405 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a150e8ed-a9e5-46cd-8a65-e9becf617bda None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:40.866699 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a150e8ed-a9e5-46cd-8a65-e9becf617bda None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:40.866975 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a150e8ed-a9e5-46cd-8a65-e9becf617bda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:40.878166 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a150e8ed-a9e5-46cd-8a65-e9becf617bda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:40.879613 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a150e8ed-a9e5-46cd-8a65-e9becf617bda None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:40.895587 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-a150e8ed-a9e5-46cd-8a65-e9becf617bda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:22:40.896754 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 256/519] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:22:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:40.897523 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a150e8ed-a9e5-46cd-8a65-e9becf617bda None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:40.955204 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea581d-24e5-44e7-92e8-3a32c6a82fe7 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:40.987964 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e501da-3951-4e9e-aab2-a3631989c4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:40.988616 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e501da-3951-4e9e-aab2-a3631989c4e4 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:40.988903 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e501da-3951-4e9e-aab2-a3631989c4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:40.989179 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e501da-3951-4e9e-aab2-a3631989c4e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:40.990709 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a150e8ed-a9e5-46cd-8a65-e9becf617bda None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:41.022660 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b05994-fbd4-4279-a157-984bad818b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:41.023445 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b05994-fbd4-4279-a157-984bad818b31 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:41.023759 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b05994-fbd4-4279-a157-984bad818b31 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:41.024037 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b05994-fbd4-4279-a157-984bad818b31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:41.034864 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b05994-fbd4-4279-a157-984bad818b31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:41.036342 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b05994-fbd4-4279-a157-984bad818b31 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:41.052208 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-73b05994-fbd4-4279-a157-984bad818b31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:22:41.053387 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 257/520] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:22:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:41.054140 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b05994-fbd4-4279-a157-984bad818b31 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:41.054902 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e501da-3951-4e9e-aab2-a3631989c4e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:41.056392 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e501da-3951-4e9e-aab2-a3631989c4e4 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:41.147496 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b05994-fbd4-4279-a157-984bad818b31 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:41.149293 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 264/521] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Apr 11 16:22:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 16:22:41.150121 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e501da-3951-4e9e-aab2-a3631989c4e4 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:41.179234 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af4691-5e26-46d6-970a-4a44621601cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:41.179928 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af4691-5e26-46d6-970a-4a44621601cb None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:41.180218 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af4691-5e26-46d6-970a-4a44621601cb None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:41.180494 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af4691-5e26-46d6-970a-4a44621601cb None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:41.181194 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89af4691-5e26-46d6-970a-4a44621601cb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:41.182614 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89af4691-5e26-46d6-970a-4a44621601cb None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:41.243597 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e501da-3951-4e9e-aab2-a3631989c4e4 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:41.269281 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 258/522] 10.222.0.43 () {60 vars in 1132 bytes} [Mon Apr 11 16:22:41 2022] POST /identity/v3/users => generated 247 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:22:41.270113 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af4691-5e26-46d6-970a-4a44621601cb None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:41.281970 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07c68ad-167b-4842-bad1-28d785e4ac79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:41.282662 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c68ad-167b-4842-bad1-28d785e4ac79 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:41.283006 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c68ad-167b-4842-bad1-28d785e4ac79 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:41.283287 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c68ad-167b-4842-bad1-28d785e4ac79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:41.284279 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07c68ad-167b-4842-bad1-28d785e4ac79 None admin] RBAC: Adding query filter params (role.id=de92d251e74f470e95b6df12ece586b8, scope.project.id=477b9d41390e455a82e733c4fc6acd6b, user.id=1be2652c984a4283aeee0b937f0555e4) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:41.284594 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07c68ad-167b-4842-bad1-28d785e4ac79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:41.286072 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07c68ad-167b-4842-bad1-28d785e4ac79 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:41.292347 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 265/523] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Apr 11 16:22:41 2022] GET /identity/v3/role_assignments?user.id=1be2652c984a4283aeee0b937f0555e4&scope.project.id=477b9d41390e455a82e733c4fc6acd6b&role.id=de92d251e74f470e95b6df12ece586b8 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:41.293210 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07c68ad-167b-4842-bad1-28d785e4ac79 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:41.401313 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af4691-5e26-46d6-970a-4a44621601cb None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:41.440158 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f85e92-75ec-4ce3-ab62-4a1f17b960d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:41.440842 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f85e92-75ec-4ce3-ab62-4a1f17b960d4 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:41.441126 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f85e92-75ec-4ce3-ab62-4a1f17b960d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:41.441402 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f85e92-75ec-4ce3-ab62-4a1f17b960d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:41.442148 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f85e92-75ec-4ce3-ab62-4a1f17b960d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:41.442554 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f85e92-75ec-4ce3-ab62-4a1f17b960d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:41.443980 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f85e92-75ec-4ce3-ab62-4a1f17b960d4 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:41.450927 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07c68ad-167b-4842-bad1-28d785e4ac79 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:41.463265 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 259/524] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Apr 11 16:22:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:41.464296 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f85e92-75ec-4ce3-ab62-4a1f17b960d4 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:41.505679 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6299281f-b93e-4635-8d92-29ca6f7ecd59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:41.506286 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6299281f-b93e-4635-8d92-29ca6f7ecd59 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:41.506575 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6299281f-b93e-4635-8d92-29ca6f7ecd59 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:41.506851 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6299281f-b93e-4635-8d92-29ca6f7ecd59 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:41.507606 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6299281f-b93e-4635-8d92-29ca6f7ecd59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:41.507921 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6299281f-b93e-4635-8d92-29ca6f7ecd59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:41.509293 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6299281f-b93e-4635-8d92-29ca6f7ecd59 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:41.523112 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 266/525] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Apr 11 16:22:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:41.523895 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6299281f-b93e-4635-8d92-29ca6f7ecd59 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:41.597433 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f85e92-75ec-4ce3-ab62-4a1f17b960d4 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:41.638589 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6299281f-b93e-4635-8d92-29ca6f7ecd59 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:41.642414 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc4398d-1302-4cf6-a6aa-60c6923bbe6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:41.643229 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc4398d-1302-4cf6-a6aa-60c6923bbe6d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:41.643535 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc4398d-1302-4cf6-a6aa-60c6923bbe6d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:41.643817 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc4398d-1302-4cf6-a6aa-60c6923bbe6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:41.656831 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc4398d-1302-4cf6-a6aa-60c6923bbe6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:41.658742 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc4398d-1302-4cf6-a6aa-60c6923bbe6d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:41.677566 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8988c19f-e57e-45ce-a61d-5f23239f7541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:41.678682 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988c19f-e57e-45ce-a61d-5f23239f7541 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:41.679142 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988c19f-e57e-45ce-a61d-5f23239f7541 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:41.679545 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-4dc4398d-1302-4cf6-a6aa-60c6923bbe6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:22:41.679851 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988c19f-e57e-45ce-a61d-5f23239f7541 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:41.681072 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 260/526] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:22:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:41.681870 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc4398d-1302-4cf6-a6aa-60c6923bbe6d None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:41.690292 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8988c19f-e57e-45ce-a61d-5f23239f7541 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:41.692112 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8988c19f-e57e-45ce-a61d-5f23239f7541 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:41.706879 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-8988c19f-e57e-45ce-a61d-5f23239f7541 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Apr 11 16:22:41.708686 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 267/527] 10.222.0.43 () {56 vars in 1102 bytes} [Mon Apr 11 16:22:41 2022] GET /identity/v3/users/neutron => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:41.709685 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8988c19f-e57e-45ce-a61d-5f23239f7541 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:41.785666 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc4398d-1302-4cf6-a6aa-60c6923bbe6d None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:41.814306 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8988c19f-e57e-45ce-a61d-5f23239f7541 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:41.818644 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68050fae-a526-4ac3-af46-2981202b0c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:41.819443 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68050fae-a526-4ac3-af46-2981202b0c93 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:41.819770 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68050fae-a526-4ac3-af46-2981202b0c93 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:41.820053 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68050fae-a526-4ac3-af46-2981202b0c93 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:41.827507 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68050fae-a526-4ac3-af46-2981202b0c93 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:41.828980 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68050fae-a526-4ac3-af46-2981202b0c93 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:41.843165 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-68050fae-a526-4ac3-af46-2981202b0c93 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 16:22:41.844683 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 261/528] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Apr 11 16:22:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:41.845525 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68050fae-a526-4ac3-af46-2981202b0c93 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:41.852574 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea28ccb9-f7b3-4582-9895-321b0aa88973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:41.853508 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea28ccb9-f7b3-4582-9895-321b0aa88973 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:41.854006 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea28ccb9-f7b3-4582-9895-321b0aa88973 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:41.854477 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea28ccb9-f7b3-4582-9895-321b0aa88973 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:41.855365 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea28ccb9-f7b3-4582-9895-321b0aa88973 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:41.855926 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea28ccb9-f7b3-4582-9895-321b0aa88973 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:41.857628 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea28ccb9-f7b3-4582-9895-321b0aa88973 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:41.871174 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 268/529] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Apr 11 16:22:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:41.872244 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea28ccb9-f7b3-4582-9895-321b0aa88973 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:41.942324 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68050fae-a526-4ac3-af46-2981202b0c93 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:41.972901 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea28ccb9-f7b3-4582-9895-321b0aa88973 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:41.976924 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a9be0-70b5-4cea-bd10-169fc275c828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:41.977601 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a9be0-70b5-4cea-bd10-169fc275c828 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:41.977885 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a9be0-70b5-4cea-bd10-169fc275c828 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:41.978163 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a9be0-70b5-4cea-bd10-169fc275c828 None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:41.979005 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222a9be0-70b5-4cea-bd10-169fc275c828 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:41.979313 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222a9be0-70b5-4cea-bd10-169fc275c828 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:41.980777 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222a9be0-70b5-4cea-bd10-169fc275c828 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:41.999633 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 262/530] 10.222.0.43 () {56 vars in 1139 bytes} [Mon Apr 11 16:22:41 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:42.000482 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a9be0-70b5-4cea-bd10-169fc275c828 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:42.011767 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd9d10b-f54d-4742-8b7a-06d92376144c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:42.012819 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9d10b-f54d-4742-8b7a-06d92376144c None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:42.013300 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9d10b-f54d-4742-8b7a-06d92376144c None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:42.014295 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9d10b-f54d-4742-8b7a-06d92376144c None admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:42.015255 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd9d10b-f54d-4742-8b7a-06d92376144c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:42.015762 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd9d10b-f54d-4742-8b7a-06d92376144c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:42.017367 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd9d10b-f54d-4742-8b7a-06d92376144c None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:42.030383 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 269/531] 10.222.0.43 () {56 vars in 1148 bytes} [Mon Apr 11 16:22:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:42.031444 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd9d10b-f54d-4742-8b7a-06d92376144c None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:42.099176 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a9be0-70b5-4cea-bd10-169fc275c828 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:42.133190 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c816cf9-06c0-4789-94e2-ba8e858ddf84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:42.133991 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c816cf9-06c0-4789-94e2-ba8e858ddf84 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:42.134276 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c816cf9-06c0-4789-94e2-ba8e858ddf84 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:42.134553 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c816cf9-06c0-4789-94e2-ba8e858ddf84 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:42.139330 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd9d10b-f54d-4742-8b7a-06d92376144c None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:42.142443 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c816cf9-06c0-4789-94e2-ba8e858ddf84 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:42.143486 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c816cf9-06c0-4789-94e2-ba8e858ddf84 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:42.157060 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-6c816cf9-06c0-4789-94e2-ba8e858ddf84 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 16:22:42.158599 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 263/532] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Apr 11 16:22:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:42.159451 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c816cf9-06c0-4789-94e2-ba8e858ddf84 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:42.174866 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f0401-84ad-4561-9beb-baf7dc1ad7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:42.175881 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f0401-84ad-4561-9beb-baf7dc1ad7b4 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:42.176341 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f0401-84ad-4561-9beb-baf7dc1ad7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:42.176815 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f0401-84ad-4561-9beb-baf7dc1ad7b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:42.255327 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00f0401-84ad-4561-9beb-baf7dc1ad7b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:42.256814 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00f0401-84ad-4561-9beb-baf7dc1ad7b4 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:42.277699 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c816cf9-06c0-4789-94e2-ba8e858ddf84 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:42.321091 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996740ff-3d23-4f0f-a761-77cf3bd3dfbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:42.322638 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996740ff-3d23-4f0f-a761-77cf3bd3dfbd None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:42.323114 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996740ff-3d23-4f0f-a761-77cf3bd3dfbd None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:42.323591 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996740ff-3d23-4f0f-a761-77cf3bd3dfbd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:42.324600 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996740ff-3d23-4f0f-a761-77cf3bd3dfbd None admin] RBAC: Adding query filter params (role.id=de92d251e74f470e95b6df12ece586b8, scope.project.id=477b9d41390e455a82e733c4fc6acd6b, user.id=a0f7cf98d5394b28a475fd67e30fc9c6) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:42.325267 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996740ff-3d23-4f0f-a761-77cf3bd3dfbd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:42.327638 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996740ff-3d23-4f0f-a761-77cf3bd3dfbd None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:42.334948 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 264/533] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Apr 11 16:22:42 2022] GET /identity/v3/role_assignments?user.id=a0f7cf98d5394b28a475fd67e30fc9c6&scope.project.id=477b9d41390e455a82e733c4fc6acd6b&role.id=de92d251e74f470e95b6df12ece586b8 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:42.335975 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996740ff-3d23-4f0f-a761-77cf3bd3dfbd None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:42.373713 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 270/534] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Apr 11 16:22:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 16:22:42.379189 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f0401-84ad-4561-9beb-baf7dc1ad7b4 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:42.453636 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996740ff-3d23-4f0f-a761-77cf3bd3dfbd None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:42.489969 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e4ed80-3b8c-4625-8286-2ffdf2964583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:42.490944 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e4ed80-3b8c-4625-8286-2ffdf2964583 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:42.491479 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e4ed80-3b8c-4625-8286-2ffdf2964583 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:42.492044 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e4ed80-3b8c-4625-8286-2ffdf2964583 None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:42.493041 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e4ed80-3b8c-4625-8286-2ffdf2964583 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:42.493593 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e4ed80-3b8c-4625-8286-2ffdf2964583 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:42.495215 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e4ed80-3b8c-4625-8286-2ffdf2964583 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:42.513389 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f0401-84ad-4561-9beb-baf7dc1ad7b4 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:42.523785 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 265/535] 10.222.0.43 () {56 vars in 1148 bytes} [Mon Apr 11 16:22:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:42.525961 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e4ed80-3b8c-4625-8286-2ffdf2964583 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:42.563545 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e154f00c-df86-4b3b-9d8c-6c417b933d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:42.565512 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154f00c-df86-4b3b-9d8c-6c417b933d11 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:42.566741 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154f00c-df86-4b3b-9d8c-6c417b933d11 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:42.568687 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154f00c-df86-4b3b-9d8c-6c417b933d11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:42.591829 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e154f00c-df86-4b3b-9d8c-6c417b933d11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:42.593727 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e154f00c-df86-4b3b-9d8c-6c417b933d11 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:42.619244 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-e154f00c-df86-4b3b-9d8c-6c417b933d11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:22:42.621394 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 271/536] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:22:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:42.632670 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e154f00c-df86-4b3b-9d8c-6c417b933d11 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:42.707456 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e4ed80-3b8c-4625-8286-2ffdf2964583 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:42.759042 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131235c4-dafb-4430-8a34-2747332f0c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:42.759731 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131235c4-dafb-4430-8a34-2747332f0c2e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:42.760012 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131235c4-dafb-4430-8a34-2747332f0c2e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:42.760285 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131235c4-dafb-4430-8a34-2747332f0c2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:42.761110 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131235c4-dafb-4430-8a34-2747332f0c2e None admin] RBAC: Adding query filter params (role.id=de92d251e74f470e95b6df12ece586b8, scope.project.id=477b9d41390e455a82e733c4fc6acd6b, user.id=950b5b5f690d41509ead753065a0b793) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:42.761416 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131235c4-dafb-4430-8a34-2747332f0c2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:42.762847 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131235c4-dafb-4430-8a34-2747332f0c2e None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:42.769128 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 266/537] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Apr 11 16:22:42 2022] GET /identity/v3/role_assignments?user.id=950b5b5f690d41509ead753065a0b793&scope.project.id=477b9d41390e455a82e733c4fc6acd6b&role.id=de92d251e74f470e95b6df12ece586b8 => generated 259 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:42.779021 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e154f00c-df86-4b3b-9d8c-6c417b933d11 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:42.832272 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd1fe33-a346-4bc3-ac6a-eff767c7ed50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:42.833040 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd1fe33-a346-4bc3-ac6a-eff767c7ed50 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:42.833242 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd1fe33-a346-4bc3-ac6a-eff767c7ed50 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:42.833513 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd1fe33-a346-4bc3-ac6a-eff767c7ed50 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:42.834252 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd1fe33-a346-4bc3-ac6a-eff767c7ed50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:42.834943 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd1fe33-a346-4bc3-ac6a-eff767c7ed50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:42.836891 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd1fe33-a346-4bc3-ac6a-eff767c7ed50 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:42.855256 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 272/538] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Apr 11 16:22:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:42.861287 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131235c4-dafb-4430-8a34-2747332f0c2e None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:43.025570 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131235c4-dafb-4430-8a34-2747332f0c2e None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:43.069119 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f1950-d67f-4c7a-bc29-15dd210b3235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:43.070287 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f1950-d67f-4c7a-bc29-15dd210b3235 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:43.070789 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f1950-d67f-4c7a-bc29-15dd210b3235 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:43.071275 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f1950-d67f-4c7a-bc29-15dd210b3235 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:43.080743 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086f1950-d67f-4c7a-bc29-15dd210b3235 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:43.082455 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086f1950-d67f-4c7a-bc29-15dd210b3235 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:43.103122 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-086f1950-d67f-4c7a-bc29-15dd210b3235 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 16:22:43.104712 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 267/539] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Apr 11 16:22:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:43.112341 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd1fe33-a346-4bc3-ac6a-eff767c7ed50 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:43.241982 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd1fe33-a346-4bc3-ac6a-eff767c7ed50 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:43.283162 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0336ef0-0397-40b5-bf69-8e4da2f42eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:43.283785 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0336ef0-0397-40b5-bf69-8e4da2f42eee None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:43.284069 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0336ef0-0397-40b5-bf69-8e4da2f42eee None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:43.284347 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0336ef0-0397-40b5-bf69-8e4da2f42eee None admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:43.285138 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0336ef0-0397-40b5-bf69-8e4da2f42eee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:43.285449 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0336ef0-0397-40b5-bf69-8e4da2f42eee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:43.286884 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0336ef0-0397-40b5-bf69-8e4da2f42eee None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:43.300472 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 273/540] 10.222.0.43 () {56 vars in 1148 bytes} [Mon Apr 11 16:22:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:43.306004 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f1950-d67f-4c7a-bc29-15dd210b3235 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:43.446987 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f1950-d67f-4c7a-bc29-15dd210b3235 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:43.492842 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abb519c-4b63-4655-a26e-76ac580bb80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:43.493504 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb519c-4b63-4655-a26e-76ac580bb80e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:43.493789 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb519c-4b63-4655-a26e-76ac580bb80e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:43.494067 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb519c-4b63-4655-a26e-76ac580bb80e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:43.494901 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abb519c-4b63-4655-a26e-76ac580bb80e None admin] RBAC: Adding query filter params (role.id=de92d251e74f470e95b6df12ece586b8, scope.project.id=477b9d41390e455a82e733c4fc6acd6b, user.id=f8c213711e794a1ba47ecf46ecb57769) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:43.495214 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abb519c-4b63-4655-a26e-76ac580bb80e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:43.496931 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abb519c-4b63-4655-a26e-76ac580bb80e None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:43.509293 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 268/541] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Apr 11 16:22:43 2022] GET /identity/v3/role_assignments?user.id=f8c213711e794a1ba47ecf46ecb57769&scope.project.id=477b9d41390e455a82e733c4fc6acd6b&role.id=de92d251e74f470e95b6df12ece586b8 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:43.942192 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff5909-713e-4bdc-9b7f-9025b315e8b6 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:43.942716 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff5909-713e-4bdc-9b7f-9025b315e8b6 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:43.943029 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff5909-713e-4bdc-9b7f-9025b315e8b6 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:43.944765 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 274/542] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:22:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:22:43.950414 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302298b4-1fae-4235-8a7e-023afcb0ef08 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:43.951622 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302298b4-1fae-4235-8a7e-023afcb0ef08 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:43.951911 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302298b4-1fae-4235-8a7e-023afcb0ef08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:43.976871 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-302298b4-1fae-4235-8a7e-023afcb0ef08 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:22:43.978133 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-302298b4-1fae-4235-8a7e-023afcb0ef08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:22:44.079741 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 269/543] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:22:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 16:22:44.105783 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ff5909-713e-4bdc-9b7f-9025b315e8b6 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:44.125718 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d84ea1-d0ac-45c2-9013-6bb43668668f None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:44.126013 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d84ea1-d0ac-45c2-9013-6bb43668668f None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:44.126274 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d84ea1-d0ac-45c2-9013-6bb43668668f None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:44.127797 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 270/544] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:22:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 16:22:44.133712 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab5819-f047-4725-83c4-d2b83f2ee537 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:44.133994 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab5819-f047-4725-83c4-d2b83f2ee537 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:44.134267 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab5819-f047-4725-83c4-d2b83f2ee537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:44.158018 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-02ab5819-f047-4725-83c4-d2b83f2ee537 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:22:44.159249 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-02ab5819-f047-4725-83c4-d2b83f2ee537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:22:44.289624 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 271/545] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:22:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 16:22:44.304183 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ff5909-713e-4bdc-9b7f-9025b315e8b6 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:44.316430 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ab5819-f047-4725-83c4-d2b83f2ee537 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:44.374456 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6344d578-7d0d-4619-abdb-0acea44beef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:44.375288 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6344d578-7d0d-4619-abdb-0acea44beef9 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:44.375935 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6344d578-7d0d-4619-abdb-0acea44beef9 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:44.375935 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6344d578-7d0d-4619-abdb-0acea44beef9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:44.405050 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6344d578-7d0d-4619-abdb-0acea44beef9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:22:44.416985 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-6344d578-7d0d-4619-abdb-0acea44beef9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 16:22:44.418572 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 275/546] 10.222.0.43 () {56 vars in 1102 bytes} [Mon Apr 11 16:22:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:44.424969 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6344d578-7d0d-4619-abdb-0acea44beef9 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:44.426281 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ab5819-f047-4725-83c4-d2b83f2ee537 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:44.469490 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3f2745-96a1-491e-9731-ceabbed527e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:44.470696 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f2745-96a1-491e-9731-ceabbed527e7 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:44.471238 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f2745-96a1-491e-9731-ceabbed527e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:44.471865 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f2745-96a1-491e-9731-ceabbed527e7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:44.494007 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3f2745-96a1-491e-9731-ceabbed527e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:22:44.508720 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-3d3f2745-96a1-491e-9731-ceabbed527e7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 16:22:44.509983 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 272/547] 10.222.0.43 () {56 vars in 1102 bytes} [Mon Apr 11 16:22:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:22:44.518690 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3f2745-96a1-491e-9731-ceabbed527e7 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:44.611540 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6344d578-7d0d-4619-abdb-0acea44beef9 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:44.648361 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1900de91-4abe-4998-96ec-e8d80c34a0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:44.649044 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1900de91-4abe-4998-96ec-e8d80c34a0cb None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:44.649326 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1900de91-4abe-4998-96ec-e8d80c34a0cb None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:44.649597 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1900de91-4abe-4998-96ec-e8d80c34a0cb None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:44.650348 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1900de91-4abe-4998-96ec-e8d80c34a0cb None admin] RBAC: Adding query filter params (name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:44.650657 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1900de91-4abe-4998-96ec-e8d80c34a0cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:44.652057 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1900de91-4abe-4998-96ec-e8d80c34a0cb None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:44.672660 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 276/548] 10.222.0.43 () {56 vars in 1103 bytes} [Mon Apr 11 16:22:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:22:44.679832 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1900de91-4abe-4998-96ec-e8d80c34a0cb None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:44.716801 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3f2745-96a1-491e-9731-ceabbed527e7 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:44.750318 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f88b4-e7f6-4e01-8918-f24b55ec7160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:44.750988 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f88b4-e7f6-4e01-8918-f24b55ec7160 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:44.751270 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f88b4-e7f6-4e01-8918-f24b55ec7160 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:44.751563 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f88b4-e7f6-4e01-8918-f24b55ec7160 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:44.752317 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f88b4-e7f6-4e01-8918-f24b55ec7160 None admin] RBAC: Adding query filter params (name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:44.752625 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f88b4-e7f6-4e01-8918-f24b55ec7160 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:44.753987 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f88b4-e7f6-4e01-8918-f24b55ec7160 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:44.762443 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 273/549] 10.222.0.43 () {56 vars in 1103 bytes} [Mon Apr 11 16:22:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:22:44.768487 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f88b4-e7f6-4e01-8918-f24b55ec7160 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:44.786426 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1900de91-4abe-4998-96ec-e8d80c34a0cb None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:44.832444 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30238b6-d1d9-4a12-818d-f334641e1885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:44.833270 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30238b6-d1d9-4a12-818d-f334641e1885 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:44.833550 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30238b6-d1d9-4a12-818d-f334641e1885 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:44.833884 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30238b6-d1d9-4a12-818d-f334641e1885 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:44.868609 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30238b6-d1d9-4a12-818d-f334641e1885 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:44.870057 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30238b6-d1d9-4a12-818d-f334641e1885 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:44.886166 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f88b4-e7f6-4e01-8918-f24b55ec7160 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:44.903489 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-d30238b6-d1d9-4a12-818d-f334641e1885 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:22:44.911321 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 277/550] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:22:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:44.916711 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30238b6-d1d9-4a12-818d-f334641e1885 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:44.930012 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c012ee-74b6-4f4a-bda5-021c7b0696ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:44.930820 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c012ee-74b6-4f4a-bda5-021c7b0696ea None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:44.931107 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c012ee-74b6-4f4a-bda5-021c7b0696ea None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:44.931382 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c012ee-74b6-4f4a-bda5-021c7b0696ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:44.948724 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c012ee-74b6-4f4a-bda5-021c7b0696ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:44.950184 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c012ee-74b6-4f4a-bda5-021c7b0696ea None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:44.980939 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-71c012ee-74b6-4f4a-bda5-021c7b0696ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:22:44.993978 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 274/551] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:22:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:44.994906 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c012ee-74b6-4f4a-bda5-021c7b0696ea None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:45.101490 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30238b6-d1d9-4a12-818d-f334641e1885 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:45.162563 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d85ab8-f606-427d-a3bd-de0c1f549f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:45.163157 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d85ab8-f606-427d-a3bd-de0c1f549f84 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:45.163446 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d85ab8-f606-427d-a3bd-de0c1f549f84 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:45.164567 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d85ab8-f606-427d-a3bd-de0c1f549f84 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:45.165301 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d85ab8-f606-427d-a3bd-de0c1f549f84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:45.165616 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d85ab8-f606-427d-a3bd-de0c1f549f84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:45.167009 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d85ab8-f606-427d-a3bd-de0c1f549f84 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:45.185262 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c012ee-74b6-4f4a-bda5-021c7b0696ea None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:45.190416 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 278/552] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Apr 11 16:22:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:22:45.195839 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d85ab8-f606-427d-a3bd-de0c1f549f84 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:45.249040 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c591bc-909e-4496-9388-8e3614f7e435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:45.250855 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c591bc-909e-4496-9388-8e3614f7e435 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:45.251149 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c591bc-909e-4496-9388-8e3614f7e435 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:45.251431 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c591bc-909e-4496-9388-8e3614f7e435 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:45.252203 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c591bc-909e-4496-9388-8e3614f7e435 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:45.252516 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c591bc-909e-4496-9388-8e3614f7e435 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:45.253885 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c591bc-909e-4496-9388-8e3614f7e435 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:45.280269 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 275/553] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Apr 11 16:22:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:45.287119 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c591bc-909e-4496-9388-8e3614f7e435 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:45.362159 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d85ab8-f606-427d-a3bd-de0c1f549f84 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:45.403003 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad6fa70-db8d-4c9b-9a14-cb45fc594570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:45.404963 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad6fa70-db8d-4c9b-9a14-cb45fc594570 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:45.405247 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad6fa70-db8d-4c9b-9a14-cb45fc594570 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:45.405523 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad6fa70-db8d-4c9b-9a14-cb45fc594570 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:45.419982 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad6fa70-db8d-4c9b-9a14-cb45fc594570 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:45.422048 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad6fa70-db8d-4c9b-9a14-cb45fc594570 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:45.431492 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c591bc-909e-4496-9388-8e3614f7e435 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:45.436414 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-dad6fa70-db8d-4c9b-9a14-cb45fc594570 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 11 16:22:45.438124 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 279/554] 10.222.0.43 () {56 vars in 1093 bytes} [Mon Apr 11 16:22:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:45.439492 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab25010-69e8-46da-9923-a938ed832cf6 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:45.440016 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab25010-69e8-46da-9923-a938ed832cf6 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:45.440494 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab25010-69e8-46da-9923-a938ed832cf6 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:45.442227 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 280/555] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:22:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:22:45.443131 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab25010-69e8-46da-9923-a938ed832cf6 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:45.472260 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0655462-f415-412b-b4e5-b5eca0d4aadd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:45.473323 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0655462-f415-412b-b4e5-b5eca0d4aadd None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:45.473771 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0655462-f415-412b-b4e5-b5eca0d4aadd None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:45.474317 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0655462-f415-412b-b4e5-b5eca0d4aadd None admin] PATH_INFO: `/v3/users/swift` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:45.483125 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0655462-f415-412b-b4e5-b5eca0d4aadd None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:45.483873 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0655462-f415-412b-b4e5-b5eca0d4aadd None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:45.497887 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-d0655462-f415-412b-b4e5-b5eca0d4aadd None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 11 16:22:45.501830 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 276/556] 10.222.0.43 () {56 vars in 1096 bytes} [Mon Apr 11 16:22:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:45.501830 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f2f849-a15e-4091-bc1b-400f1d57aae1 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:45.501830 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f2f849-a15e-4091-bc1b-400f1d57aae1 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:45.501830 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f2f849-a15e-4091-bc1b-400f1d57aae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:45.518945 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-e4f2f849-a15e-4091-bc1b-400f1d57aae1 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:22:45.520243 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e4f2f849-a15e-4091-bc1b-400f1d57aae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:22:45.552425 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab25010-69e8-46da-9923-a938ed832cf6 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:45.593034 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 277/557] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:22:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:22:45.595694 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6688f9-ac74-420a-92e5-f49f18ac7bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:45.595694 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6688f9-ac74-420a-92e5-f49f18ac7bf8 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:45.595694 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6688f9-ac74-420a-92e5-f49f18ac7bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:45.595694 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6688f9-ac74-420a-92e5-f49f18ac7bf8 None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:45.595996 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6688f9-ac74-420a-92e5-f49f18ac7bf8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:45.596281 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6688f9-ac74-420a-92e5-f49f18ac7bf8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:45.597638 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6688f9-ac74-420a-92e5-f49f18ac7bf8 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:45.601255 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5dca9f-6409-4786-a929-ac7e4d8fedae None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:45.601772 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5dca9f-6409-4786-a929-ac7e4d8fedae None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:45.602254 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5dca9f-6409-4786-a929-ac7e4d8fedae None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:45.604093 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 278/558] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:22:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:22:45.605119 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5dca9f-6409-4786-a929-ac7e4d8fedae None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:45.634991 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 281/559] 10.222.0.43 () {56 vars in 1133 bytes} [Mon Apr 11 16:22:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:45.636311 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b371f-68ea-4b99-8ef5-c04b63f72cc0 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:45.636600 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b371f-68ea-4b99-8ef5-c04b63f72cc0 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:45.636878 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b371f-68ea-4b99-8ef5-c04b63f72cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:45.654196 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-e94b371f-68ea-4b99-8ef5-c04b63f72cc0 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:22:45.655389 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-e94b371f-68ea-4b99-8ef5-c04b63f72cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:22:45.718127 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5dca9f-6409-4786-a929-ac7e4d8fedae None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:45.727581 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 282/560] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:22:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:22:45.727581 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94b371f-68ea-4b99-8ef5-c04b63f72cc0 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:45.759817 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b88c603-3e6f-41a0-a55c-68dc052f304c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:45.760735 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b88c603-3e6f-41a0-a55c-68dc052f304c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:45.761242 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b88c603-3e6f-41a0-a55c-68dc052f304c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:45.761662 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b88c603-3e6f-41a0-a55c-68dc052f304c None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:45.762721 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b88c603-3e6f-41a0-a55c-68dc052f304c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:45.763698 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b88c603-3e6f-41a0-a55c-68dc052f304c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:45.765374 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b88c603-3e6f-41a0-a55c-68dc052f304c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:45.784771 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 279/561] 10.222.0.43 () {56 vars in 1135 bytes} [Mon Apr 11 16:22:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:45.785921 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b88c603-3e6f-41a0-a55c-68dc052f304c None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:45.832179 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94b371f-68ea-4b99-8ef5-c04b63f72cc0 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:45.871037 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d155e5-46bd-44c7-929e-d036dbf04acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:45.871881 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d155e5-46bd-44c7-929e-d036dbf04acd None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:45.872213 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d155e5-46bd-44c7-929e-d036dbf04acd None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:45.872651 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d155e5-46bd-44c7-929e-d036dbf04acd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:45.882809 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d155e5-46bd-44c7-929e-d036dbf04acd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:22:45.888781 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b88c603-3e6f-41a0-a55c-68dc052f304c None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:45.890652 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-09d155e5-46bd-44c7-929e-d036dbf04acd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 16:22:45.892033 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 283/562] 10.222.0.43 () {56 vars in 1102 bytes} [Mon Apr 11 16:22:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:45.892637 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d155e5-46bd-44c7-929e-d036dbf04acd None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:45.923331 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d848d73f-ed97-45e0-af89-026fa95d74b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:45.924404 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d848d73f-ed97-45e0-af89-026fa95d74b6 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:45.924840 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d848d73f-ed97-45e0-af89-026fa95d74b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:45.925120 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d848d73f-ed97-45e0-af89-026fa95d74b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:45.935746 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d848d73f-ed97-45e0-af89-026fa95d74b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:45.937331 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d848d73f-ed97-45e0-af89-026fa95d74b6 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:45.956833 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-d848d73f-ed97-45e0-af89-026fa95d74b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:22:45.962606 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 280/563] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:22:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:45.962606 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d848d73f-ed97-45e0-af89-026fa95d74b6 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:45.997742 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d155e5-46bd-44c7-929e-d036dbf04acd None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:46.037118 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e396a-4428-40a5-bf01-a688ea09dea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:46.038255 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e396a-4428-40a5-bf01-a688ea09dea1 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:46.038255 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e396a-4428-40a5-bf01-a688ea09dea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:46.038530 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e396a-4428-40a5-bf01-a688ea09dea1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:46.048983 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7e396a-4428-40a5-bf01-a688ea09dea1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:22:46.056046 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-7d7e396a-4428-40a5-bf01-a688ea09dea1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 16:22:46.057381 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 284/564] 10.222.0.43 () {56 vars in 1102 bytes} [Mon Apr 11 16:22:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:46.058054 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e396a-4428-40a5-bf01-a688ea09dea1 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:46.066619 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d848d73f-ed97-45e0-af89-026fa95d74b6 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:46.100738 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c486615a-e72f-4200-bb81-cd34f13da9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:46.101394 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486615a-e72f-4200-bb81-cd34f13da9c8 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:46.101680 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486615a-e72f-4200-bb81-cd34f13da9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:46.101959 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486615a-e72f-4200-bb81-cd34f13da9c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:46.160242 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e396a-4428-40a5-bf01-a688ea09dea1 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:46.171080 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c486615a-e72f-4200-bb81-cd34f13da9c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:46.172645 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c486615a-e72f-4200-bb81-cd34f13da9c8 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:46.193805 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c845339c-c692-4c8e-8b49-9db545a1a0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:46.194476 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c845339c-c692-4c8e-8b49-9db545a1a0cb None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:46.194763 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c845339c-c692-4c8e-8b49-9db545a1a0cb None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:46.195040 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c845339c-c692-4c8e-8b49-9db545a1a0cb None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:46.195806 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c845339c-c692-4c8e-8b49-9db545a1a0cb None admin] RBAC: Adding query filter params (name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:46.196122 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c845339c-c692-4c8e-8b49-9db545a1a0cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:46.197492 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c845339c-c692-4c8e-8b49-9db545a1a0cb None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:46.207637 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 285/565] 10.222.0.43 () {56 vars in 1103 bytes} [Mon Apr 11 16:22:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:46.207637 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c845339c-c692-4c8e-8b49-9db545a1a0cb None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:46.274400 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 281/566] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Apr 11 16:22:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 16:22:46.275155 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c486615a-e72f-4200-bb81-cd34f13da9c8 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:46.311495 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c845339c-c692-4c8e-8b49-9db545a1a0cb None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:46.344849 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873bbc9c-f56a-488e-b752-755b3d3755fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:46.345520 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873bbc9c-f56a-488e-b752-755b3d3755fb None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:46.345827 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873bbc9c-f56a-488e-b752-755b3d3755fb None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:46.346104 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873bbc9c-f56a-488e-b752-755b3d3755fb None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:46.346830 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873bbc9c-f56a-488e-b752-755b3d3755fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:46.347143 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873bbc9c-f56a-488e-b752-755b3d3755fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:46.348637 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873bbc9c-f56a-488e-b752-755b3d3755fb None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:46.364606 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 286/567] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Apr 11 16:22:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:46.364606 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873bbc9c-f56a-488e-b752-755b3d3755fb None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:46.383227 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c486615a-e72f-4200-bb81-cd34f13da9c8 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:46.427330 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e5373-14f6-4630-b900-e5c37440aa4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:46.428032 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e5373-14f6-4630-b900-e5c37440aa4d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:46.428317 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e5373-14f6-4630-b900-e5c37440aa4d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:46.428595 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e5373-14f6-4630-b900-e5c37440aa4d None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:46.429342 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64e5373-14f6-4630-b900-e5c37440aa4d None admin] RBAC: Adding query filter params (name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:46.429650 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64e5373-14f6-4630-b900-e5c37440aa4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:46.431011 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64e5373-14f6-4630-b900-e5c37440aa4d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:46.438799 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 282/568] 10.222.0.43 () {56 vars in 1103 bytes} [Mon Apr 11 16:22:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:46.439618 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e5373-14f6-4630-b900-e5c37440aa4d None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:46.465098 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873bbc9c-f56a-488e-b752-755b3d3755fb None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:46.498336 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c8b8c1-7876-4bf6-9250-b2cbea8bb915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:46.499176 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c8b8c1-7876-4bf6-9250-b2cbea8bb915 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:46.499455 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c8b8c1-7876-4bf6-9250-b2cbea8bb915 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:46.499828 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c8b8c1-7876-4bf6-9250-b2cbea8bb915 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:46.509905 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c8b8c1-7876-4bf6-9250-b2cbea8bb915 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:46.511470 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c8b8c1-7876-4bf6-9250-b2cbea8bb915 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:46.529634 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-27c8b8c1-7876-4bf6-9250-b2cbea8bb915 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:22:46.530756 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 287/569] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:22:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:46.531539 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c8b8c1-7876-4bf6-9250-b2cbea8bb915 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:46.537721 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e5373-14f6-4630-b900-e5c37440aa4d None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:46.568942 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d337f98e-408a-4573-9c44-2221518d45b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:46.569729 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d337f98e-408a-4573-9c44-2221518d45b2 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:46.570010 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d337f98e-408a-4573-9c44-2221518d45b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:46.570284 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d337f98e-408a-4573-9c44-2221518d45b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:46.580973 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d337f98e-408a-4573-9c44-2221518d45b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:46.582407 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d337f98e-408a-4573-9c44-2221518d45b2 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:46.598584 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-d337f98e-408a-4573-9c44-2221518d45b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:22:46.599780 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 283/570] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:22:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:46.600970 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed3ef5-0a74-483d-ae8a-41447a0d0152 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:46.601258 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed3ef5-0a74-483d-ae8a-41447a0d0152 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:46.601534 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed3ef5-0a74-483d-ae8a-41447a0d0152 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:46.602770 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 284/571] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:22:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:22:46.603444 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ed3ef5-0a74-483d-ae8a-41447a0d0152 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:46.628421 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c8b8c1-7876-4bf6-9250-b2cbea8bb915 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:46.661410 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8806e8e4-6c1b-44a2-a442-4f38c890477c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:46.662204 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8806e8e4-6c1b-44a2-a442-4f38c890477c None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:46.662490 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8806e8e4-6c1b-44a2-a442-4f38c890477c None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:46.662777 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8806e8e4-6c1b-44a2-a442-4f38c890477c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:46.669394 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8806e8e4-6c1b-44a2-a442-4f38c890477c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:46.670835 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8806e8e4-6c1b-44a2-a442-4f38c890477c None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:46.684198 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-8806e8e4-6c1b-44a2-a442-4f38c890477c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 16:22:46.685884 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 288/572] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Apr 11 16:22:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:46.686640 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8806e8e4-6c1b-44a2-a442-4f38c890477c None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:46.698776 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ed3ef5-0a74-483d-ae8a-41447a0d0152 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:46.730556 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98270461-0ddc-4456-a9b8-36c8e884acba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:46.731336 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98270461-0ddc-4456-a9b8-36c8e884acba None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:46.731745 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98270461-0ddc-4456-a9b8-36c8e884acba None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:46.732019 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98270461-0ddc-4456-a9b8-36c8e884acba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:46.741452 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98270461-0ddc-4456-a9b8-36c8e884acba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:46.742875 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98270461-0ddc-4456-a9b8-36c8e884acba None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:46.759942 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-98270461-0ddc-4456-a9b8-36c8e884acba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:22:46.761110 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 285/573] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:22:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:46.761871 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98270461-0ddc-4456-a9b8-36c8e884acba None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:46.780860 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8806e8e4-6c1b-44a2-a442-4f38c890477c None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:46.812300 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb76cfb7-493c-4876-ad8e-ec01623a5b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:46.812951 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76cfb7-493c-4876-ad8e-ec01623a5b01 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:46.813231 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76cfb7-493c-4876-ad8e-ec01623a5b01 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:46.813504 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76cfb7-493c-4876-ad8e-ec01623a5b01 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:46.814212 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb76cfb7-493c-4876-ad8e-ec01623a5b01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:46.814516 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb76cfb7-493c-4876-ad8e-ec01623a5b01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:46.815900 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb76cfb7-493c-4876-ad8e-ec01623a5b01 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:46.826935 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 289/574] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Apr 11 16:22:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:46.828127 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3188a94-e1b4-4f68-ac9f-29e6e4b9b114 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:46.828410 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3188a94-e1b4-4f68-ac9f-29e6e4b9b114 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:46.828792 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3188a94-e1b4-4f68-ac9f-29e6e4b9b114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:46.844722 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-b3188a94-e1b4-4f68-ac9f-29e6e4b9b114 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:22:46.845904 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-b3188a94-e1b4-4f68-ac9f-29e6e4b9b114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:22:46.855873 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98270461-0ddc-4456-a9b8-36c8e884acba None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:46.889003 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05d6d05-08ee-432a-80e9-7b5522d4704d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:46.889670 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d6d05-08ee-432a-80e9-7b5522d4704d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:46.890079 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d6d05-08ee-432a-80e9-7b5522d4704d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:46.890361 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d6d05-08ee-432a-80e9-7b5522d4704d None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:46.891157 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05d6d05-08ee-432a-80e9-7b5522d4704d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:46.891471 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05d6d05-08ee-432a-80e9-7b5522d4704d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:46.892860 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05d6d05-08ee-432a-80e9-7b5522d4704d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:46.904791 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 286/575] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Apr 11 16:22:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:46.905614 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05d6d05-08ee-432a-80e9-7b5522d4704d None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:46.910350 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 290/576] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:22:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:22:46.911260 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3188a94-e1b4-4f68-ac9f-29e6e4b9b114 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:47.001750 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05d6d05-08ee-432a-80e9-7b5522d4704d None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:47.007667 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3188a94-e1b4-4f68-ac9f-29e6e4b9b114 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:47.034905 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df1cf8b-263e-4867-8f01-da933abb05b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:47.035490 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1cf8b-263e-4867-8f01-da933abb05b6 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:47.035800 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1cf8b-263e-4867-8f01-da933abb05b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:47.036078 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1cf8b-263e-4867-8f01-da933abb05b6 None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:47.036867 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df1cf8b-263e-4867-8f01-da933abb05b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:47.037173 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df1cf8b-263e-4867-8f01-da933abb05b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:47.038602 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df1cf8b-263e-4867-8f01-da933abb05b6 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:47.040472 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f157cc-508e-49ff-9aed-0e0027d69815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:47.041139 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f157cc-508e-49ff-9aed-0e0027d69815 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:47.041422 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f157cc-508e-49ff-9aed-0e0027d69815 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:47.041698 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f157cc-508e-49ff-9aed-0e0027d69815 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:47.042419 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f157cc-508e-49ff-9aed-0e0027d69815 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:47.042727 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f157cc-508e-49ff-9aed-0e0027d69815 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:47.044211 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f157cc-508e-49ff-9aed-0e0027d69815 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:47.049743 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 287/577] 10.222.0.43 () {56 vars in 1148 bytes} [Mon Apr 11 16:22:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:47.050351 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df1cf8b-263e-4867-8f01-da933abb05b6 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:47.055469 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 291/578] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Apr 11 16:22:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:47.056280 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f157cc-508e-49ff-9aed-0e0027d69815 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:47.148919 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df1cf8b-263e-4867-8f01-da933abb05b6 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:47.152946 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f157cc-508e-49ff-9aed-0e0027d69815 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:47.180401 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e4033c-beeb-4bd8-9b13-c499cf664c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:47.181198 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e4033c-beeb-4bd8-9b13-c499cf664c42 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:47.181485 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e4033c-beeb-4bd8-9b13-c499cf664c42 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:47.181765 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e4033c-beeb-4bd8-9b13-c499cf664c42 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:47.184851 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febb84fa-3996-42b2-841e-8ea1d0e946d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:47.185641 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb84fa-3996-42b2-841e-8ea1d0e946d4 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:47.185923 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb84fa-3996-42b2-841e-8ea1d0e946d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:47.186196 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb84fa-3996-42b2-841e-8ea1d0e946d4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:47.189099 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e4033c-beeb-4bd8-9b13-c499cf664c42 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:47.190520 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e4033c-beeb-4bd8-9b13-c499cf664c42 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:47.192644 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febb84fa-3996-42b2-841e-8ea1d0e946d4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:47.194065 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febb84fa-3996-42b2-841e-8ea1d0e946d4 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:47.204211 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-51e4033c-beeb-4bd8-9b13-c499cf664c42 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Apr 11 16:22:47.205379 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 288/579] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Apr 11 16:22:47 2022] GET /identity/v3/users/glance => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:47.206141 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e4033c-beeb-4bd8-9b13-c499cf664c42 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:47.207870 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-febb84fa-3996-42b2-841e-8ea1d0e946d4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 16:22:47.213484 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 292/580] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Apr 11 16:22:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:47.213484 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febb84fa-3996-42b2-841e-8ea1d0e946d4 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:47.302382 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febb84fa-3996-42b2-841e-8ea1d0e946d4 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:47.302709 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e4033c-beeb-4bd8-9b13-c499cf664c42 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:47.334310 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51025a3b-73f5-4760-b65d-cb3d00b42ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:47.335094 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51025a3b-73f5-4760-b65d-cb3d00b42ebe None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:47.335373 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51025a3b-73f5-4760-b65d-cb3d00b42ebe None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:47.335677 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51025a3b-73f5-4760-b65d-cb3d00b42ebe None admin] PATH_INFO: `/v3/roles/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:47.336113 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e66b0d-6a25-4889-87e0-c7d5ed306972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:47.336997 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e66b0d-6a25-4889-87e0-c7d5ed306972 None admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:47.337277 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e66b0d-6a25-4889-87e0-c7d5ed306972 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:47.337544 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e66b0d-6a25-4889-87e0-c7d5ed306972 None admin] PATH_INFO: `/v3/projects/477b9d41390e455a82e733c4fc6acd6b/users/1be2652c984a4283aeee0b937f0555e4/roles/de92d251e74f470e95b6df12ece586b8` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:47.346073 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51025a3b-73f5-4760-b65d-cb3d00b42ebe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:22:47.351827 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e66b0d-6a25-4889-87e0-c7d5ed306972 None admin] RBAC: Authorizing `identity:create_grant(project_id=477b9d41390e455a82e733c4fc6acd6b, user_id=1be2652c984a4283aeee0b937f0555e4, role_id=de92d251e74f470e95b6df12ece586b8)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:47.353088 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-51025a3b-73f5-4760-b65d-cb3d00b42ebe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 16:22:47.353264 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e66b0d-6a25-4889-87e0-c7d5ed306972 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:47.354254 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 289/581] 10.222.0.43 () {56 vars in 1102 bytes} [Mon Apr 11 16:22:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:47.355005 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51025a3b-73f5-4760-b65d-cb3d00b42ebe None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:47.443384 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 293/582] 10.222.0.43 () {58 vars in 1439 bytes} [Mon Apr 11 16:22:47 2022] PUT /identity/v3/projects/477b9d41390e455a82e733c4fc6acd6b/users/1be2652c984a4283aeee0b937f0555e4/roles/de92d251e74f470e95b6df12ece586b8 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:22:47.444298 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e66b0d-6a25-4889-87e0-c7d5ed306972 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:47.447378 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51025a3b-73f5-4760-b65d-cb3d00b42ebe None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:47.492110 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477edd3e-9250-4535-aac7-05a2c61c5691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:47.492928 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477edd3e-9250-4535-aac7-05a2c61c5691 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:47.493215 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477edd3e-9250-4535-aac7-05a2c61c5691 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:47.493489 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477edd3e-9250-4535-aac7-05a2c61c5691 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:47.504907 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477edd3e-9250-4535-aac7-05a2c61c5691 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:47.506382 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477edd3e-9250-4535-aac7-05a2c61c5691 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:47.521278 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-477edd3e-9250-4535-aac7-05a2c61c5691 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 11 16:22:47.522791 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 290/583] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Apr 11 16:22:47 2022] GET /identity/v3/users/cinder => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:47.523766 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477edd3e-9250-4535-aac7-05a2c61c5691 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:47.608395 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e66b0d-6a25-4889-87e0-c7d5ed306972 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:47.645586 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5c3b4f-e0d9-4b06-b405-7ace94b3d3da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:47.646507 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c3b4f-e0d9-4b06-b405-7ace94b3d3da None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:47.646846 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c3b4f-e0d9-4b06-b405-7ace94b3d3da None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:47.647125 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c3b4f-e0d9-4b06-b405-7ace94b3d3da None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:47.648027 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5c3b4f-e0d9-4b06-b405-7ace94b3d3da None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:47.648338 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5c3b4f-e0d9-4b06-b405-7ace94b3d3da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:47.649786 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5c3b4f-e0d9-4b06-b405-7ace94b3d3da None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:47.667393 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 294/584] 10.222.0.43 () {56 vars in 1137 bytes} [Mon Apr 11 16:22:47 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:47.668250 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5c3b4f-e0d9-4b06-b405-7ace94b3d3da None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:47.688960 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477edd3e-9250-4535-aac7-05a2c61c5691 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:47.722189 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed705f1-8ff2-4aba-a60e-7167304c7b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:47.723082 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed705f1-8ff2-4aba-a60e-7167304c7b43 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:47.723536 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed705f1-8ff2-4aba-a60e-7167304c7b43 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:47.723949 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed705f1-8ff2-4aba-a60e-7167304c7b43 None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:47.724907 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed705f1-8ff2-4aba-a60e-7167304c7b43 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:47.725357 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed705f1-8ff2-4aba-a60e-7167304c7b43 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:47.726902 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed705f1-8ff2-4aba-a60e-7167304c7b43 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:47.739849 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 291/585] 10.222.0.43 () {56 vars in 1148 bytes} [Mon Apr 11 16:22:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:47.740910 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed705f1-8ff2-4aba-a60e-7167304c7b43 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:47.768129 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5c3b4f-e0d9-4b06-b405-7ace94b3d3da None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:47.802003 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4eeafc-59ae-4fb4-ac2c-130dc385ffe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:47.802678 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4eeafc-59ae-4fb4-ac2c-130dc385ffe5 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:47.802965 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4eeafc-59ae-4fb4-ac2c-130dc385ffe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:47.803263 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4eeafc-59ae-4fb4-ac2c-130dc385ffe5 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:47.804037 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4eeafc-59ae-4fb4-ac2c-130dc385ffe5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:47.804347 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4eeafc-59ae-4fb4-ac2c-130dc385ffe5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:47.805713 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4eeafc-59ae-4fb4-ac2c-130dc385ffe5 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:47.814340 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 295/586] 10.222.0.43 () {56 vars in 1103 bytes} [Mon Apr 11 16:22:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:47.815140 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4eeafc-59ae-4fb4-ac2c-130dc385ffe5 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:47.857826 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed705f1-8ff2-4aba-a60e-7167304c7b43 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:47.893013 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15959e9b-f7e0-4e0a-b68e-6ee1a5322c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:47.893617 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15959e9b-f7e0-4e0a-b68e-6ee1a5322c3a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:47.893905 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15959e9b-f7e0-4e0a-b68e-6ee1a5322c3a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:47.894190 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15959e9b-f7e0-4e0a-b68e-6ee1a5322c3a None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:47.895054 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15959e9b-f7e0-4e0a-b68e-6ee1a5322c3a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:47.895368 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15959e9b-f7e0-4e0a-b68e-6ee1a5322c3a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:47.896839 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15959e9b-f7e0-4e0a-b68e-6ee1a5322c3a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:47.911256 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4eeafc-59ae-4fb4-ac2c-130dc385ffe5 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:47.913598 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 292/587] 10.222.0.43 () {56 vars in 1137 bytes} [Mon Apr 11 16:22:47 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:47.914413 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15959e9b-f7e0-4e0a-b68e-6ee1a5322c3a None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:47.949842 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d7c863-f970-4b46-b369-d5ce19e2c0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:47.950933 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7c863-f970-4b46-b369-d5ce19e2c0a7 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:47.951387 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7c863-f970-4b46-b369-d5ce19e2c0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:47.951845 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7c863-f970-4b46-b369-d5ce19e2c0a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:47.962133 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d7c863-f970-4b46-b369-d5ce19e2c0a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:47.963607 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d7c863-f970-4b46-b369-d5ce19e2c0a7 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:47.980291 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-73d7c863-f970-4b46-b369-d5ce19e2c0a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:22:47.986740 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 296/588] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:22:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:47.986740 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d7c863-f970-4b46-b369-d5ce19e2c0a7 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:48.015730 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15959e9b-f7e0-4e0a-b68e-6ee1a5322c3a None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:48.048853 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6446a165-6c5d-4863-9bb5-9024d0cc510b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:48.049514 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446a165-6c5d-4863-9bb5-9024d0cc510b None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:48.049799 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446a165-6c5d-4863-9bb5-9024d0cc510b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:48.050075 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446a165-6c5d-4863-9bb5-9024d0cc510b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:48.050903 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6446a165-6c5d-4863-9bb5-9024d0cc510b None admin] RBAC: Adding query filter params (role.id=de92d251e74f470e95b6df12ece586b8, scope.project.id=477b9d41390e455a82e733c4fc6acd6b, user.id=bb193a1a7abd430fbbcccab970e4f37c) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:48.051217 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6446a165-6c5d-4863-9bb5-9024d0cc510b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:48.052667 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6446a165-6c5d-4863-9bb5-9024d0cc510b None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:48.057895 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 293/589] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Apr 11 16:22:47 2022] GET /identity/v3/role_assignments?user.id=bb193a1a7abd430fbbcccab970e4f37c&scope.project.id=477b9d41390e455a82e733c4fc6acd6b&role.id=de92d251e74f470e95b6df12ece586b8 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:48.059405 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6446a165-6c5d-4863-9bb5-9024d0cc510b None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:48.088826 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d7c863-f970-4b46-b369-d5ce19e2c0a7 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:48.134116 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdff59e-59e9-44de-8a03-157a4dfcfeae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:48.134991 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdff59e-59e9-44de-8a03-157a4dfcfeae None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:48.135280 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdff59e-59e9-44de-8a03-157a4dfcfeae None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:48.135597 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdff59e-59e9-44de-8a03-157a4dfcfeae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:48.150324 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdff59e-59e9-44de-8a03-157a4dfcfeae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:48.151782 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdff59e-59e9-44de-8a03-157a4dfcfeae None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:48.172865 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6446a165-6c5d-4863-9bb5-9024d0cc510b None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:48.178612 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-1fdff59e-59e9-44de-8a03-157a4dfcfeae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:22:48.184933 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 297/590] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:22:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:48.184933 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdff59e-59e9-44de-8a03-157a4dfcfeae None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:48.218021 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4a6a17-96cd-419f-86b8-6804a5ee570e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:48.219195 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a6a17-96cd-419f-86b8-6804a5ee570e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:48.219730 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a6a17-96cd-419f-86b8-6804a5ee570e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:48.220229 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a6a17-96cd-419f-86b8-6804a5ee570e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:48.232083 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4a6a17-96cd-419f-86b8-6804a5ee570e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:48.233898 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4a6a17-96cd-419f-86b8-6804a5ee570e None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:48.252303 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-0a4a6a17-96cd-419f-86b8-6804a5ee570e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:22:48.258326 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 294/591] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:22:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:48.259564 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4a6a17-96cd-419f-86b8-6804a5ee570e None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:48.289264 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdff59e-59e9-44de-8a03-157a4dfcfeae None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:48.323253 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3df1af-3c08-4e31-ae48-fddc29d506fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:48.323969 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3df1af-3c08-4e31-ae48-fddc29d506fd None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:48.324249 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3df1af-3c08-4e31-ae48-fddc29d506fd None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:48.324521 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3df1af-3c08-4e31-ae48-fddc29d506fd None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:48.325330 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3df1af-3c08-4e31-ae48-fddc29d506fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:48.325635 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3df1af-3c08-4e31-ae48-fddc29d506fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:48.327064 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3df1af-3c08-4e31-ae48-fddc29d506fd None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:48.339955 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 298/592] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Apr 11 16:22:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:48.341418 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3df1af-3c08-4e31-ae48-fddc29d506fd None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:48.361797 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4a6a17-96cd-419f-86b8-6804a5ee570e None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:48.395315 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462e1562-2302-4c2f-8d36-590ff64a6ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:48.396025 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e1562-2302-4c2f-8d36-590ff64a6ca4 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:48.396308 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e1562-2302-4c2f-8d36-590ff64a6ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:48.396590 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e1562-2302-4c2f-8d36-590ff64a6ca4 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:48.397319 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462e1562-2302-4c2f-8d36-590ff64a6ca4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:48.397629 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462e1562-2302-4c2f-8d36-590ff64a6ca4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:48.398990 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462e1562-2302-4c2f-8d36-590ff64a6ca4 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:48.415713 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 295/593] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Apr 11 16:22:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:48.416523 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462e1562-2302-4c2f-8d36-590ff64a6ca4 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:48.443450 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3df1af-3c08-4e31-ae48-fddc29d506fd None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:48.483538 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4ddfba-c422-4615-bed8-845e1213d34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:48.483538 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ddfba-c422-4615-bed8-845e1213d34f None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:48.483538 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ddfba-c422-4615-bed8-845e1213d34f None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:48.483538 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ddfba-c422-4615-bed8-845e1213d34f None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:48.483917 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4ddfba-c422-4615-bed8-845e1213d34f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:48.483917 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4ddfba-c422-4615-bed8-845e1213d34f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:48.484056 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4ddfba-c422-4615-bed8-845e1213d34f None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:48.496369 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 299/594] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Apr 11 16:22:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:48.497455 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4ddfba-c422-4615-bed8-845e1213d34f None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:48.534738 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462e1562-2302-4c2f-8d36-590ff64a6ca4 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:48.569428 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f9bc18-8940-43f0-bd8a-cd2bed7daf0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:48.570257 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9bc18-8940-43f0-bd8a-cd2bed7daf0c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:48.570541 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9bc18-8940-43f0-bd8a-cd2bed7daf0c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:48.570816 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9bc18-8940-43f0-bd8a-cd2bed7daf0c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:48.578235 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f9bc18-8940-43f0-bd8a-cd2bed7daf0c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:48.579728 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f9bc18-8940-43f0-bd8a-cd2bed7daf0c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:48.593508 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-02f9bc18-8940-43f0-bd8a-cd2bed7daf0c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 16:22:48.595170 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 296/595] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Apr 11 16:22:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:48.596133 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f9bc18-8940-43f0-bd8a-cd2bed7daf0c None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:48.607649 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4ddfba-c422-4615-bed8-845e1213d34f None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:48.643237 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cb3a09-128e-481a-b497-808ad3f070f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:48.644080 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb3a09-128e-481a-b497-808ad3f070f9 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:48.644358 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb3a09-128e-481a-b497-808ad3f070f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:48.644626 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb3a09-128e-481a-b497-808ad3f070f9 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:48.652609 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cb3a09-128e-481a-b497-808ad3f070f9 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:48.654674 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cb3a09-128e-481a-b497-808ad3f070f9 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:48.668311 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-13cb3a09-128e-481a-b497-808ad3f070f9 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Apr 11 16:22:48.669854 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 300/596] 10.222.0.43 () {56 vars in 1102 bytes} [Mon Apr 11 16:22:48 2022] GET /identity/v3/users/neutron => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:48.670637 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cb3a09-128e-481a-b497-808ad3f070f9 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:48.703541 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f9bc18-8940-43f0-bd8a-cd2bed7daf0c None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:48.736677 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c2da3b-5df9-40ed-bf4a-934f50cda0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:48.737476 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c2da3b-5df9-40ed-bf4a-934f50cda0dd None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:48.737759 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c2da3b-5df9-40ed-bf4a-934f50cda0dd None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:48.738034 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c2da3b-5df9-40ed-bf4a-934f50cda0dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:48.745087 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c2da3b-5df9-40ed-bf4a-934f50cda0dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:48.746570 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c2da3b-5df9-40ed-bf4a-934f50cda0dd None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:48.760323 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-29c2da3b-5df9-40ed-bf4a-934f50cda0dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 16:22:48.761927 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 297/597] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Apr 11 16:22:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:48.763350 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c2da3b-5df9-40ed-bf4a-934f50cda0dd None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:48.771767 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cb3a09-128e-481a-b497-808ad3f070f9 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:48.805932 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e0e9e2-e321-4ace-8fc6-e00ad762a3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:48.806648 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0e9e2-e321-4ace-8fc6-e00ad762a3a5 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:48.806929 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0e9e2-e321-4ace-8fc6-e00ad762a3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:48.807248 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0e9e2-e321-4ace-8fc6-e00ad762a3a5 None admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:48.808063 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e0e9e2-e321-4ace-8fc6-e00ad762a3a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:48.808369 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e0e9e2-e321-4ace-8fc6-e00ad762a3a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:48.810021 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e0e9e2-e321-4ace-8fc6-e00ad762a3a5 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:48.822405 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 301/598] 10.222.0.43 () {56 vars in 1148 bytes} [Mon Apr 11 16:22:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:48.823223 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e0e9e2-e321-4ace-8fc6-e00ad762a3a5 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:48.862645 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c2da3b-5df9-40ed-bf4a-934f50cda0dd None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:48.896996 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60b0b21-b2bd-4086-bd8c-87733e711b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:48.898005 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b0b21-b2bd-4086-bd8c-87733e711b00 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:48.898005 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b0b21-b2bd-4086-bd8c-87733e711b00 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:48.898327 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b0b21-b2bd-4086-bd8c-87733e711b00 None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:48.899045 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60b0b21-b2bd-4086-bd8c-87733e711b00 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:48.899360 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60b0b21-b2bd-4086-bd8c-87733e711b00 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:48.901818 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60b0b21-b2bd-4086-bd8c-87733e711b00 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:48.919798 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 298/599] 10.222.0.43 () {56 vars in 1139 bytes} [Mon Apr 11 16:22:48 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:48.924844 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60b0b21-b2bd-4086-bd8c-87733e711b00 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:48.938649 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e0e9e2-e321-4ace-8fc6-e00ad762a3a5 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:48.974107 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6540933-b314-4c8a-8488-7a847f1a4b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:48.974778 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6540933-b314-4c8a-8488-7a847f1a4b96 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:48.975062 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6540933-b314-4c8a-8488-7a847f1a4b96 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:48.975338 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6540933-b314-4c8a-8488-7a847f1a4b96 None admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:48.976281 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6540933-b314-4c8a-8488-7a847f1a4b96 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:48.976600 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6540933-b314-4c8a-8488-7a847f1a4b96 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:48.978029 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6540933-b314-4c8a-8488-7a847f1a4b96 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:48.990757 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 302/600] 10.222.0.43 () {56 vars in 1148 bytes} [Mon Apr 11 16:22:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:48.991757 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6540933-b314-4c8a-8488-7a847f1a4b96 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:49.026615 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60b0b21-b2bd-4086-bd8c-87733e711b00 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:49.060507 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dfc9b0-bb35-4adf-8b5b-574dd7eb2405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:49.061428 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dfc9b0-bb35-4adf-8b5b-574dd7eb2405 None admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:49.061708 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dfc9b0-bb35-4adf-8b5b-574dd7eb2405 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:49.061982 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dfc9b0-bb35-4adf-8b5b-574dd7eb2405 None admin] PATH_INFO: `/v3/projects/477b9d41390e455a82e733c4fc6acd6b/users/a0f7cf98d5394b28a475fd67e30fc9c6/roles/de92d251e74f470e95b6df12ece586b8` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:49.077454 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dfc9b0-bb35-4adf-8b5b-574dd7eb2405 None admin] RBAC: Authorizing `identity:create_grant(project_id=477b9d41390e455a82e733c4fc6acd6b, user_id=a0f7cf98d5394b28a475fd67e30fc9c6, role_id=de92d251e74f470e95b6df12ece586b8)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:49.078888 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dfc9b0-bb35-4adf-8b5b-574dd7eb2405 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:49.096563 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6540933-b314-4c8a-8488-7a847f1a4b96 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:49.130813 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a83d930-3a77-4eaa-b1b2-24e4565bf172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:49.131879 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83d930-3a77-4eaa-b1b2-24e4565bf172 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:49.132213 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83d930-3a77-4eaa-b1b2-24e4565bf172 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:49.132495 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83d930-3a77-4eaa-b1b2-24e4565bf172 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:49.143922 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a83d930-3a77-4eaa-b1b2-24e4565bf172 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:49.145435 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a83d930-3a77-4eaa-b1b2-24e4565bf172 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:49.164891 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-2a83d930-3a77-4eaa-b1b2-24e4565bf172 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:22:49.164891 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 303/602] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:22:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:49.165334 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 299/602] 10.222.0.43 () {58 vars in 1439 bytes} [Mon Apr 11 16:22:48 2022] PUT /identity/v3/projects/477b9d41390e455a82e733c4fc6acd6b/users/a0f7cf98d5394b28a475fd67e30fc9c6/roles/de92d251e74f470e95b6df12ece586b8 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:22:49.167772 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a83d930-3a77-4eaa-b1b2-24e4565bf172 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:49.191670 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dfc9b0-bb35-4adf-8b5b-574dd7eb2405 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:49.365941 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dfc9b0-bb35-4adf-8b5b-574dd7eb2405 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:49.370645 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a83d930-3a77-4eaa-b1b2-24e4565bf172 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:49.414092 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd0a458-3938-4df7-866b-367165841c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:49.415135 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd0a458-3938-4df7-866b-367165841c58 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:49.415725 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd0a458-3938-4df7-866b-367165841c58 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:49.416198 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd0a458-3938-4df7-866b-367165841c58 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:49.417185 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd0a458-3938-4df7-866b-367165841c58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:49.417693 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd0a458-3938-4df7-866b-367165841c58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:49.419440 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd0a458-3938-4df7-866b-367165841c58 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:49.435637 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 300/603] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Apr 11 16:22:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:49.438405 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd0a458-3938-4df7-866b-367165841c58 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:49.441041 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31265eac-eeff-40ce-9e99-f1b089a6f4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:49.444053 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31265eac-eeff-40ce-9e99-f1b089a6f4cd None admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:49.444542 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31265eac-eeff-40ce-9e99-f1b089a6f4cd None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:49.445032 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31265eac-eeff-40ce-9e99-f1b089a6f4cd None admin] PATH_INFO: `/v3/projects/477b9d41390e455a82e733c4fc6acd6b/users/950b5b5f690d41509ead753065a0b793/roles/de92d251e74f470e95b6df12ece586b8` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:49.468994 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31265eac-eeff-40ce-9e99-f1b089a6f4cd None admin] RBAC: Authorizing `identity:create_grant(project_id=477b9d41390e455a82e733c4fc6acd6b, user_id=950b5b5f690d41509ead753065a0b793, role_id=de92d251e74f470e95b6df12ece586b8)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:49.470983 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31265eac-eeff-40ce-9e99-f1b089a6f4cd None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:49.557404 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd0a458-3938-4df7-866b-367165841c58 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:49.574563 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 304/604] 10.222.0.43 () {58 vars in 1439 bytes} [Mon Apr 11 16:22:49 2022] PUT /identity/v3/projects/477b9d41390e455a82e733c4fc6acd6b/users/950b5b5f690d41509ead753065a0b793/roles/de92d251e74f470e95b6df12ece586b8 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:22:49.599329 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e39bdb6-c231-4bd5-9a49-3a90bae46985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:49.600554 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39bdb6-c231-4bd5-9a49-3a90bae46985 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:49.601038 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39bdb6-c231-4bd5-9a49-3a90bae46985 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:49.601505 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39bdb6-c231-4bd5-9a49-3a90bae46985 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:49.631834 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e39bdb6-c231-4bd5-9a49-3a90bae46985 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:49.633332 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e39bdb6-c231-4bd5-9a49-3a90bae46985 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:49.652075 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-6e39bdb6-c231-4bd5-9a49-3a90bae46985 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 16:22:49.654392 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 301/605] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Apr 11 16:22:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:22:49.660529 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31265eac-eeff-40ce-9e99-f1b089a6f4cd None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:49.821039 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31265eac-eeff-40ce-9e99-f1b089a6f4cd None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:49.865256 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d17fda-df10-4802-9a41-dfc39c4a0104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:49.865949 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d17fda-df10-4802-9a41-dfc39c4a0104 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:49.866233 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d17fda-df10-4802-9a41-dfc39c4a0104 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:49.866507 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d17fda-df10-4802-9a41-dfc39c4a0104 None admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:49.867300 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d17fda-df10-4802-9a41-dfc39c4a0104 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:49.867633 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d17fda-df10-4802-9a41-dfc39c4a0104 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:49.869062 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d17fda-df10-4802-9a41-dfc39c4a0104 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:49.886642 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 305/606] 10.222.0.43 () {56 vars in 1148 bytes} [Mon Apr 11 16:22:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:49.893234 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e39bdb6-c231-4bd5-9a49-3a90bae46985 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:49.914641 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e42197-4ca7-4278-a1bf-0cf13e7ab4f3 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:49.914942 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e42197-4ca7-4278-a1bf-0cf13e7ab4f3 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:49.915204 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e42197-4ca7-4278-a1bf-0cf13e7ab4f3 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:49.916869 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 306/607] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:22:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:22:49.922211 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdadc53-65cc-415b-b3f1-f4cbd03b5a1c None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:49.922497 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdadc53-65cc-415b-b3f1-f4cbd03b5a1c None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:49.922781 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdadc53-65cc-415b-b3f1-f4cbd03b5a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:49.942950 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-5cdadc53-65cc-415b-b3f1-f4cbd03b5a1c None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:22:49.944265 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-5cdadc53-65cc-415b-b3f1-f4cbd03b5a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:22:50.027507 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e39bdb6-c231-4bd5-9a49-3a90bae46985 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:50.065350 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 307/608] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:22:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 16:22:50.067277 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2874928-860f-42b8-aa86-b7dd6ef9617f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:50.068204 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2874928-860f-42b8-aa86-b7dd6ef9617f None admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:50.068485 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2874928-860f-42b8-aa86-b7dd6ef9617f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:50.068761 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2874928-860f-42b8-aa86-b7dd6ef9617f None admin] PATH_INFO: `/v3/projects/477b9d41390e455a82e733c4fc6acd6b/users/f8c213711e794a1ba47ecf46ecb57769/roles/de92d251e74f470e95b6df12ece586b8` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:50.084624 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2874928-860f-42b8-aa86-b7dd6ef9617f None admin] RBAC: Authorizing `identity:create_grant(project_id=477b9d41390e455a82e733c4fc6acd6b, user_id=f8c213711e794a1ba47ecf46ecb57769, role_id=de92d251e74f470e95b6df12ece586b8)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:50.086001 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2874928-860f-42b8-aa86-b7dd6ef9617f None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:50.100977 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdadc53-65cc-415b-b3f1-f4cbd03b5a1c None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:50.176658 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 302/609] 10.222.0.43 () {58 vars in 1439 bytes} [Mon Apr 11 16:22:49 2022] PUT /identity/v3/projects/477b9d41390e455a82e733c4fc6acd6b/users/f8c213711e794a1ba47ecf46ecb57769/roles/de92d251e74f470e95b6df12ece586b8 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:22:50.218539 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdadc53-65cc-415b-b3f1-f4cbd03b5a1c None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:50.260166 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71192faf-a566-433f-91c9-6a3e57e308fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:50.261000 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71192faf-a566-433f-91c9-6a3e57e308fa None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:50.261284 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71192faf-a566-433f-91c9-6a3e57e308fa None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:50.261563 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71192faf-a566-433f-91c9-6a3e57e308fa None admin] PATH_INFO: `/v3/roles/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:50.281170 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71192faf-a566-433f-91c9-6a3e57e308fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:22:50.289476 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-71192faf-a566-433f-91c9-6a3e57e308fa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 16:22:50.290121 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 308/610] 10.222.0.43 () {56 vars in 1102 bytes} [Mon Apr 11 16:22:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:22:50.296421 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2874928-860f-42b8-aa86-b7dd6ef9617f None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:50.453842 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2874928-860f-42b8-aa86-b7dd6ef9617f None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:50.507541 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52161d1e-ba01-488b-945a-3635545c2d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:50.507541 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52161d1e-ba01-488b-945a-3635545c2d8c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:50.507541 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52161d1e-ba01-488b-945a-3635545c2d8c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:50.507541 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52161d1e-ba01-488b-945a-3635545c2d8c None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:50.507936 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52161d1e-ba01-488b-945a-3635545c2d8c None admin] RBAC: Adding query filter params (name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:50.507936 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52161d1e-ba01-488b-945a-3635545c2d8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:50.509308 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52161d1e-ba01-488b-945a-3635545c2d8c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:50.523139 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 303/611] 10.222.0.43 () {56 vars in 1103 bytes} [Mon Apr 11 16:22:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:50.528732 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71192faf-a566-433f-91c9-6a3e57e308fa None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:50.547774 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464462de-b4ab-44d2-9a1e-532c4c5a6255 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:50.548311 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464462de-b4ab-44d2-9a1e-532c4c5a6255 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:50.548724 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464462de-b4ab-44d2-9a1e-532c4c5a6255 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:50.551256 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 304/612] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:22:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:22:50.556301 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97229406-7713-4623-8d88-a490be191f15 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:50.556593 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97229406-7713-4623-8d88-a490be191f15 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:50.556878 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97229406-7713-4623-8d88-a490be191f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:50.574465 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-97229406-7713-4623-8d88-a490be191f15 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:22:50.576143 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-97229406-7713-4623-8d88-a490be191f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:22:50.665325 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71192faf-a566-433f-91c9-6a3e57e308fa None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:50.676099 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 305/613] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:22:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 16:22:50.700757 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97229406-7713-4623-8d88-a490be191f15 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:50.713170 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a70044f-2f97-4283-8aba-7795cc50b211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:50.713901 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70044f-2f97-4283-8aba-7795cc50b211 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:50.714182 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70044f-2f97-4283-8aba-7795cc50b211 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:50.714470 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70044f-2f97-4283-8aba-7795cc50b211 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:50.738111 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a70044f-2f97-4283-8aba-7795cc50b211 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:50.740583 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a70044f-2f97-4283-8aba-7795cc50b211 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:50.776741 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-2a70044f-2f97-4283-8aba-7795cc50b211 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:22:50.785130 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 309/614] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:22:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:50.786041 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a70044f-2f97-4283-8aba-7795cc50b211 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:50.836472 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97229406-7713-4623-8d88-a490be191f15 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:50.871056 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152b2966-9977-4367-adaa-46548a57415a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:50.872529 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b2966-9977-4367-adaa-46548a57415a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:50.872813 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b2966-9977-4367-adaa-46548a57415a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:50.873084 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b2966-9977-4367-adaa-46548a57415a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:50.883248 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152b2966-9977-4367-adaa-46548a57415a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:22:50.890582 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-152b2966-9977-4367-adaa-46548a57415a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 16:22:50.892134 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 306/615] 10.222.0.43 () {56 vars in 1102 bytes} [Mon Apr 11 16:22:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:22:50.902808 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152b2966-9977-4367-adaa-46548a57415a None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:50.982623 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a70044f-2f97-4283-8aba-7795cc50b211 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:51.044863 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaebe06-80e9-4fc3-94c0-3de175ee8a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:51.045547 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaebe06-80e9-4fc3-94c0-3de175ee8a72 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:51.045994 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaebe06-80e9-4fc3-94c0-3de175ee8a72 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:51.046283 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaebe06-80e9-4fc3-94c0-3de175ee8a72 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:51.047015 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaebe06-80e9-4fc3-94c0-3de175ee8a72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:51.047329 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaebe06-80e9-4fc3-94c0-3de175ee8a72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:51.048730 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaebe06-80e9-4fc3-94c0-3de175ee8a72 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:51.051490 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152b2966-9977-4367-adaa-46548a57415a None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:51.077192 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 310/616] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Apr 11 16:22:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:51.085969 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaebe06-80e9-4fc3-94c0-3de175ee8a72 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:51.091400 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371e136b-848e-4a11-aa8d-2ac1df662714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:51.092442 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e136b-848e-4a11-aa8d-2ac1df662714 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:51.092922 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e136b-848e-4a11-aa8d-2ac1df662714 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:51.093389 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e136b-848e-4a11-aa8d-2ac1df662714 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:51.095116 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371e136b-848e-4a11-aa8d-2ac1df662714 None admin] RBAC: Adding query filter params (name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:51.099839 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371e136b-848e-4a11-aa8d-2ac1df662714 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:51.101441 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371e136b-848e-4a11-aa8d-2ac1df662714 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:51.119943 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 307/617] 10.222.0.43 () {56 vars in 1103 bytes} [Mon Apr 11 16:22:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:22:51.130650 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371e136b-848e-4a11-aa8d-2ac1df662714 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:51.230089 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371e136b-848e-4a11-aa8d-2ac1df662714 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:51.266428 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e68dc0-0c43-443d-865d-c84378b7fae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:51.267595 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e68dc0-0c43-443d-865d-c84378b7fae5 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:51.268080 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e68dc0-0c43-443d-865d-c84378b7fae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:51.268557 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e68dc0-0c43-443d-865d-c84378b7fae5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:51.280224 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e68dc0-0c43-443d-865d-c84378b7fae5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:51.281974 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e68dc0-0c43-443d-865d-c84378b7fae5 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:51.302102 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-e8e68dc0-0c43-443d-865d-c84378b7fae5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:22:51.305611 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaebe06-80e9-4fc3-94c0-3de175ee8a72 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:51.308471 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 308/618] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:22:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:22:51.315991 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e68dc0-0c43-443d-865d-c84378b7fae5 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:51.368889 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994e39b9-89b7-475a-bebc-967bc99f155b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:51.369893 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994e39b9-89b7-475a-bebc-967bc99f155b None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:51.370175 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994e39b9-89b7-475a-bebc-967bc99f155b None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:51.370448 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994e39b9-89b7-475a-bebc-967bc99f155b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:51.382542 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994e39b9-89b7-475a-bebc-967bc99f155b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:51.384060 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994e39b9-89b7-475a-bebc-967bc99f155b None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:51.401321 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-994e39b9-89b7-475a-bebc-967bc99f155b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 11 16:22:51.407628 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 311/619] 10.222.0.43 () {56 vars in 1093 bytes} [Mon Apr 11 16:22:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:22:51.408736 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994e39b9-89b7-475a-bebc-967bc99f155b None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:51.423189 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e68dc0-0c43-443d-865d-c84378b7fae5 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:51.456746 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83754791-7988-4928-b02c-ac687656d974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:51.457791 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83754791-7988-4928-b02c-ac687656d974 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:51.458274 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83754791-7988-4928-b02c-ac687656d974 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:51.458745 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83754791-7988-4928-b02c-ac687656d974 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:51.459694 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83754791-7988-4928-b02c-ac687656d974 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:51.460223 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83754791-7988-4928-b02c-ac687656d974 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:51.461766 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83754791-7988-4928-b02c-ac687656d974 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:51.474664 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 309/620] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Apr 11 16:22:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:51.485146 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83754791-7988-4928-b02c-ac687656d974 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:51.525969 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994e39b9-89b7-475a-bebc-967bc99f155b None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:51.569087 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b71141-10af-4807-8a25-2a4785bc9d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:51.569711 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b71141-10af-4807-8a25-2a4785bc9d6e None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:51.569711 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b71141-10af-4807-8a25-2a4785bc9d6e None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:51.570017 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b71141-10af-4807-8a25-2a4785bc9d6e None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:51.570790 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b71141-10af-4807-8a25-2a4785bc9d6e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:51.571098 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b71141-10af-4807-8a25-2a4785bc9d6e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:51.572565 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b71141-10af-4807-8a25-2a4785bc9d6e None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:51.607288 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 312/621] 10.222.0.43 () {56 vars in 1133 bytes} [Mon Apr 11 16:22:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:51.612487 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b71141-10af-4807-8a25-2a4785bc9d6e None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:51.618608 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83754791-7988-4928-b02c-ac687656d974 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:51.654705 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89a5b21-882a-4321-a468-485d3e9ae67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:51.655888 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a5b21-882a-4321-a468-485d3e9ae67a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:51.656371 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a5b21-882a-4321-a468-485d3e9ae67a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:51.656923 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a5b21-882a-4321-a468-485d3e9ae67a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:51.664664 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89a5b21-882a-4321-a468-485d3e9ae67a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:51.666357 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89a5b21-882a-4321-a468-485d3e9ae67a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:51.680702 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-c89a5b21-882a-4321-a468-485d3e9ae67a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 11 16:22:51.682518 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 310/622] 10.222.0.43 () {56 vars in 1096 bytes} [Mon Apr 11 16:22:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:51.687807 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89a5b21-882a-4321-a468-485d3e9ae67a None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:51.793918 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89a5b21-882a-4321-a468-485d3e9ae67a None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:51.829723 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e84ff05-298a-49e1-be31-13053b0d65ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:51.830765 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e84ff05-298a-49e1-be31-13053b0d65ac None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:51.831249 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e84ff05-298a-49e1-be31-13053b0d65ac None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:51.831753 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e84ff05-298a-49e1-be31-13053b0d65ac None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:51.832858 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e84ff05-298a-49e1-be31-13053b0d65ac None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:51.833402 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e84ff05-298a-49e1-be31-13053b0d65ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:51.835162 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e84ff05-298a-49e1-be31-13053b0d65ac None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:51.854426 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b71141-10af-4807-8a25-2a4785bc9d6e None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:51.856904 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 311/623] 10.222.0.43 () {56 vars in 1135 bytes} [Mon Apr 11 16:22:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:51.864959 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e84ff05-298a-49e1-be31-13053b0d65ac None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:51.919057 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae2b7fc-1bb8-4238-a679-b4e287429f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:51.919746 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae2b7fc-1bb8-4238-a679-b4e287429f34 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:51.920035 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae2b7fc-1bb8-4238-a679-b4e287429f34 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:51.920316 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae2b7fc-1bb8-4238-a679-b4e287429f34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:52.032844 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e84ff05-298a-49e1-be31-13053b0d65ac None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:52.053379 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae2b7fc-1bb8-4238-a679-b4e287429f34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:52.054765 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae2b7fc-1bb8-4238-a679-b4e287429f34 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:52.103340 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc3757c-49fd-4e98-9b87-761ed014c7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:52.104186 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc3757c-49fd-4e98-9b87-761ed014c7a1 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:52.104473 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc3757c-49fd-4e98-9b87-761ed014c7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:52.104754 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc3757c-49fd-4e98-9b87-761ed014c7a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:52.127635 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc3757c-49fd-4e98-9b87-761ed014c7a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:52.129125 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc3757c-49fd-4e98-9b87-761ed014c7a1 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:52.161364 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-9cc3757c-49fd-4e98-9b87-761ed014c7a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:22:52.169734 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 312/624] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:22:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:52.173089 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc3757c-49fd-4e98-9b87-761ed014c7a1 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:52.231720 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 313/625] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Apr 11 16:22:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 619 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 16:22:52.233220 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21a254-d318-4db7-9ce4-d13e1e622e2d None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:52.233512 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21a254-d318-4db7-9ce4-d13e1e622e2d None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:52.233792 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21a254-d318-4db7-9ce4-d13e1e622e2d None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:52.235324 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 314/626] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:22:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:22:52.240414 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e21a254-d318-4db7-9ce4-d13e1e622e2d None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:52.293676 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc3757c-49fd-4e98-9b87-761ed014c7a1 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:52.335093 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3280fcd0-78bb-4db4-bce6-a0ced73db39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:52.336511 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280fcd0-78bb-4db4-bce6-a0ced73db39d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:52.336945 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280fcd0-78bb-4db4-bce6-a0ced73db39d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:52.337779 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280fcd0-78bb-4db4-bce6-a0ced73db39d None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:52.338664 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3280fcd0-78bb-4db4-bce6-a0ced73db39d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:52.339121 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3280fcd0-78bb-4db4-bce6-a0ced73db39d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:52.341379 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3280fcd0-78bb-4db4-bce6-a0ced73db39d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:52.362455 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 313/627] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Apr 11 16:22:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:52.362455 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d308a20d-edca-4e68-b944-c804f9227cb1 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:52.362455 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d308a20d-edca-4e68-b944-c804f9227cb1 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:52.362455 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d308a20d-edca-4e68-b944-c804f9227cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:52.374060 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e21a254-d318-4db7-9ce4-d13e1e622e2d None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:52.381847 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-d308a20d-edca-4e68-b944-c804f9227cb1 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:22:52.383342 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-d308a20d-edca-4e68-b944-c804f9227cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:22:52.417757 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffea3633-3cad-4114-be93-ce706743491a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:52.419933 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea3633-3cad-4114-be93-ce706743491a None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:52.420279 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea3633-3cad-4114-be93-ce706743491a None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:52.420559 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea3633-3cad-4114-be93-ce706743491a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:52.431096 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffea3633-3cad-4114-be93-ce706743491a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:52.432646 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffea3633-3cad-4114-be93-ce706743491a None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:52.451601 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-ffea3633-3cad-4114-be93-ce706743491a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:22:52.457463 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 315/628] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:22:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:52.458392 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffea3633-3cad-4114-be93-ce706743491a None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:52.461279 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 314/629] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:22:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:22:52.467546 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d308a20d-edca-4e68-b944-c804f9227cb1 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:52.581513 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d308a20d-edca-4e68-b944-c804f9227cb1 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:52.583036 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffea3633-3cad-4114-be93-ce706743491a None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:52.614704 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0127058-a358-4c33-89a3-77344d241d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:52.615376 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0127058-a358-4c33-89a3-77344d241d32 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:52.615695 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0127058-a358-4c33-89a3-77344d241d32 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:52.615973 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0127058-a358-4c33-89a3-77344d241d32 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:52.616699 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0127058-a358-4c33-89a3-77344d241d32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:52.617051 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0127058-a358-4c33-89a3-77344d241d32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:52.618368 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0127058-a358-4c33-89a3-77344d241d32 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:52.618521 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8fdf09-360e-4583-9309-b20c8fe0e494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:52.619558 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8fdf09-360e-4583-9309-b20c8fe0e494 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:52.619846 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8fdf09-360e-4583-9309-b20c8fe0e494 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:52.620123 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8fdf09-360e-4583-9309-b20c8fe0e494 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:52.627915 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8fdf09-360e-4583-9309-b20c8fe0e494 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:52.629368 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8fdf09-360e-4583-9309-b20c8fe0e494 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:52.634663 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 315/630] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Apr 11 16:22:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:52.634663 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee573ffd-d036-4321-957c-f4fe495703d3 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:52.634663 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee573ffd-d036-4321-957c-f4fe495703d3 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:52.634663 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee573ffd-d036-4321-957c-f4fe495703d3 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:52.634663 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 316/631] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:22:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:22:52.635013 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee573ffd-d036-4321-957c-f4fe495703d3 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:52.650135 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-8c8fdf09-360e-4583-9309-b20c8fe0e494 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 16:22:52.656972 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 316/632] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Apr 11 16:22:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:52.656972 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8fdf09-360e-4583-9309-b20c8fe0e494 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:52.746753 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee573ffd-d036-4321-957c-f4fe495703d3 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:52.761240 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8fdf09-360e-4583-9309-b20c8fe0e494 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:52.780441 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4614de9-4599-4979-a699-ebf7db92adac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:52.781248 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4614de9-4599-4979-a699-ebf7db92adac None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:52.781536 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4614de9-4599-4979-a699-ebf7db92adac None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:52.781817 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4614de9-4599-4979-a699-ebf7db92adac None admin] PATH_INFO: `/v3/roles/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:52.792392 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4614de9-4599-4979-a699-ebf7db92adac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:22:52.796311 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afc8474-0b45-4601-b3cb-0949274dd238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:52.797108 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc8474-0b45-4601-b3cb-0949274dd238 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:52.797387 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc8474-0b45-4601-b3cb-0949274dd238 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:52.797659 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc8474-0b45-4601-b3cb-0949274dd238 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:52.800763 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-b4614de9-4599-4979-a699-ebf7db92adac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 16:22:52.807037 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 317/633] 10.222.0.43 () {56 vars in 1102 bytes} [Mon Apr 11 16:22:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:52.807037 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c39c2f-3137-4908-82d7-50267f3b7d64 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:52.807037 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c39c2f-3137-4908-82d7-50267f3b7d64 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:52.807037 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c39c2f-3137-4908-82d7-50267f3b7d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:52.808768 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afc8474-0b45-4601-b3cb-0949274dd238 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:52.810264 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afc8474-0b45-4601-b3cb-0949274dd238 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:52.820532 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-f5c39c2f-3137-4908-82d7-50267f3b7d64 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:22:52.821724 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-f5c39c2f-3137-4908-82d7-50267f3b7d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:22:52.824036 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-0afc8474-0b45-4601-b3cb-0949274dd238 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 16:22:52.829996 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 317/634] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Apr 11 16:22:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:52.829996 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afc8474-0b45-4601-b3cb-0949274dd238 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:52.899619 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 318/635] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:22:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:22:52.899619 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c39c2f-3137-4908-82d7-50267f3b7d64 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:52.947744 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afc8474-0b45-4601-b3cb-0949274dd238 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:52.982041 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64330611-7ef9-44e5-9f5c-3a36c079214e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:52.982705 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64330611-7ef9-44e5-9f5c-3a36c079214e None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:52.982988 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64330611-7ef9-44e5-9f5c-3a36c079214e None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:52.983266 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64330611-7ef9-44e5-9f5c-3a36c079214e None admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:52.984082 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64330611-7ef9-44e5-9f5c-3a36c079214e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:52.984397 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64330611-7ef9-44e5-9f5c-3a36c079214e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:52.985814 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64330611-7ef9-44e5-9f5c-3a36c079214e None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:52.991764 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c39c2f-3137-4908-82d7-50267f3b7d64 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:53.002691 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 318/636] 10.222.0.43 () {56 vars in 1148 bytes} [Mon Apr 11 16:22:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:53.002691 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64330611-7ef9-44e5-9f5c-3a36c079214e None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:53.027941 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e0a5b6-56fe-44d0-a502-ae4bded11938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:53.028709 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e0a5b6-56fe-44d0-a502-ae4bded11938 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:53.029000 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e0a5b6-56fe-44d0-a502-ae4bded11938 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:53.029278 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e0a5b6-56fe-44d0-a502-ae4bded11938 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:53.030023 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e0a5b6-56fe-44d0-a502-ae4bded11938 None admin] RBAC: Adding query filter params (name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:53.030331 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e0a5b6-56fe-44d0-a502-ae4bded11938 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:53.031719 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e0a5b6-56fe-44d0-a502-ae4bded11938 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:53.039477 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 319/637] 10.222.0.43 () {56 vars in 1103 bytes} [Mon Apr 11 16:22:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:53.040277 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e0a5b6-56fe-44d0-a502-ae4bded11938 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:53.101694 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64330611-7ef9-44e5-9f5c-3a36c079214e None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:53.133778 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e0a5b6-56fe-44d0-a502-ae4bded11938 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:53.134270 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a6379b-554a-4be6-948b-c346e2b130d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:53.134937 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6379b-554a-4be6-948b-c346e2b130d6 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:53.135225 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6379b-554a-4be6-948b-c346e2b130d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:53.135509 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6379b-554a-4be6-948b-c346e2b130d6 None admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:53.136325 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a6379b-554a-4be6-948b-c346e2b130d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:53.137154 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a6379b-554a-4be6-948b-c346e2b130d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:53.139150 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a6379b-554a-4be6-948b-c346e2b130d6 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:53.150931 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 319/638] 10.222.0.43 () {56 vars in 1148 bytes} [Mon Apr 11 16:22:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:53.151674 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a6379b-554a-4be6-948b-c346e2b130d6 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:53.166774 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6481d4e-646a-44b6-9109-a23500fdc9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:53.167592 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6481d4e-646a-44b6-9109-a23500fdc9e2 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:53.167913 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6481d4e-646a-44b6-9109-a23500fdc9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:53.168377 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6481d4e-646a-44b6-9109-a23500fdc9e2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:53.178376 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6481d4e-646a-44b6-9109-a23500fdc9e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:22:53.193229 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-c6481d4e-646a-44b6-9109-a23500fdc9e2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 16:22:53.194428 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 320/639] 10.222.0.43 () {56 vars in 1102 bytes} [Mon Apr 11 16:22:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:53.195669 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15cb785-3faa-445b-8095-1fe51023f2ce None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:53.196041 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15cb785-3faa-445b-8095-1fe51023f2ce None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:53.196335 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15cb785-3faa-445b-8095-1fe51023f2ce None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:53.197638 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 321/640] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:22:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:22:53.198336 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15cb785-3faa-445b-8095-1fe51023f2ce None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:53.248656 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a6379b-554a-4be6-948b-c346e2b130d6 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:53.281094 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6518a7f-eab4-4066-9343-b9d95914063b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:53.281974 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6518a7f-eab4-4066-9343-b9d95914063b None admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:53.282253 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6518a7f-eab4-4066-9343-b9d95914063b None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:53.282524 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6518a7f-eab4-4066-9343-b9d95914063b None admin] PATH_INFO: `/v3/projects/477b9d41390e455a82e733c4fc6acd6b/users/bb193a1a7abd430fbbcccab970e4f37c/roles/de92d251e74f470e95b6df12ece586b8` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:53.294976 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15cb785-3faa-445b-8095-1fe51023f2ce None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:53.296422 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6518a7f-eab4-4066-9343-b9d95914063b None admin] RBAC: Authorizing `identity:create_grant(project_id=477b9d41390e455a82e733c4fc6acd6b, user_id=bb193a1a7abd430fbbcccab970e4f37c, role_id=de92d251e74f470e95b6df12ece586b8)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:53.297846 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6518a7f-eab4-4066-9343-b9d95914063b None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:53.327302 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a583914a-1269-4aac-be31-ef806e95ce86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:53.328116 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a583914a-1269-4aac-be31-ef806e95ce86 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:53.328400 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a583914a-1269-4aac-be31-ef806e95ce86 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:53.328674 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a583914a-1269-4aac-be31-ef806e95ce86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:53.338112 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a583914a-1269-4aac-be31-ef806e95ce86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:53.339539 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a583914a-1269-4aac-be31-ef806e95ce86 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:53.356520 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-a583914a-1269-4aac-be31-ef806e95ce86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:22:53.357518 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 322/641] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:22:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:53.358275 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a583914a-1269-4aac-be31-ef806e95ce86 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:53.381334 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 320/642] 10.222.0.43 () {58 vars in 1439 bytes} [Mon Apr 11 16:22:53 2022] PUT /identity/v3/projects/477b9d41390e455a82e733c4fc6acd6b/users/bb193a1a7abd430fbbcccab970e4f37c/roles/de92d251e74f470e95b6df12ece586b8 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:22:53.382149 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6518a7f-eab4-4066-9343-b9d95914063b None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:53.461816 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a583914a-1269-4aac-be31-ef806e95ce86 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:53.494116 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6518a7f-eab4-4066-9343-b9d95914063b None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:53.502180 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2275dc38-63be-4764-9424-4f911f3e299c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:53.502180 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2275dc38-63be-4764-9424-4f911f3e299c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:53.502180 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2275dc38-63be-4764-9424-4f911f3e299c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:53.502180 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2275dc38-63be-4764-9424-4f911f3e299c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:53.512730 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2275dc38-63be-4764-9424-4f911f3e299c None admin] RBAC: Adding query filter params (role.id=de92d251e74f470e95b6df12ece586b8, scope.project.id=477b9d41390e455a82e733c4fc6acd6b, user.id=1be2652c984a4283aeee0b937f0555e4) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:53.512730 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2275dc38-63be-4764-9424-4f911f3e299c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:53.512730 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2275dc38-63be-4764-9424-4f911f3e299c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:53.512730 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 323/643] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Apr 11 16:22:53 2022] GET /identity/v3/role_assignments?user.id=1be2652c984a4283aeee0b937f0555e4&scope.project.id=477b9d41390e455a82e733c4fc6acd6b&role.id=de92d251e74f470e95b6df12ece586b8 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:53.513434 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d04810-81e9-459f-bc12-1728af71261d None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:53.513785 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d04810-81e9-459f-bc12-1728af71261d None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:53.514127 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d04810-81e9-459f-bc12-1728af71261d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:53.533010 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-73d04810-81e9-459f-bc12-1728af71261d None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:22:53.534368 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-73d04810-81e9-459f-bc12-1728af71261d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:22:53.565670 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8086f1c4-3125-4255-87d5-fb757c4f8fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:53.566357 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086f1c4-3125-4255-87d5-fb757c4f8fb4 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:53.566635 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086f1c4-3125-4255-87d5-fb757c4f8fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:53.566907 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086f1c4-3125-4255-87d5-fb757c4f8fb4 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:53.567691 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8086f1c4-3125-4255-87d5-fb757c4f8fb4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:53.567998 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8086f1c4-3125-4255-87d5-fb757c4f8fb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:53.569555 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8086f1c4-3125-4255-87d5-fb757c4f8fb4 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:53.587334 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 321/644] 10.222.0.43 () {56 vars in 1103 bytes} [Mon Apr 11 16:22:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:53.587334 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8086f1c4-3125-4255-87d5-fb757c4f8fb4 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:53.643683 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 324/645] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:22:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:22:53.644736 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d04810-81e9-459f-bc12-1728af71261d None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:53.712832 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8086f1c4-3125-4255-87d5-fb757c4f8fb4 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:53.751674 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e3c156-28fe-40ad-a971-382d127b22db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:53.752695 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3c156-28fe-40ad-a971-382d127b22db None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:53.753200 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3c156-28fe-40ad-a971-382d127b22db None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:53.753682 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3c156-28fe-40ad-a971-382d127b22db None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:53.754601 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e3c156-28fe-40ad-a971-382d127b22db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:53.755103 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e3c156-28fe-40ad-a971-382d127b22db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:53.756715 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e3c156-28fe-40ad-a971-382d127b22db None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:53.770007 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 322/646] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Apr 11 16:22:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:53.771207 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e3c156-28fe-40ad-a971-382d127b22db None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:53.787475 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d04810-81e9-459f-bc12-1728af71261d None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:53.835684 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e966af-aa40-462e-a4c6-408295f2ede8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:53.836488 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e966af-aa40-462e-a4c6-408295f2ede8 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:53.836777 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e966af-aa40-462e-a4c6-408295f2ede8 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:53.837054 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e966af-aa40-462e-a4c6-408295f2ede8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:53.848656 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e966af-aa40-462e-a4c6-408295f2ede8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:53.850283 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e966af-aa40-462e-a4c6-408295f2ede8 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:53.873997 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-c5e966af-aa40-462e-a4c6-408295f2ede8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:22:53.875534 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 325/647] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:22:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:53.880468 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e966af-aa40-462e-a4c6-408295f2ede8 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:53.885105 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e3c156-28fe-40ad-a971-382d127b22db None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:53.929155 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16f4a4e-d969-491a-8f94-30cf588ec686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:53.930410 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f4a4e-d969-491a-8f94-30cf588ec686 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:53.930699 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f4a4e-d969-491a-8f94-30cf588ec686 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:53.930975 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f4a4e-d969-491a-8f94-30cf588ec686 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:53.944922 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16f4a4e-d969-491a-8f94-30cf588ec686 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:22:53.954487 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-f16f4a4e-d969-491a-8f94-30cf588ec686 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 16:22:53.956434 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 323/648] 10.222.0.43 () {56 vars in 1102 bytes} [Mon Apr 11 16:22:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:53.957645 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16f4a4e-d969-491a-8f94-30cf588ec686 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:53.981580 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e966af-aa40-462e-a4c6-408295f2ede8 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:54.016750 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf9389-4886-4efb-9f4a-970ebf06bcbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:54.017616 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf9389-4886-4efb-9f4a-970ebf06bcbd None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:54.017902 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf9389-4886-4efb-9f4a-970ebf06bcbd None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:54.018235 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf9389-4886-4efb-9f4a-970ebf06bcbd None admin] PATH_INFO: `/v3/users/glance` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:54.025579 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcf9389-4886-4efb-9f4a-970ebf06bcbd None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:54.027080 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcf9389-4886-4efb-9f4a-970ebf06bcbd None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:54.041940 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-cdcf9389-4886-4efb-9f4a-970ebf06bcbd None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Apr 11 16:22:54.048341 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 326/649] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Apr 11 16:22:53 2022] GET /identity/v3/users/glance => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:54.049195 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf9389-4886-4efb-9f4a-970ebf06bcbd None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:54.065188 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16f4a4e-d969-491a-8f94-30cf588ec686 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:54.098481 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c73811-f892-45c2-8bca-888e7bd91685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:54.099153 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c73811-f892-45c2-8bca-888e7bd91685 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:54.099437 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c73811-f892-45c2-8bca-888e7bd91685 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:54.099744 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c73811-f892-45c2-8bca-888e7bd91685 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:54.100473 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c73811-f892-45c2-8bca-888e7bd91685 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:54.100780 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c73811-f892-45c2-8bca-888e7bd91685 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:54.102145 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c73811-f892-45c2-8bca-888e7bd91685 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:54.120123 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 324/650] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Apr 11 16:22:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:54.121541 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c73811-f892-45c2-8bca-888e7bd91685 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:54.151274 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf9389-4886-4efb-9f4a-970ebf06bcbd None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:54.186538 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ebf0bc-6bda-47e6-b3b4-75d40ff59b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:54.187216 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ebf0bc-6bda-47e6-b3b4-75d40ff59b41 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:54.187504 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ebf0bc-6bda-47e6-b3b4-75d40ff59b41 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:54.187815 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ebf0bc-6bda-47e6-b3b4-75d40ff59b41 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:54.188565 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ebf0bc-6bda-47e6-b3b4-75d40ff59b41 None admin] RBAC: Adding query filter params (name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:54.188876 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ebf0bc-6bda-47e6-b3b4-75d40ff59b41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:54.190340 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ebf0bc-6bda-47e6-b3b4-75d40ff59b41 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:54.202207 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 327/651] 10.222.0.43 () {56 vars in 1103 bytes} [Mon Apr 11 16:22:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:54.203675 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ebf0bc-6bda-47e6-b3b4-75d40ff59b41 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:54.224703 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c73811-f892-45c2-8bca-888e7bd91685 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:54.260019 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e2d29f-96f4-4dad-bfb6-fa4c8ae2469b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:54.260620 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e2d29f-96f4-4dad-bfb6-fa4c8ae2469b None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:54.260903 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e2d29f-96f4-4dad-bfb6-fa4c8ae2469b None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:54.261178 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e2d29f-96f4-4dad-bfb6-fa4c8ae2469b None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:54.262934 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e2d29f-96f4-4dad-bfb6-fa4c8ae2469b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:54.263247 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e2d29f-96f4-4dad-bfb6-fa4c8ae2469b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:54.264715 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e2d29f-96f4-4dad-bfb6-fa4c8ae2469b None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:54.286505 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 325/652] 10.222.0.43 () {56 vars in 1137 bytes} [Mon Apr 11 16:22:54 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:54.287408 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e2d29f-96f4-4dad-bfb6-fa4c8ae2469b None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:54.306737 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ebf0bc-6bda-47e6-b3b4-75d40ff59b41 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:54.341701 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727bfd14-eaf6-4a49-9e18-25438b6f9986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:54.342504 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727bfd14-eaf6-4a49-9e18-25438b6f9986 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:54.342795 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727bfd14-eaf6-4a49-9e18-25438b6f9986 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:54.343078 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727bfd14-eaf6-4a49-9e18-25438b6f9986 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:54.351370 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727bfd14-eaf6-4a49-9e18-25438b6f9986 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:54.352854 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727bfd14-eaf6-4a49-9e18-25438b6f9986 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:54.366285 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-727bfd14-eaf6-4a49-9e18-25438b6f9986 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 11 16:22:54.367869 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 328/653] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Apr 11 16:22:54 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:54.368659 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727bfd14-eaf6-4a49-9e18-25438b6f9986 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:54.393882 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e2d29f-96f4-4dad-bfb6-fa4c8ae2469b None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:54.428693 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584cb7a2-9d25-4aea-8f47-530ae9e0b70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:54.429500 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584cb7a2-9d25-4aea-8f47-530ae9e0b70e None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:54.429782 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584cb7a2-9d25-4aea-8f47-530ae9e0b70e None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:54.430059 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584cb7a2-9d25-4aea-8f47-530ae9e0b70e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:54.441142 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584cb7a2-9d25-4aea-8f47-530ae9e0b70e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:54.442595 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584cb7a2-9d25-4aea-8f47-530ae9e0b70e None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:54.461494 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-584cb7a2-9d25-4aea-8f47-530ae9e0b70e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:22:54.463161 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 326/654] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:22:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:54.463993 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584cb7a2-9d25-4aea-8f47-530ae9e0b70e None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:54.475626 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727bfd14-eaf6-4a49-9e18-25438b6f9986 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:54.517097 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b33a0e3-c907-4a97-b31b-233b7588f979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:54.517747 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33a0e3-c907-4a97-b31b-233b7588f979 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:54.518171 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33a0e3-c907-4a97-b31b-233b7588f979 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:54.518463 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33a0e3-c907-4a97-b31b-233b7588f979 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:54.598056 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584cb7a2-9d25-4aea-8f47-530ae9e0b70e None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:54.605089 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b33a0e3-c907-4a97-b31b-233b7588f979 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:54.606740 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b33a0e3-c907-4a97-b31b-233b7588f979 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:54.644692 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ee102-d45f-4505-8939-eed36670d974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:54.645385 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ee102-d45f-4505-8939-eed36670d974 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:54.645668 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ee102-d45f-4505-8939-eed36670d974 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:54.645933 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ee102-d45f-4505-8939-eed36670d974 None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:54.646792 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0ee102-d45f-4505-8939-eed36670d974 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:54.647105 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0ee102-d45f-4505-8939-eed36670d974 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:54.649057 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0ee102-d45f-4505-8939-eed36670d974 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:54.677008 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 327/655] 10.222.0.43 () {56 vars in 1137 bytes} [Mon Apr 11 16:22:54 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:54.677008 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ee102-d45f-4505-8939-eed36670d974 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:54.722363 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 329/656] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Apr 11 16:22:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 16:22:54.723541 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b33a0e3-c907-4a97-b31b-233b7588f979 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:54.797722 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ee102-d45f-4505-8939-eed36670d974 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:54.833864 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b33a0e3-c907-4a97-b31b-233b7588f979 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:54.836487 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aff63c-9065-41de-b05c-1c2701ee36a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:54.837401 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aff63c-9065-41de-b05c-1c2701ee36a2 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:54.837831 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aff63c-9065-41de-b05c-1c2701ee36a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:54.838328 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aff63c-9065-41de-b05c-1c2701ee36a2 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:54.839191 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aff63c-9065-41de-b05c-1c2701ee36a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:54.840768 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aff63c-9065-41de-b05c-1c2701ee36a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:54.842296 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aff63c-9065-41de-b05c-1c2701ee36a2 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:54.854484 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 328/657] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Apr 11 16:22:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:54.856224 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aff63c-9065-41de-b05c-1c2701ee36a2 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:54.873374 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e01e8c-9e86-48cf-a636-13debc550639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:54.874041 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e01e8c-9e86-48cf-a636-13debc550639 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:54.874330 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e01e8c-9e86-48cf-a636-13debc550639 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:54.874613 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e01e8c-9e86-48cf-a636-13debc550639 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:54.965690 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e01e8c-9e86-48cf-a636-13debc550639 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:54.967151 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e01e8c-9e86-48cf-a636-13debc550639 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:54.967721 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aff63c-9065-41de-b05c-1c2701ee36a2 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:55.010765 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189e643c-29dc-4cbf-8274-a0a46a6e89b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:55.013714 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e643c-29dc-4cbf-8274-a0a46a6e89b5 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:55.014238 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e643c-29dc-4cbf-8274-a0a46a6e89b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:55.014831 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e643c-29dc-4cbf-8274-a0a46a6e89b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:55.029693 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189e643c-29dc-4cbf-8274-a0a46a6e89b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:55.031156 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189e643c-29dc-4cbf-8274-a0a46a6e89b5 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:55.055075 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-189e643c-29dc-4cbf-8274-a0a46a6e89b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:22:55.057410 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 329/658] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:22:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:55.057599 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189e643c-29dc-4cbf-8274-a0a46a6e89b5 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:55.091778 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 330/659] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Apr 11 16:22:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 16:22:55.093005 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e01e8c-9e86-48cf-a636-13debc550639 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:55.168438 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189e643c-29dc-4cbf-8274-a0a46a6e89b5 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:55.203642 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d0b00-f01e-4bc9-8a85-419ba1e3a515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:55.204289 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d0b00-f01e-4bc9-8a85-419ba1e3a515 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:55.204580 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d0b00-f01e-4bc9-8a85-419ba1e3a515 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:55.204859 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d0b00-f01e-4bc9-8a85-419ba1e3a515 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:55.213709 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294d0b00-f01e-4bc9-8a85-419ba1e3a515 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:55.215353 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294d0b00-f01e-4bc9-8a85-419ba1e3a515 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:55.224903 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e01e8c-9e86-48cf-a636-13debc550639 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:55.229300 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-294d0b00-f01e-4bc9-8a85-419ba1e3a515 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Apr 11 16:22:55.231026 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 330/660] 10.222.0.43 () {56 vars in 1102 bytes} [Mon Apr 11 16:22:55 2022] GET /identity/v3/users/neutron => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:55.231906 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d0b00-f01e-4bc9-8a85-419ba1e3a515 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:55.267018 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dcdd01-7ef8-4100-8df7-6f820fd56fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:55.268110 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dcdd01-7ef8-4100-8df7-6f820fd56fc8 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:55.268600 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dcdd01-7ef8-4100-8df7-6f820fd56fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:55.269112 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dcdd01-7ef8-4100-8df7-6f820fd56fc8 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:55.270033 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dcdd01-7ef8-4100-8df7-6f820fd56fc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:55.270570 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dcdd01-7ef8-4100-8df7-6f820fd56fc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:55.279005 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dcdd01-7ef8-4100-8df7-6f820fd56fc8 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:55.295767 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 331/661] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Apr 11 16:22:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:55.296940 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dcdd01-7ef8-4100-8df7-6f820fd56fc8 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:55.338059 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d0b00-f01e-4bc9-8a85-419ba1e3a515 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:55.382622 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6456bb79-5087-494e-867a-b50599255737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:55.383459 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6456bb79-5087-494e-867a-b50599255737 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:55.383889 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6456bb79-5087-494e-867a-b50599255737 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:55.384266 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6456bb79-5087-494e-867a-b50599255737 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:55.397646 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6456bb79-5087-494e-867a-b50599255737 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:55.399292 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6456bb79-5087-494e-867a-b50599255737 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:55.413223 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dcdd01-7ef8-4100-8df7-6f820fd56fc8 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:55.418842 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-6456bb79-5087-494e-867a-b50599255737 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:22:55.424835 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 331/662] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:22:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:55.425876 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6456bb79-5087-494e-867a-b50599255737 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:55.448095 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699e9e5a-d956-4632-af96-125972892e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:55.449607 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699e9e5a-d956-4632-af96-125972892e36 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:55.450068 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699e9e5a-d956-4632-af96-125972892e36 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:55.450521 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699e9e5a-d956-4632-af96-125972892e36 None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:55.451551 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699e9e5a-d956-4632-af96-125972892e36 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:55.452056 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699e9e5a-d956-4632-af96-125972892e36 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:55.453654 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699e9e5a-d956-4632-af96-125972892e36 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:55.477562 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 332/663] 10.222.0.43 () {56 vars in 1139 bytes} [Mon Apr 11 16:22:55 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:55.478639 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699e9e5a-d956-4632-af96-125972892e36 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:55.532114 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6456bb79-5087-494e-867a-b50599255737 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:55.568916 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83696c7a-cd9c-4a2b-a4ca-ba7b5ac99106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:55.569884 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83696c7a-cd9c-4a2b-a4ca-ba7b5ac99106 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:55.570239 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83696c7a-cd9c-4a2b-a4ca-ba7b5ac99106 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:55.570586 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83696c7a-cd9c-4a2b-a4ca-ba7b5ac99106 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:55.578013 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83696c7a-cd9c-4a2b-a4ca-ba7b5ac99106 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:55.579658 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83696c7a-cd9c-4a2b-a4ca-ba7b5ac99106 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:55.586279 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699e9e5a-d956-4632-af96-125972892e36 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:55.593844 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-83696c7a-cd9c-4a2b-a4ca-ba7b5ac99106 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 16:22:55.599550 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 332/664] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Apr 11 16:22:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:55.599550 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83696c7a-cd9c-4a2b-a4ca-ba7b5ac99106 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:55.627510 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32002cf-f6d8-4c90-a024-ee1a34b4fe1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:55.628597 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32002cf-f6d8-4c90-a024-ee1a34b4fe1a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:55.629082 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32002cf-f6d8-4c90-a024-ee1a34b4fe1a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:55.629576 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32002cf-f6d8-4c90-a024-ee1a34b4fe1a None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:55.630567 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32002cf-f6d8-4c90-a024-ee1a34b4fe1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:55.631069 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32002cf-f6d8-4c90-a024-ee1a34b4fe1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:55.632710 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32002cf-f6d8-4c90-a024-ee1a34b4fe1a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:55.650605 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 333/665] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Apr 11 16:22:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:55.652527 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32002cf-f6d8-4c90-a024-ee1a34b4fe1a None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:55.710513 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83696c7a-cd9c-4a2b-a4ca-ba7b5ac99106 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:55.747306 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa35e1-27d5-4825-a0d0-83f674dc6e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:55.747742 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa35e1-27d5-4825-a0d0-83f674dc6e8a None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:55.748031 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa35e1-27d5-4825-a0d0-83f674dc6e8a None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:55.748309 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa35e1-27d5-4825-a0d0-83f674dc6e8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:55.759977 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32002cf-f6d8-4c90-a024-ee1a34b4fe1a None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:55.796464 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aafafa0-4295-4731-bab7-880e6c26c967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:55.797649 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aafafa0-4295-4731-bab7-880e6c26c967 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:55.798336 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aafafa0-4295-4731-bab7-880e6c26c967 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:55.798759 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aafafa0-4295-4731-bab7-880e6c26c967 None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:55.799752 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aafafa0-4295-4731-bab7-880e6c26c967 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:55.800203 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aafafa0-4295-4731-bab7-880e6c26c967 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:55.802484 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aafafa0-4295-4731-bab7-880e6c26c967 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:55.815846 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aa35e1-27d5-4825-a0d0-83f674dc6e8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:55.820852 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 334/666] 10.222.0.43 () {56 vars in 1148 bytes} [Mon Apr 11 16:22:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:55.820852 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aafafa0-4295-4731-bab7-880e6c26c967 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:55.821069 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aa35e1-27d5-4825-a0d0-83f674dc6e8a None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:55.915311 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 333/667] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Apr 11 16:22:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 16:22:55.916667 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d102f-c376-4d5d-816f-ae8da48615f1 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:55.916954 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d102f-c376-4d5d-816f-ae8da48615f1 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:55.917230 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d102f-c376-4d5d-816f-ae8da48615f1 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:55.919452 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 334/668] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:22:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:22:55.923994 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53d102f-c376-4d5d-816f-ae8da48615f1 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:55.931408 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aafafa0-4295-4731-bab7-880e6c26c967 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:55.964130 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2502d664-1f0e-4a31-b201-bcd743bfe217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:55.965610 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2502d664-1f0e-4a31-b201-bcd743bfe217 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:55.965902 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2502d664-1f0e-4a31-b201-bcd743bfe217 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:55.966408 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2502d664-1f0e-4a31-b201-bcd743bfe217 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:55.972907 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2502d664-1f0e-4a31-b201-bcd743bfe217 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:55.974342 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2502d664-1f0e-4a31-b201-bcd743bfe217 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:55.988171 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-2502d664-1f0e-4a31-b201-bcd743bfe217 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 16:22:55.994440 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 335/669] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Apr 11 16:22:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:55.994440 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2502d664-1f0e-4a31-b201-bcd743bfe217 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:56.048476 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53d102f-c376-4d5d-816f-ae8da48615f1 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:56.081363 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a10cef7-a724-4eff-aa82-d345768fea43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:56.082022 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a10cef7-a724-4eff-aa82-d345768fea43 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:56.082309 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a10cef7-a724-4eff-aa82-d345768fea43 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:56.082587 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a10cef7-a724-4eff-aa82-d345768fea43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:56.083411 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a10cef7-a724-4eff-aa82-d345768fea43 None admin] RBAC: Adding query filter params (role.id=de92d251e74f470e95b6df12ece586b8, scope.project.id=477b9d41390e455a82e733c4fc6acd6b, user.id=a0f7cf98d5394b28a475fd67e30fc9c6) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:56.083754 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a10cef7-a724-4eff-aa82-d345768fea43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:56.085175 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a10cef7-a724-4eff-aa82-d345768fea43 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:56.091357 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 335/670] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Apr 11 16:22:55 2022] GET /identity/v3/role_assignments?user.id=a0f7cf98d5394b28a475fd67e30fc9c6&scope.project.id=477b9d41390e455a82e733c4fc6acd6b&role.id=de92d251e74f470e95b6df12ece586b8 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:56.092556 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb5877-9dd0-46e1-b4af-86cc31459b96 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:56.092845 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb5877-9dd0-46e1-b4af-86cc31459b96 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:56.093124 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb5877-9dd0-46e1-b4af-86cc31459b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:56.101363 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2502d664-1f0e-4a31-b201-bcd743bfe217 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:56.109944 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-dffb5877-9dd0-46e1-b4af-86cc31459b96 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:22:56.111212 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-dffb5877-9dd0-46e1-b4af-86cc31459b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:22:56.138008 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b1ec4b-91cb-4abf-800c-c44b0ecdc559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:56.138811 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b1ec4b-91cb-4abf-800c-c44b0ecdc559 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:56.139113 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b1ec4b-91cb-4abf-800c-c44b0ecdc559 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:56.139371 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b1ec4b-91cb-4abf-800c-c44b0ecdc559 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:56.150967 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b1ec4b-91cb-4abf-800c-c44b0ecdc559 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:56.153150 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b1ec4b-91cb-4abf-800c-c44b0ecdc559 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:56.170580 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-a9b1ec4b-91cb-4abf-800c-c44b0ecdc559 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:22:56.171787 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 336/671] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:22:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:56.172613 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b1ec4b-91cb-4abf-800c-c44b0ecdc559 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:56.187497 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 336/672] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:22:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:22:56.188688 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc599536-dc2d-4188-80c8-f7cbfe018e25 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:56.188976 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc599536-dc2d-4188-80c8-f7cbfe018e25 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:56.189252 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc599536-dc2d-4188-80c8-f7cbfe018e25 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:56.194828 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 337/673] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:22:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:22:56.194828 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc599536-dc2d-4188-80c8-f7cbfe018e25 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:56.298412 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b1ec4b-91cb-4abf-800c-c44b0ecdc559 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:56.317658 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc599536-dc2d-4188-80c8-f7cbfe018e25 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:56.341478 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595c248a-8f14-4c6e-8b04-8078ee825c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:56.342179 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c248a-8f14-4c6e-8b04-8078ee825c7b None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:56.342471 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c248a-8f14-4c6e-8b04-8078ee825c7b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:56.343620 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c248a-8f14-4c6e-8b04-8078ee825c7b None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:56.343620 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595c248a-8f14-4c6e-8b04-8078ee825c7b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:56.343896 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595c248a-8f14-4c6e-8b04-8078ee825c7b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:56.345396 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595c248a-8f14-4c6e-8b04-8078ee825c7b None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:56.358935 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 337/674] 10.222.0.43 () {56 vars in 1148 bytes} [Mon Apr 11 16:22:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:56.360377 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a73496-72f1-43f6-b6c5-728a6e1b6987 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:56.360770 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a73496-72f1-43f6-b6c5-728a6e1b6987 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:56.361007 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d31b1a6-0d8d-43bf-a6de-e84bf5c18692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:56.361128 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a73496-72f1-43f6-b6c5-728a6e1b6987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:56.361682 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31b1a6-0d8d-43bf-a6de-e84bf5c18692 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:56.361964 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31b1a6-0d8d-43bf-a6de-e84bf5c18692 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:56.362309 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31b1a6-0d8d-43bf-a6de-e84bf5c18692 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:56.362961 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d31b1a6-0d8d-43bf-a6de-e84bf5c18692 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:56.363268 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d31b1a6-0d8d-43bf-a6de-e84bf5c18692 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:56.364772 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d31b1a6-0d8d-43bf-a6de-e84bf5c18692 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:56.377807 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 338/675] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Apr 11 16:22:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:56.378641 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d31b1a6-0d8d-43bf-a6de-e84bf5c18692 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:56.379234 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-35a73496-72f1-43f6-b6c5-728a6e1b6987 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:22:56.380492 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-35a73496-72f1-43f6-b6c5-728a6e1b6987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:22:56.447142 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 338/676] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:22:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:22:56.447944 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a73496-72f1-43f6-b6c5-728a6e1b6987 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:56.496543 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d31b1a6-0d8d-43bf-a6de-e84bf5c18692 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:56.534257 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7156967a-342f-4d54-9c00-d007ec0a5bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:56.535078 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7156967a-342f-4d54-9c00-d007ec0a5bea None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:56.535363 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7156967a-342f-4d54-9c00-d007ec0a5bea None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:56.535674 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7156967a-342f-4d54-9c00-d007ec0a5bea None admin] PATH_INFO: `/v3/roles/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:56.546364 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7156967a-342f-4d54-9c00-d007ec0a5bea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:22:56.553535 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-7156967a-342f-4d54-9c00-d007ec0a5bea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 16:22:56.554745 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 339/677] 10.222.0.43 () {56 vars in 1102 bytes} [Mon Apr 11 16:22:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:56.555597 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7156967a-342f-4d54-9c00-d007ec0a5bea None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:56.587857 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a73496-72f1-43f6-b6c5-728a6e1b6987 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:56.627354 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7614fab-3125-497c-83a8-d6f265b3e439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:56.628376 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7614fab-3125-497c-83a8-d6f265b3e439 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:56.628805 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7614fab-3125-497c-83a8-d6f265b3e439 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:56.629228 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7614fab-3125-497c-83a8-d6f265b3e439 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:56.630210 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7614fab-3125-497c-83a8-d6f265b3e439 None admin] RBAC: Adding query filter params (role.id=de92d251e74f470e95b6df12ece586b8, scope.project.id=477b9d41390e455a82e733c4fc6acd6b, user.id=950b5b5f690d41509ead753065a0b793) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:56.630679 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7614fab-3125-497c-83a8-d6f265b3e439 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:56.632671 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7614fab-3125-497c-83a8-d6f265b3e439 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:56.643265 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 339/678] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Apr 11 16:22:56 2022] GET /identity/v3/role_assignments?user.id=950b5b5f690d41509ead753065a0b793&scope.project.id=477b9d41390e455a82e733c4fc6acd6b&role.id=de92d251e74f470e95b6df12ece586b8 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:56.644229 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7614fab-3125-497c-83a8-d6f265b3e439 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:56.672928 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7156967a-342f-4d54-9c00-d007ec0a5bea None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:56.716862 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616804ff-8c67-4935-a7fb-f6b50b19f04b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:56.717781 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616804ff-8c67-4935-a7fb-f6b50b19f04b None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:56.718168 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616804ff-8c67-4935-a7fb-f6b50b19f04b None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:56.718545 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616804ff-8c67-4935-a7fb-f6b50b19f04b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:56.726392 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616804ff-8c67-4935-a7fb-f6b50b19f04b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:56.728089 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616804ff-8c67-4935-a7fb-f6b50b19f04b None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:56.743661 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-616804ff-8c67-4935-a7fb-f6b50b19f04b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 16:22:56.746147 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 340/679] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Apr 11 16:22:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:56.747251 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616804ff-8c67-4935-a7fb-f6b50b19f04b None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:56.767578 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7614fab-3125-497c-83a8-d6f265b3e439 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:56.805338 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cb73dd-3ca4-40f8-a4ad-2e8359d05766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:56.806318 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb73dd-3ca4-40f8-a4ad-2e8359d05766 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:56.806706 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb73dd-3ca4-40f8-a4ad-2e8359d05766 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:56.807088 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb73dd-3ca4-40f8-a4ad-2e8359d05766 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:56.820111 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cb73dd-3ca4-40f8-a4ad-2e8359d05766 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:22:56.827732 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-e1cb73dd-3ca4-40f8-a4ad-2e8359d05766 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 16:22:56.829588 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 340/680] 10.222.0.43 () {56 vars in 1096 bytes} [Mon Apr 11 16:22:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:56.830355 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cb73dd-3ca4-40f8-a4ad-2e8359d05766 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:56.873699 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616804ff-8c67-4935-a7fb-f6b50b19f04b None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:56.921518 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9123e6f-a7ea-4f3d-9308-392920cd6330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:56.921865 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9123e6f-a7ea-4f3d-9308-392920cd6330 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:56.922131 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9123e6f-a7ea-4f3d-9308-392920cd6330 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:56.922408 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9123e6f-a7ea-4f3d-9308-392920cd6330 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:56.923162 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9123e6f-a7ea-4f3d-9308-392920cd6330 None admin] RBAC: Adding query filter params (name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:56.923472 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9123e6f-a7ea-4f3d-9308-392920cd6330 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:56.924871 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9123e6f-a7ea-4f3d-9308-392920cd6330 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:56.933677 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 341/681] 10.222.0.43 () {56 vars in 1103 bytes} [Mon Apr 11 16:22:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:56.934505 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9123e6f-a7ea-4f3d-9308-392920cd6330 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:56.975914 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cb73dd-3ca4-40f8-a4ad-2e8359d05766 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:57.020580 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269e3c57-91e1-42ce-9a70-03e6c80849b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:57.022187 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e3c57-91e1-42ce-9a70-03e6c80849b7 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:57.022679 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e3c57-91e1-42ce-9a70-03e6c80849b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:57.023157 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e3c57-91e1-42ce-9a70-03e6c80849b7 None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:57.024701 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269e3c57-91e1-42ce-9a70-03e6c80849b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:57.025227 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269e3c57-91e1-42ce-9a70-03e6c80849b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:57.028095 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269e3c57-91e1-42ce-9a70-03e6c80849b7 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:57.043073 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9123e6f-a7ea-4f3d-9308-392920cd6330 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:57.044072 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 341/682] 10.222.0.43 () {56 vars in 1148 bytes} [Mon Apr 11 16:22:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:57.045084 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269e3c57-91e1-42ce-9a70-03e6c80849b7 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:57.094352 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2889f32-c180-4231-a762-19c43b0907ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:57.095135 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2889f32-c180-4231-a762-19c43b0907ea None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:57.095487 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2889f32-c180-4231-a762-19c43b0907ea None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:57.095861 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2889f32-c180-4231-a762-19c43b0907ea None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:57.096683 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2889f32-c180-4231-a762-19c43b0907ea None admin] RBAC: Adding query filter params (name=admin) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:57.097078 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2889f32-c180-4231-a762-19c43b0907ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:57.098513 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2889f32-c180-4231-a762-19c43b0907ea None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:57.112343 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 342/683] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Apr 11 16:22:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:57.113339 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2889f32-c180-4231-a762-19c43b0907ea None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:57.174178 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269e3c57-91e1-42ce-9a70-03e6c80849b7 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:57.215396 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2889f32-c180-4231-a762-19c43b0907ea None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:57.218461 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7fed8e-f85f-4316-a301-46d33ab9ee7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:57.219489 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7fed8e-f85f-4316-a301-46d33ab9ee7b None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:57.219978 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7fed8e-f85f-4316-a301-46d33ab9ee7b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:57.220432 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7fed8e-f85f-4316-a301-46d33ab9ee7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:57.233585 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7fed8e-f85f-4316-a301-46d33ab9ee7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:57.235275 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7fed8e-f85f-4316-a301-46d33ab9ee7b None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:57.251312 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1538e85f-8c6f-43dc-8b02-5cd9d60f1b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:57.252090 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1538e85f-8c6f-43dc-8b02-5cd9d60f1b18 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:57.252436 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1538e85f-8c6f-43dc-8b02-5cd9d60f1b18 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:57.252826 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1538e85f-8c6f-43dc-8b02-5cd9d60f1b18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:57.253775 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1538e85f-8c6f-43dc-8b02-5cd9d60f1b18 None admin] RBAC: Adding query filter params (role.id=de92d251e74f470e95b6df12ece586b8, scope.project.id=477b9d41390e455a82e733c4fc6acd6b, user.id=f8c213711e794a1ba47ecf46ecb57769) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:57.254180 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1538e85f-8c6f-43dc-8b02-5cd9d60f1b18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:57.255767 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1538e85f-8c6f-43dc-8b02-5cd9d60f1b18 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:57.258089 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-7c7fed8e-f85f-4316-a301-46d33ab9ee7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:22:57.265055 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 342/684] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:22:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:57.266187 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7fed8e-f85f-4316-a301-46d33ab9ee7b None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:57.267915 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 343/685] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Apr 11 16:22:57 2022] GET /identity/v3/role_assignments?user.id=f8c213711e794a1ba47ecf46ecb57769&scope.project.id=477b9d41390e455a82e733c4fc6acd6b&role.id=de92d251e74f470e95b6df12ece586b8 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:57.269019 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1538e85f-8c6f-43dc-8b02-5cd9d60f1b18 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:57.389414 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7fed8e-f85f-4316-a301-46d33ab9ee7b None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:57.431796 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952575f2-2ed1-4c8a-a724-f5af6c321483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:57.433267 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952575f2-2ed1-4c8a-a724-f5af6c321483 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:57.433923 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952575f2-2ed1-4c8a-a724-f5af6c321483 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:57.434403 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952575f2-2ed1-4c8a-a724-f5af6c321483 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:57.447572 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952575f2-2ed1-4c8a-a724-f5af6c321483 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:57.450472 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952575f2-2ed1-4c8a-a724-f5af6c321483 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:57.470647 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1538e85f-8c6f-43dc-8b02-5cd9d60f1b18 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:57.471537 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-952575f2-2ed1-4c8a-a724-f5af6c321483 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:22:57.473514 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 343/686] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:22:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:57.485581 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952575f2-2ed1-4c8a-a724-f5af6c321483 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:57.533457 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a26f2a-9e9f-4147-a79c-0ab1895f7a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:57.534191 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a26f2a-9e9f-4147-a79c-0ab1895f7a23 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:57.534523 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a26f2a-9e9f-4147-a79c-0ab1895f7a23 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:57.534798 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a26f2a-9e9f-4147-a79c-0ab1895f7a23 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:57.535552 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a26f2a-9e9f-4147-a79c-0ab1895f7a23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:57.535948 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a26f2a-9e9f-4147-a79c-0ab1895f7a23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:57.537334 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a26f2a-9e9f-4147-a79c-0ab1895f7a23 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:57.553119 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 344/687] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Apr 11 16:22:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:57.558525 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a26f2a-9e9f-4147-a79c-0ab1895f7a23 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:57.666751 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952575f2-2ed1-4c8a-a724-f5af6c321483 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:57.686023 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a26f2a-9e9f-4147-a79c-0ab1895f7a23 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:57.706124 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90265c98-a025-43a1-8196-d296d6c2a619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:57.707074 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90265c98-a025-43a1-8196-d296d6c2a619 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:57.707591 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90265c98-a025-43a1-8196-d296d6c2a619 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:57.708094 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90265c98-a025-43a1-8196-d296d6c2a619 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:57.709016 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90265c98-a025-43a1-8196-d296d6c2a619 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:57.709525 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90265c98-a025-43a1-8196-d296d6c2a619 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:57.711091 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90265c98-a025-43a1-8196-d296d6c2a619 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:57.724752 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 344/688] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Apr 11 16:22:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:57.730507 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d2b543-06ef-4feb-a417-41a33fa673a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:57.732280 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2b543-06ef-4feb-a417-41a33fa673a8 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:57.732280 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2b543-06ef-4feb-a417-41a33fa673a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:57.732280 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2b543-06ef-4feb-a417-41a33fa673a8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:57.734550 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90265c98-a025-43a1-8196-d296d6c2a619 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:57.741264 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d2b543-06ef-4feb-a417-41a33fa673a8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:57.742726 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d2b543-06ef-4feb-a417-41a33fa673a8 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:57.762554 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-b4d2b543-06ef-4feb-a417-41a33fa673a8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 11 16:22:57.764404 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 345/689] 10.222.0.43 () {56 vars in 1096 bytes} [Mon Apr 11 16:22:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:57.770502 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d2b543-06ef-4feb-a417-41a33fa673a8 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:57.853438 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90265c98-a025-43a1-8196-d296d6c2a619 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:57.922964 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dfb129-b35f-4ed4-b952-5a619cf64d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:57.924044 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dfb129-b35f-4ed4-b952-5a619cf64d60 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:57.924499 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dfb129-b35f-4ed4-b952-5a619cf64d60 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:57.924916 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dfb129-b35f-4ed4-b952-5a619cf64d60 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:57.931423 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d2b543-06ef-4feb-a417-41a33fa673a8 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:57.944416 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dfb129-b35f-4ed4-b952-5a619cf64d60 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:57.945878 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dfb129-b35f-4ed4-b952-5a619cf64d60 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:57.970927 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaadbe1-7375-4031-82fc-dcc9ea8d05e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:57.971561 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-d1dfb129-b35f-4ed4-b952-5a619cf64d60 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 11 16:22:57.972052 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaadbe1-7375-4031-82fc-dcc9ea8d05e6 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:57.972490 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaadbe1-7375-4031-82fc-dcc9ea8d05e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:57.972904 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaadbe1-7375-4031-82fc-dcc9ea8d05e6 None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:57.973113 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 345/690] 10.222.0.43 () {56 vars in 1093 bytes} [Mon Apr 11 16:22:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:57.974101 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaadbe1-7375-4031-82fc-dcc9ea8d05e6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:57.974570 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaadbe1-7375-4031-82fc-dcc9ea8d05e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:57.976181 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaadbe1-7375-4031-82fc-dcc9ea8d05e6 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:57.980301 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dfb129-b35f-4ed4-b952-5a619cf64d60 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:57.995925 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 346/691] 10.222.0.43 () {56 vars in 1135 bytes} [Mon Apr 11 16:22:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:58.001554 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaadbe1-7375-4031-82fc-dcc9ea8d05e6 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:58.100682 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaadbe1-7375-4031-82fc-dcc9ea8d05e6 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:58.156073 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dfb129-b35f-4ed4-b952-5a619cf64d60 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:58.170011 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56abe334-7b3b-4f9b-b98c-9d6007ddfc09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:58.170865 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56abe334-7b3b-4f9b-b98c-9d6007ddfc09 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:58.171284 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56abe334-7b3b-4f9b-b98c-9d6007ddfc09 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:58.171750 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56abe334-7b3b-4f9b-b98c-9d6007ddfc09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:58.222501 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c6397-12a4-446e-9212-c713929a35f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:58.223440 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c6397-12a4-446e-9212-c713929a35f5 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:58.223899 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c6397-12a4-446e-9212-c713929a35f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:58.224316 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c6397-12a4-446e-9212-c713929a35f5 None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:58.225319 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50c6397-12a4-446e-9212-c713929a35f5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:58.226450 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50c6397-12a4-446e-9212-c713929a35f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:58.229722 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50c6397-12a4-446e-9212-c713929a35f5 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:58.265340 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 346/692] 10.222.0.43 () {56 vars in 1133 bytes} [Mon Apr 11 16:22:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:22:58.271899 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c6397-12a4-446e-9212-c713929a35f5 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:58.363161 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56abe334-7b3b-4f9b-b98c-9d6007ddfc09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:58.371738 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56abe334-7b3b-4f9b-b98c-9d6007ddfc09 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:58.606147 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c6397-12a4-446e-9212-c713929a35f5 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:58.635491 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 347/693] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Apr 11 16:22:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 634 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 16:22:58.641900 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56abe334-7b3b-4f9b-b98c-9d6007ddfc09 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:58.750450 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce12e6e6-6e1c-4919-a772-bf18aa5c337c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:58.751128 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce12e6e6-6e1c-4919-a772-bf18aa5c337c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:58.751412 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce12e6e6-6e1c-4919-a772-bf18aa5c337c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:58.752184 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce12e6e6-6e1c-4919-a772-bf18aa5c337c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:58.850317 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56abe334-7b3b-4f9b-b98c-9d6007ddfc09 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:58.861239 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce12e6e6-6e1c-4919-a772-bf18aa5c337c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:58.862624 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce12e6e6-6e1c-4919-a772-bf18aa5c337c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:58.896156 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb733df1-012b-48ca-9ac9-974a141b01c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:58.896979 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb733df1-012b-48ca-9ac9-974a141b01c5 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:58.897267 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb733df1-012b-48ca-9ac9-974a141b01c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:58.897549 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb733df1-012b-48ca-9ac9-974a141b01c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:58.910956 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb733df1-012b-48ca-9ac9-974a141b01c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:58.912866 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb733df1-012b-48ca-9ac9-974a141b01c5 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:58.934343 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-bb733df1-012b-48ca-9ac9-974a141b01c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:22:58.935966 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 348/694] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:22:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:22:58.937366 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b31f67a-927e-492b-9f3a-dffbfaa2a166 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:58.937656 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b31f67a-927e-492b-9f3a-dffbfaa2a166 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:58.937930 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b31f67a-927e-492b-9f3a-dffbfaa2a166 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:58.943322 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 349/695] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:22:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:22:58.944251 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b31f67a-927e-492b-9f3a-dffbfaa2a166 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:58.980124 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 347/696] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Apr 11 16:22:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 704 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 16:22:58.981603 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840ed48a-6b0d-4572-991c-05852b796f1e None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:58.981892 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840ed48a-6b0d-4572-991c-05852b796f1e None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:58.982166 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840ed48a-6b0d-4572-991c-05852b796f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:59.002871 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-840ed48a-6b0d-4572-991c-05852b796f1e None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:22:59.004490 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-840ed48a-6b0d-4572-991c-05852b796f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:22:59.063187 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b31f67a-927e-492b-9f3a-dffbfaa2a166 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:59.091616 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 348/697] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:22:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:22:59.092578 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840ed48a-6b0d-4572-991c-05852b796f1e None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:59.123122 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3ec801-c9d8-4a34-bdb1-b8936e523177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:59.123751 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ec801-c9d8-4a34-bdb1-b8936e523177 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:59.124039 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ec801-c9d8-4a34-bdb1-b8936e523177 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:59.124314 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ec801-c9d8-4a34-bdb1-b8936e523177 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:59.125048 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3ec801-c9d8-4a34-bdb1-b8936e523177 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:59.125352 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3ec801-c9d8-4a34-bdb1-b8936e523177 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:59.126729 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3ec801-c9d8-4a34-bdb1-b8936e523177 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:59.139493 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 350/698] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Apr 11 16:22:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:59.140392 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3ec801-c9d8-4a34-bdb1-b8936e523177 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:59.223603 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840ed48a-6b0d-4572-991c-05852b796f1e None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:59.252150 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3ec801-c9d8-4a34-bdb1-b8936e523177 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:59.257557 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583fa634-2b66-4eef-a20e-35be249ba3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:59.258601 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583fa634-2b66-4eef-a20e-35be249ba3ce None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:59.259032 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583fa634-2b66-4eef-a20e-35be249ba3ce None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:59.259451 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583fa634-2b66-4eef-a20e-35be249ba3ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:59.270343 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583fa634-2b66-4eef-a20e-35be249ba3ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:59.272086 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583fa634-2b66-4eef-a20e-35be249ba3ce None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:59.290699 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-583fa634-2b66-4eef-a20e-35be249ba3ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:22:59.291494 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d038581c-2870-4c80-aa4f-8fbdfa9ce53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:59.293036 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d038581c-2870-4c80-aa4f-8fbdfa9ce53e None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:59.293407 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d038581c-2870-4c80-aa4f-8fbdfa9ce53e None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:59.293711 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d038581c-2870-4c80-aa4f-8fbdfa9ce53e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:59.298543 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 349/699] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:22:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:59.299639 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583fa634-2b66-4eef-a20e-35be249ba3ce None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:59.305898 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d038581c-2870-4c80-aa4f-8fbdfa9ce53e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:59.307439 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d038581c-2870-4c80-aa4f-8fbdfa9ce53e None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:59.329850 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-d038581c-2870-4c80-aa4f-8fbdfa9ce53e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:22:59.332186 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 351/700] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:22:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:59.333031 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d038581c-2870-4c80-aa4f-8fbdfa9ce53e None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:59.403952 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583fa634-2b66-4eef-a20e-35be249ba3ce None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:59.438646 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d038581c-2870-4c80-aa4f-8fbdfa9ce53e None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:59.438870 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61194106-bf1c-4fed-a4f7-28dea63edb7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:59.439459 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61194106-bf1c-4fed-a4f7-28dea63edb7a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:59.439775 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61194106-bf1c-4fed-a4f7-28dea63edb7a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:59.440056 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61194106-bf1c-4fed-a4f7-28dea63edb7a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:59.446838 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61194106-bf1c-4fed-a4f7-28dea63edb7a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:59.448849 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61194106-bf1c-4fed-a4f7-28dea63edb7a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:59.462121 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-61194106-bf1c-4fed-a4f7-28dea63edb7a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 16:22:59.468456 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 350/701] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Apr 11 16:22:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:59.468456 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8830678-64d1-49a8-9b42-29add0501737 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:59.468456 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8830678-64d1-49a8-9b42-29add0501737 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:59.468456 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8830678-64d1-49a8-9b42-29add0501737 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:59.468456 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 351/702] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:22:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:22:59.468456 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8830678-64d1-49a8-9b42-29add0501737 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:59.482509 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d047b1-0299-46eb-9b60-ace82577b437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:59.483179 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d047b1-0299-46eb-9b60-ace82577b437 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:59.483455 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d047b1-0299-46eb-9b60-ace82577b437 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:59.483775 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d047b1-0299-46eb-9b60-ace82577b437 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:59.484490 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d047b1-0299-46eb-9b60-ace82577b437 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:59.484799 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d047b1-0299-46eb-9b60-ace82577b437 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:59.486148 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d047b1-0299-46eb-9b60-ace82577b437 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:59.498807 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 352/703] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Apr 11 16:22:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:59.499895 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d047b1-0299-46eb-9b60-ace82577b437 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:59.579947 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8830678-64d1-49a8-9b42-29add0501737 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:59.604961 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d047b1-0299-46eb-9b60-ace82577b437 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:59.614559 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f7b3a7-badb-4f9f-aa54-220ca5a887ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:59.615231 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7b3a7-badb-4f9f-aa54-220ca5a887ac None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:59.615545 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7b3a7-badb-4f9f-aa54-220ca5a887ac None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:59.615836 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7b3a7-badb-4f9f-aa54-220ca5a887ac None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:59.616566 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f7b3a7-badb-4f9f-aa54-220ca5a887ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:59.616880 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f7b3a7-badb-4f9f-aa54-220ca5a887ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:59.618239 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f7b3a7-badb-4f9f-aa54-220ca5a887ac None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:59.634606 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 352/704] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Apr 11 16:22:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:59.634606 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e90fa-8982-4cf7-8c32-600f652e70a5 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:59.634606 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e90fa-8982-4cf7-8c32-600f652e70a5 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:59.634606 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e90fa-8982-4cf7-8c32-600f652e70a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:59.644823 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58f0312-ac69-4e64-afab-8927a7cc1d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:59.645487 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f0312-ac69-4e64-afab-8927a7cc1d51 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:59.645890 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f0312-ac69-4e64-afab-8927a7cc1d51 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:59.646173 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f0312-ac69-4e64-afab-8927a7cc1d51 None admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:59.646960 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58f0312-ac69-4e64-afab-8927a7cc1d51 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:59.647340 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58f0312-ac69-4e64-afab-8927a7cc1d51 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:59.648766 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58f0312-ac69-4e64-afab-8927a7cc1d51 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:59.649868 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-2f9e90fa-8982-4cf7-8c32-600f652e70a5 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:22:59.651060 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-2f9e90fa-8982-4cf7-8c32-600f652e70a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:22:59.666416 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 353/705] 10.222.0.43 () {56 vars in 1148 bytes} [Mon Apr 11 16:22:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:22:59.666416 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58f0312-ac69-4e64-afab-8927a7cc1d51 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:59.722978 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 353/706] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:22:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:22:59.724129 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e90fa-8982-4cf7-8c32-600f652e70a5 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:59.777477 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58f0312-ac69-4e64-afab-8927a7cc1d51 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:59.814316 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e2402-d84e-4fba-9ed0-e06859a4ecd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:59.815211 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e2402-d84e-4fba-9ed0-e06859a4ecd0 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:59.815495 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e2402-d84e-4fba-9ed0-e06859a4ecd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:59.815798 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e2402-d84e-4fba-9ed0-e06859a4ecd0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:59.822571 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285e2402-d84e-4fba-9ed0-e06859a4ecd0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:59.824728 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285e2402-d84e-4fba-9ed0-e06859a4ecd0 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:59.828616 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e90fa-8982-4cf7-8c32-600f652e70a5 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:59.837965 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-285e2402-d84e-4fba-9ed0-e06859a4ecd0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 16:22:59.839331 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 354/707] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Apr 11 16:22:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:22:59.840290 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e2402-d84e-4fba-9ed0-e06859a4ecd0 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:59.871186 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90116584-a538-4447-8183-f72f2dc57baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:59.872177 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90116584-a538-4447-8183-f72f2dc57baf None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:59.872636 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90116584-a538-4447-8183-f72f2dc57baf None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:59.873239 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90116584-a538-4447-8183-f72f2dc57baf None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:59.874882 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90116584-a538-4447-8183-f72f2dc57baf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:59.876715 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90116584-a538-4447-8183-f72f2dc57baf None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:22:59.937417 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e2402-d84e-4fba-9ed0-e06859a4ecd0 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:22:59.958687 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 354/708] 10.222.0.43 () {60 vars in 1132 bytes} [Mon Apr 11 16:22:59 2022] POST /identity/v3/users => generated 254 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:22:59.959652 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90116584-a538-4447-8183-f72f2dc57baf None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:22:59.989212 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc97beef-4837-4a90-b2c0-36f870b10eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:22:59.989949 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc97beef-4837-4a90-b2c0-36f870b10eb1 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:22:59.990236 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc97beef-4837-4a90-b2c0-36f870b10eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:22:59.990509 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc97beef-4837-4a90-b2c0-36f870b10eb1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:22:59.991422 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc97beef-4837-4a90-b2c0-36f870b10eb1 None admin] RBAC: Adding query filter params (role.id=de92d251e74f470e95b6df12ece586b8, scope.project.id=477b9d41390e455a82e733c4fc6acd6b, user.id=bb193a1a7abd430fbbcccab970e4f37c) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:22:59.991762 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc97beef-4837-4a90-b2c0-36f870b10eb1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:22:59.993711 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc97beef-4837-4a90-b2c0-36f870b10eb1 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:00.008001 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 355/709] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Apr 11 16:22:59 2022] GET /identity/v3/role_assignments?user.id=bb193a1a7abd430fbbcccab970e4f37c&scope.project.id=477b9d41390e455a82e733c4fc6acd6b&role.id=de92d251e74f470e95b6df12ece586b8 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:00.009007 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc97beef-4837-4a90-b2c0-36f870b10eb1 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:00.081502 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90116584-a538-4447-8183-f72f2dc57baf None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:00.126250 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdafbb02-32cb-44e4-9c60-028aa15e3f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:00.127502 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdafbb02-32cb-44e4-9c60-028aa15e3f27 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:00.128015 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdafbb02-32cb-44e4-9c60-028aa15e3f27 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:00.128481 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdafbb02-32cb-44e4-9c60-028aa15e3f27 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:00.129422 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdafbb02-32cb-44e4-9c60-028aa15e3f27 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:00.131113 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdafbb02-32cb-44e4-9c60-028aa15e3f27 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:00.145954 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-fdafbb02-32cb-44e4-9c60-028aa15e3f27 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 11 16:23:00.147884 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 355/710] 10.222.0.43 () {56 vars in 1129 bytes} [Mon Apr 11 16:22:59 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:23:00.160698 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdafbb02-32cb-44e4-9c60-028aa15e3f27 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:00.185924 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc97beef-4837-4a90-b2c0-36f870b10eb1 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:00.223605 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ffff2b-7cba-4413-a898-2a38a9fa9b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:00.224174 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ffff2b-7cba-4413-a898-2a38a9fa9b49 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:00.224456 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ffff2b-7cba-4413-a898-2a38a9fa9b49 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:00.224732 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ffff2b-7cba-4413-a898-2a38a9fa9b49 None admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:00.225527 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ffff2b-7cba-4413-a898-2a38a9fa9b49 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:00.225837 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ffff2b-7cba-4413-a898-2a38a9fa9b49 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:00.227281 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ffff2b-7cba-4413-a898-2a38a9fa9b49 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:00.240344 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 356/711] 10.222.0.43 () {56 vars in 1148 bytes} [Mon Apr 11 16:23:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:00.241774 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528105e-cc21-4640-9e88-4616c8c81621 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:00.242065 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528105e-cc21-4640-9e88-4616c8c81621 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:00.242341 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528105e-cc21-4640-9e88-4616c8c81621 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:00.244315 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 357/712] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:23:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:23:00.246785 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1528105e-cc21-4640-9e88-4616c8c81621 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:00.282596 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdafbb02-32cb-44e4-9c60-028aa15e3f27 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:00.320568 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e693dd33-2173-4a3c-861f-38d29560c55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:00.321255 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693dd33-2173-4a3c-861f-38d29560c55b None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:00.321544 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693dd33-2173-4a3c-861f-38d29560c55b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:00.321826 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693dd33-2173-4a3c-861f-38d29560c55b None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:00.322542 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e693dd33-2173-4a3c-861f-38d29560c55b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:00.322855 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e693dd33-2173-4a3c-861f-38d29560c55b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:00.325044 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e693dd33-2173-4a3c-861f-38d29560c55b None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:00.334348 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 356/713] 10.222.0.43 () {56 vars in 1124 bytes} [Mon Apr 11 16:23:00 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:00.335754 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6da50e-50fe-477b-a154-9be0657466e5 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:00.336055 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6da50e-50fe-477b-a154-9be0657466e5 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:00.336346 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6da50e-50fe-477b-a154-9be0657466e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:00.354316 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-3b6da50e-50fe-477b-a154-9be0657466e5 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:23:00.355959 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1528105e-cc21-4640-9e88-4616c8c81621 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:00.356171 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-3b6da50e-50fe-477b-a154-9be0657466e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:23:00.399354 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13918ef-a7d9-43a4-a3a6-86dade1044c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:00.400197 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13918ef-a7d9-43a4-a3a6-86dade1044c9 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:00.400580 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13918ef-a7d9-43a4-a3a6-86dade1044c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:00.400970 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13918ef-a7d9-43a4-a3a6-86dade1044c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:00.402536 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13918ef-a7d9-43a4-a3a6-86dade1044c9 None admin] RBAC: Adding query filter params (role.id=702e5e78b5d744529384b96a390ae92f, scope.project.id=477b9d41390e455a82e733c4fc6acd6b, user.id=1be2652c984a4283aeee0b937f0555e4) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:00.402944 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13918ef-a7d9-43a4-a3a6-86dade1044c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:00.405168 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13918ef-a7d9-43a4-a3a6-86dade1044c9 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:00.413249 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 358/714] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Apr 11 16:23:00 2022] GET /identity/v3/role_assignments?user.id=1be2652c984a4283aeee0b937f0555e4&scope.project.id=477b9d41390e455a82e733c4fc6acd6b&role.id=702e5e78b5d744529384b96a390ae92f => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:00.414181 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13918ef-a7d9-43a4-a3a6-86dade1044c9 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:00.447551 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 357/715] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:23:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:23:00.466494 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6da50e-50fe-477b-a154-9be0657466e5 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:00.587095 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6da50e-50fe-477b-a154-9be0657466e5 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:00.597796 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13918ef-a7d9-43a4-a3a6-86dade1044c9 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:00.636274 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b6cfde-cacc-4729-8b26-325914f71fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:00.637053 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6cfde-cacc-4729-8b26-325914f71fe7 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:00.637337 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6cfde-cacc-4729-8b26-325914f71fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:00.637609 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6cfde-cacc-4729-8b26-325914f71fe7 None admin] PATH_INFO: `/v3/services/network` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:00.638265 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b6cfde-cacc-4729-8b26-325914f71fe7 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:00.639659 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b6cfde-cacc-4729-8b26-325914f71fe7 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:00.656812 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-f7b6cfde-cacc-4729-8b26-325914f71fe7 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Apr 11 16:23:00.658617 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 358/716] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Apr 11 16:23:00 2022] GET /identity/v3/services/network => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:23:00.669964 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e54d46-731a-4eb5-bf1a-350fb2d05ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:00.670977 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e54d46-731a-4eb5-bf1a-350fb2d05ce1 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:00.671474 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e54d46-731a-4eb5-bf1a-350fb2d05ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:00.671984 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e54d46-731a-4eb5-bf1a-350fb2d05ce1 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:00.672888 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e54d46-731a-4eb5-bf1a-350fb2d05ce1 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:00.673407 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e54d46-731a-4eb5-bf1a-350fb2d05ce1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:00.676057 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e54d46-731a-4eb5-bf1a-350fb2d05ce1 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:00.677433 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b6cfde-cacc-4729-8b26-325914f71fe7 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:00.683342 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 359/717] 10.222.0.43 () {56 vars in 1124 bytes} [Mon Apr 11 16:23:00 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:00.784247 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b6cfde-cacc-4729-8b26-325914f71fe7 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:00.827625 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f57ca-cef2-48bc-9abb-aeb81b45d3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:00.828322 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f57ca-cef2-48bc-9abb-aeb81b45d3e9 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:00.828605 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f57ca-cef2-48bc-9abb-aeb81b45d3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:00.828878 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f57ca-cef2-48bc-9abb-aeb81b45d3e9 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:00.829601 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6f57ca-cef2-48bc-9abb-aeb81b45d3e9 None admin] RBAC: Adding query filter params (name=network) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:00.829904 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6f57ca-cef2-48bc-9abb-aeb81b45d3e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:00.831293 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6f57ca-cef2-48bc-9abb-aeb81b45d3e9 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:00.836861 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 359/718] 10.222.0.43 () {56 vars in 1112 bytes} [Mon Apr 11 16:23:00 2022] GET /identity/v3/services?name=network => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:23:00.842807 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e54d46-731a-4eb5-bf1a-350fb2d05ce1 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:00.991205 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e54d46-731a-4eb5-bf1a-350fb2d05ce1 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:01.038075 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9a4853-4afe-45ed-844a-4653514d993e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:01.038691 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a4853-4afe-45ed-844a-4653514d993e None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:01.038981 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a4853-4afe-45ed-844a-4653514d993e None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:01.039261 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a4853-4afe-45ed-844a-4653514d993e None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:01.040016 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9a4853-4afe-45ed-844a-4653514d993e None admin] RBAC: Adding query filter params (type=network) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:01.040328 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9a4853-4afe-45ed-844a-4653514d993e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:01.042279 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9a4853-4afe-45ed-844a-4653514d993e None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:01.049982 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 360/719] 10.222.0.43 () {56 vars in 1112 bytes} [Mon Apr 11 16:23:00 2022] GET /identity/v3/services?type=network => generated 124 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:02.880162 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e3286-27fa-42f6-b581-8c52e6ae12fd None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:02.880702 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e3286-27fa-42f6-b581-8c52e6ae12fd None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:02.880702 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e3286-27fa-42f6-b581-8c52e6ae12fd None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:02.882337 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 360/720] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:23:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:23:02.887642 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b9240-3c9a-4234-b05b-d98d89c589cc None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:02.888045 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b9240-3c9a-4234-b05b-d98d89c589cc None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:02.888232 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b9240-3c9a-4234-b05b-d98d89c589cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:02.912594 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-430b9240-3c9a-4234-b05b-d98d89c589cc None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:23:02.913797 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-430b9240-3c9a-4234-b05b-d98d89c589cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:23:02.998644 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 361/721] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:23:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:23:03.047233 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e3286-27fa-42f6-b581-8c52e6ae12fd None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:03.142736 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aad61f-7efb-4cc9-96fb-c97b23c0524a None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:03.143033 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aad61f-7efb-4cc9-96fb-c97b23c0524a None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:03.143214 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aad61f-7efb-4cc9-96fb-c97b23c0524a None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:03.145578 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 362/722] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:23:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:23:03.149709 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c12359-46d8-436a-996a-113b74155e1f None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:03.150248 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c12359-46d8-436a-996a-113b74155e1f None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:03.151273 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c12359-46d8-436a-996a-113b74155e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:03.167791 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e3286-27fa-42f6-b581-8c52e6ae12fd None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:03.170177 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-b3c12359-46d8-436a-996a-113b74155e1f None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:23:03.171348 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-b3c12359-46d8-436a-996a-113b74155e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:23:03.200998 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb13beb5-b9ff-4287-b08e-f237aa22ed79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:03.201845 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13beb5-b9ff-4287-b08e-f237aa22ed79 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:03.202161 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13beb5-b9ff-4287-b08e-f237aa22ed79 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:03.202465 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13beb5-b9ff-4287-b08e-f237aa22ed79 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:03.213232 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb13beb5-b9ff-4287-b08e-f237aa22ed79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:23:03.220784 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-fb13beb5-b9ff-4287-b08e-f237aa22ed79 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 16:23:03.222289 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 361/723] 10.222.0.43 () {56 vars in 1102 bytes} [Mon Apr 11 16:23:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:23:03.223527 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c9350-f912-4e16-b15e-b2489b6b98b9 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:03.223828 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c9350-f912-4e16-b15e-b2489b6b98b9 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:03.224099 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c9350-f912-4e16-b15e-b2489b6b98b9 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:03.225580 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 362/724] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:23:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:23:03.233813 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63c9350-f912-4e16-b15e-b2489b6b98b9 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:03.253213 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 363/725] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:23:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:23:03.255027 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0eed8-3cdc-4d5e-99f8-38db4c0a4fd0 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:03.255313 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0eed8-3cdc-4d5e-99f8-38db4c0a4fd0 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:03.255614 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0eed8-3cdc-4d5e-99f8-38db4c0a4fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:03.277609 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-37e0eed8-3cdc-4d5e-99f8-38db4c0a4fd0 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:23:03.278843 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-37e0eed8-3cdc-4d5e-99f8-38db4c0a4fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:23:03.355006 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63c9350-f912-4e16-b15e-b2489b6b98b9 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:03.358576 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 364/726] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:23:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:23:03.359699 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e0eed8-3cdc-4d5e-99f8-38db4c0a4fd0 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:03.412470 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0796ca46-6f10-4c2c-9a6d-d64c4eec5b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:03.413576 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0796ca46-6f10-4c2c-9a6d-d64c4eec5b6e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:03.414069 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0796ca46-6f10-4c2c-9a6d-d64c4eec5b6e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:03.414571 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0796ca46-6f10-4c2c-9a6d-d64c4eec5b6e None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:03.415567 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0796ca46-6f10-4c2c-9a6d-d64c4eec5b6e None admin] RBAC: Adding query filter params (name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:03.416087 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0796ca46-6f10-4c2c-9a6d-d64c4eec5b6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:03.418281 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0796ca46-6f10-4c2c-9a6d-d64c4eec5b6e None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:03.431437 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 363/727] 10.222.0.43 () {56 vars in 1103 bytes} [Mon Apr 11 16:23:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:03.433393 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0796ca46-6f10-4c2c-9a6d-d64c4eec5b6e None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:03.482045 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e0eed8-3cdc-4d5e-99f8-38db4c0a4fd0 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:03.517044 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02681ea8-9d16-4a2d-bd88-fa643305776b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:03.517888 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02681ea8-9d16-4a2d-bd88-fa643305776b None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:03.518168 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02681ea8-9d16-4a2d-bd88-fa643305776b None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:03.518489 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02681ea8-9d16-4a2d-bd88-fa643305776b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:03.531604 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02681ea8-9d16-4a2d-bd88-fa643305776b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:23:03.538705 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0796ca46-6f10-4c2c-9a6d-d64c4eec5b6e None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:03.540163 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-02681ea8-9d16-4a2d-bd88-fa643305776b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 16:23:03.543315 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 365/728] 10.222.0.43 () {56 vars in 1096 bytes} [Mon Apr 11 16:23:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:23:03.544237 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02681ea8-9d16-4a2d-bd88-fa643305776b None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:03.574718 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677e46bb-293e-4365-8222-532b994d57dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:03.575977 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e46bb-293e-4365-8222-532b994d57dd None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:03.576473 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e46bb-293e-4365-8222-532b994d57dd None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:03.576949 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e46bb-293e-4365-8222-532b994d57dd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:03.587823 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677e46bb-293e-4365-8222-532b994d57dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:23:03.595895 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-677e46bb-293e-4365-8222-532b994d57dd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 16:23:03.597797 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 364/729] 10.222.0.43 () {56 vars in 1096 bytes} [Mon Apr 11 16:23:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:23:03.598787 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677e46bb-293e-4365-8222-532b994d57dd None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:03.683756 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02681ea8-9d16-4a2d-bd88-fa643305776b None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:03.711794 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677e46bb-293e-4365-8222-532b994d57dd None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:03.718421 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81309689-ed37-4f1d-883c-844b221e16bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:03.719238 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81309689-ed37-4f1d-883c-844b221e16bd None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:03.719970 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81309689-ed37-4f1d-883c-844b221e16bd None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:03.720250 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81309689-ed37-4f1d-883c-844b221e16bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:03.733447 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81309689-ed37-4f1d-883c-844b221e16bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:03.734895 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81309689-ed37-4f1d-883c-844b221e16bd None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:03.746150 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63cd240-1004-4b4e-ab57-33042ef2d948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:03.746818 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63cd240-1004-4b4e-ab57-33042ef2d948 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:03.747102 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63cd240-1004-4b4e-ab57-33042ef2d948 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:03.747379 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63cd240-1004-4b4e-ab57-33042ef2d948 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:03.748156 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63cd240-1004-4b4e-ab57-33042ef2d948 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:03.748466 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63cd240-1004-4b4e-ab57-33042ef2d948 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:03.749818 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63cd240-1004-4b4e-ab57-33042ef2d948 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:03.752578 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-81309689-ed37-4f1d-883c-844b221e16bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:23:03.758311 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 366/730] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:23:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:23:03.758311 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81309689-ed37-4f1d-883c-844b221e16bd None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:03.766881 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 365/731] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Apr 11 16:23:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:03.766881 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181a150-f510-4d7f-99e1-3d7acea1d757 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:03.766881 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181a150-f510-4d7f-99e1-3d7acea1d757 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:03.766881 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181a150-f510-4d7f-99e1-3d7acea1d757 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:03.769819 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 366/732] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:23:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:23:03.770617 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b181a150-f510-4d7f-99e1-3d7acea1d757 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:03.940599 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81309689-ed37-4f1d-883c-844b221e16bd None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:03.943416 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b181a150-f510-4d7f-99e1-3d7acea1d757 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:03.973357 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e8cb04-9712-4f1d-af07-f96059611efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:03.974026 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8cb04-9712-4f1d-af07-f96059611efb None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:03.974308 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8cb04-9712-4f1d-af07-f96059611efb None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:03.974582 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8cb04-9712-4f1d-af07-f96059611efb None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:03.975320 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e8cb04-9712-4f1d-af07-f96059611efb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:03.975653 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e8cb04-9712-4f1d-af07-f96059611efb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:03.977001 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e8cb04-9712-4f1d-af07-f96059611efb None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:03.978977 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a32c6be-832d-4de3-a565-5c84b5ac264e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:03.980002 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a32c6be-832d-4de3-a565-5c84b5ac264e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:03.980294 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a32c6be-832d-4de3-a565-5c84b5ac264e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:03.980574 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a32c6be-832d-4de3-a565-5c84b5ac264e None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:03.981319 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a32c6be-832d-4de3-a565-5c84b5ac264e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:03.981611 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a32c6be-832d-4de3-a565-5c84b5ac264e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:03.982956 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a32c6be-832d-4de3-a565-5c84b5ac264e None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:03.985210 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 367/733] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Apr 11 16:23:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:03.985994 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e8cb04-9712-4f1d-af07-f96059611efb None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:04.005178 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 367/734] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Apr 11 16:23:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:04.006539 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02abbf3b-e7ab-4f93-a114-58eb7e3d3a8a None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:04.006839 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02abbf3b-e7ab-4f93-a114-58eb7e3d3a8a None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:04.007123 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02abbf3b-e7ab-4f93-a114-58eb7e3d3a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:04.023695 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-02abbf3b-e7ab-4f93-a114-58eb7e3d3a8a None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:23:04.025216 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-02abbf3b-e7ab-4f93-a114-58eb7e3d3a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:23:04.084102 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e8cb04-9712-4f1d-af07-f96059611efb None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:04.093533 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 368/735] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:23:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:23:04.094723 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02abbf3b-e7ab-4f93-a114-58eb7e3d3a8a None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:04.124445 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db74ad59-be66-4406-abb3-60e34f628f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:04.125251 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db74ad59-be66-4406-abb3-60e34f628f7b None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:04.125532 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db74ad59-be66-4406-abb3-60e34f628f7b None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:04.125802 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db74ad59-be66-4406-abb3-60e34f628f7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:04.137025 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db74ad59-be66-4406-abb3-60e34f628f7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:04.138597 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db74ad59-be66-4406-abb3-60e34f628f7b None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:04.155506 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-db74ad59-be66-4406-abb3-60e34f628f7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:23:04.161160 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 368/736] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:23:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:23:04.161160 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db74ad59-be66-4406-abb3-60e34f628f7b None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:04.212302 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02abbf3b-e7ab-4f93-a114-58eb7e3d3a8a None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:04.244728 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec1a46-b4e1-4286-a163-e33ebc85eae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:04.245521 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec1a46-b4e1-4286-a163-e33ebc85eae0 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:04.245848 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec1a46-b4e1-4286-a163-e33ebc85eae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:04.246121 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec1a46-b4e1-4286-a163-e33ebc85eae0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:04.253172 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db74ad59-be66-4406-abb3-60e34f628f7b None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:04.255768 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cec1a46-b4e1-4286-a163-e33ebc85eae0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:04.257202 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cec1a46-b4e1-4286-a163-e33ebc85eae0 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:04.274143 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-7cec1a46-b4e1-4286-a163-e33ebc85eae0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:23:04.275402 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 369/737] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:23:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:23:04.276814 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec1a46-b4e1-4286-a163-e33ebc85eae0 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:04.286307 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c80fc9d-f14e-4742-b3f6-8ca8dc95b2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:04.287123 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c80fc9d-f14e-4742-b3f6-8ca8dc95b2bd None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:04.287411 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c80fc9d-f14e-4742-b3f6-8ca8dc95b2bd None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:04.287718 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c80fc9d-f14e-4742-b3f6-8ca8dc95b2bd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:04.295015 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c80fc9d-f14e-4742-b3f6-8ca8dc95b2bd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:04.296474 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c80fc9d-f14e-4742-b3f6-8ca8dc95b2bd None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:04.310608 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-6c80fc9d-f14e-4742-b3f6-8ca8dc95b2bd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 11 16:23:04.311808 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 369/738] 10.222.0.43 () {56 vars in 1117 bytes} [Mon Apr 11 16:23:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:23:04.312573 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c80fc9d-f14e-4742-b3f6-8ca8dc95b2bd None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:04.375030 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec1a46-b4e1-4286-a163-e33ebc85eae0 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:04.408043 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d3c72c-8fa5-4566-8530-414a3f0a8263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:04.408708 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3c72c-8fa5-4566-8530-414a3f0a8263 None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:04.408996 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3c72c-8fa5-4566-8530-414a3f0a8263 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:04.409277 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3c72c-8fa5-4566-8530-414a3f0a8263 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:04.409811 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c80fc9d-f14e-4742-b3f6-8ca8dc95b2bd None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:04.409999 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d3c72c-8fa5-4566-8530-414a3f0a8263 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:04.411433 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d3c72c-8fa5-4566-8530-414a3f0a8263 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:04.444710 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a0f8db-fd2a-40f9-a5e8-37255434ffb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:04.445565 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0f8db-fd2a-40f9-a5e8-37255434ffb7 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:04.445847 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0f8db-fd2a-40f9-a5e8-37255434ffb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:04.446114 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0f8db-fd2a-40f9-a5e8-37255434ffb7 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:04.446840 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a0f8db-fd2a-40f9-a5e8-37255434ffb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:04.447141 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a0f8db-fd2a-40f9-a5e8-37255434ffb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:04.448723 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a0f8db-fd2a-40f9-a5e8-37255434ffb7 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:04.468107 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 370/739] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Apr 11 16:23:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:04.469304 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e93c61-4bfb-4e11-a848-28b69b964fc2 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:04.469588 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e93c61-4bfb-4e11-a848-28b69b964fc2 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:04.469862 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e93c61-4bfb-4e11-a848-28b69b964fc2 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:04.471063 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 371/740] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:23:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:23:04.471765 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e93c61-4bfb-4e11-a848-28b69b964fc2 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:04.515846 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 370/741] 10.222.0.43 () {60 vars in 1141 bytes} [Mon Apr 11 16:23:04 2022] POST /identity/v3/services => generated 251 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:23:04.516696 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d3c72c-8fa5-4566-8530-414a3f0a8263 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:04.653031 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d3c72c-8fa5-4566-8530-414a3f0a8263 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:04.653266 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e93c61-4bfb-4e11-a848-28b69b964fc2 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:04.689990 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a706e-bbf2-420b-bf8d-90f7bbc9dab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:04.690265 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98749fd-994c-41ce-94b7-cbfb41ac8a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:04.690673 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98749fd-994c-41ce-94b7-cbfb41ac8a0a None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:04.690781 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a706e-bbf2-420b-bf8d-90f7bbc9dab3 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:04.690954 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a706e-bbf2-420b-bf8d-90f7bbc9dab3 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:04.691046 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98749fd-994c-41ce-94b7-cbfb41ac8a0a None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:04.691215 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a706e-bbf2-420b-bf8d-90f7bbc9dab3 None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:04.691307 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98749fd-994c-41ce-94b7-cbfb41ac8a0a None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:04.691976 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98749fd-994c-41ce-94b7-cbfb41ac8a0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:04.692130 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133a706e-bbf2-420b-bf8d-90f7bbc9dab3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:04.692306 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98749fd-994c-41ce-94b7-cbfb41ac8a0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:04.692491 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133a706e-bbf2-420b-bf8d-90f7bbc9dab3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:04.693667 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98749fd-994c-41ce-94b7-cbfb41ac8a0a None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:04.693828 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133a706e-bbf2-420b-bf8d-90f7bbc9dab3 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:04.706170 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 372/742] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Apr 11 16:23:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:04.706821 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98749fd-994c-41ce-94b7-cbfb41ac8a0a None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:04.717222 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 371/743] 10.222.0.43 () {56 vars in 1149 bytes} [Mon Apr 11 16:23:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:04.718570 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94949a-8a7e-458b-bba6-b3d349e07948 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:04.718570 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94949a-8a7e-458b-bba6-b3d349e07948 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:04.718830 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94949a-8a7e-458b-bba6-b3d349e07948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:04.735476 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-6c94949a-8a7e-458b-bba6-b3d349e07948 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:23:04.736744 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-6c94949a-8a7e-458b-bba6-b3d349e07948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:23:04.813556 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98749fd-994c-41ce-94b7-cbfb41ac8a0a None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:04.827542 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 372/744] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:23:04 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:23:04.827542 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c94949a-8a7e-458b-bba6-b3d349e07948 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:04.859784 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac72706-ab8f-4c4c-ad9d-5fb5dff973f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:04.861406 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac72706-ab8f-4c4c-ad9d-5fb5dff973f5 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:04.861693 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac72706-ab8f-4c4c-ad9d-5fb5dff973f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:04.861968 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac72706-ab8f-4c4c-ad9d-5fb5dff973f5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:04.872292 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac72706-ab8f-4c4c-ad9d-5fb5dff973f5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:04.873770 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac72706-ab8f-4c4c-ad9d-5fb5dff973f5 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:04.888296 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-4ac72706-ab8f-4c4c-ad9d-5fb5dff973f5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 11 16:23:04.894089 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 373/745] 10.222.0.43 () {56 vars in 1096 bytes} [Mon Apr 11 16:23:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:23:04.894089 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac72706-ab8f-4c4c-ad9d-5fb5dff973f5 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:04.924469 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c94949a-8a7e-458b-bba6-b3d349e07948 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:04.958036 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7986671-b27a-420a-bdad-488aef222346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:04.958832 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7986671-b27a-420a-bdad-488aef222346 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:04.959128 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7986671-b27a-420a-bdad-488aef222346 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:04.959408 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7986671-b27a-420a-bdad-488aef222346 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:04.967095 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7986671-b27a-420a-bdad-488aef222346 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:04.968638 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7986671-b27a-420a-bdad-488aef222346 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:04.982752 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-a7986671-b27a-420a-bdad-488aef222346 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 11 16:23:04.988470 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 373/746] 10.222.0.43 () {56 vars in 1093 bytes} [Mon Apr 11 16:23:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:23:04.988470 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7986671-b27a-420a-bdad-488aef222346 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:04.996880 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac72706-ab8f-4c4c-ad9d-5fb5dff973f5 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:05.029806 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26343742-3fae-44a5-8181-c228fff411d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:05.030464 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26343742-3fae-44a5-8181-c228fff411d4 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:05.030751 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26343742-3fae-44a5-8181-c228fff411d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:05.031031 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26343742-3fae-44a5-8181-c228fff411d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:05.084668 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7986671-b27a-420a-bdad-488aef222346 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:05.096663 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26343742-3fae-44a5-8181-c228fff411d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:05.098130 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26343742-3fae-44a5-8181-c228fff411d4 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:05.118266 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7efaff-f9f3-4720-950e-95bdaca0a23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:05.118922 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7efaff-f9f3-4720-950e-95bdaca0a23d None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:05.119247 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7efaff-f9f3-4720-950e-95bdaca0a23d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:05.119552 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7efaff-f9f3-4720-950e-95bdaca0a23d None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:05.120271 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7efaff-f9f3-4720-950e-95bdaca0a23d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:05.121615 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7efaff-f9f3-4720-950e-95bdaca0a23d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:05.197811 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 374/747] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Apr 11 16:23:04 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 16:23:05.198675 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26343742-3fae-44a5-8181-c228fff411d4 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:05.207602 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 374/748] 10.222.0.43 () {60 vars in 1141 bytes} [Mon Apr 11 16:23:04 2022] POST /identity/v3/services => generated 240 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:23:05.208779 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7efaff-f9f3-4720-950e-95bdaca0a23d None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:05.305099 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26343742-3fae-44a5-8181-c228fff411d4 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:05.331667 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7efaff-f9f3-4720-950e-95bdaca0a23d None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:05.343028 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e909984-7816-499f-8ee0-c76b0dadcf36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:05.343769 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e909984-7816-499f-8ee0-c76b0dadcf36 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:05.344056 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e909984-7816-499f-8ee0-c76b0dadcf36 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:05.344347 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e909984-7816-499f-8ee0-c76b0dadcf36 None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:05.345533 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e909984-7816-499f-8ee0-c76b0dadcf36 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:05.345874 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e909984-7816-499f-8ee0-c76b0dadcf36 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:05.347680 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e909984-7816-499f-8ee0-c76b0dadcf36 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:05.376628 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 375/749] 10.222.0.43 () {56 vars in 1135 bytes} [Mon Apr 11 16:23:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:05.376628 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e909984-7816-499f-8ee0-c76b0dadcf36 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:05.377959 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc513a6-6700-46e7-968f-49f0417a72d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:05.378910 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc513a6-6700-46e7-968f-49f0417a72d8 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:05.379424 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc513a6-6700-46e7-968f-49f0417a72d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:05.379955 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc513a6-6700-46e7-968f-49f0417a72d8 None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:05.381105 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc513a6-6700-46e7-968f-49f0417a72d8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:05.381630 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc513a6-6700-46e7-968f-49f0417a72d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:05.383361 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc513a6-6700-46e7-968f-49f0417a72d8 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:05.408416 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 375/750] 10.222.0.43 () {56 vars in 1133 bytes} [Mon Apr 11 16:23:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:05.409759 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc513a6-6700-46e7-968f-49f0417a72d8 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:05.496755 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e909984-7816-499f-8ee0-c76b0dadcf36 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:05.540318 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5402b441-7360-4138-ae0b-404cffab5d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:05.541943 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402b441-7360-4138-ae0b-404cffab5d81 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:05.542228 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402b441-7360-4138-ae0b-404cffab5d81 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:05.542501 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402b441-7360-4138-ae0b-404cffab5d81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:05.547214 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc513a6-6700-46e7-968f-49f0417a72d8 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:05.555608 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5402b441-7360-4138-ae0b-404cffab5d81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:05.558005 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5402b441-7360-4138-ae0b-404cffab5d81 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:05.580099 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-5402b441-7360-4138-ae0b-404cffab5d81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:23:05.581646 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 376/751] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:23:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:23:05.582536 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5402b441-7360-4138-ae0b-404cffab5d81 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:05.588764 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d9e8af-b5ec-4235-a644-7f8883d95bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:05.589419 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d9e8af-b5ec-4235-a644-7f8883d95bb0 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:05.589701 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d9e8af-b5ec-4235-a644-7f8883d95bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:05.589974 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d9e8af-b5ec-4235-a644-7f8883d95bb0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:05.674889 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d9e8af-b5ec-4235-a644-7f8883d95bb0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:05.676370 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d9e8af-b5ec-4235-a644-7f8883d95bb0 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:05.692550 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5402b441-7360-4138-ae0b-404cffab5d81 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:05.731287 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed05a51-95ca-4e2d-9d86-3c7b4d908c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:05.732124 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed05a51-95ca-4e2d-9d86-3c7b4d908c34 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:05.732411 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed05a51-95ca-4e2d-9d86-3c7b4d908c34 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:05.732690 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed05a51-95ca-4e2d-9d86-3c7b4d908c34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:05.745737 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed05a51-95ca-4e2d-9d86-3c7b4d908c34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:05.748062 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed05a51-95ca-4e2d-9d86-3c7b4d908c34 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:05.770486 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-6ed05a51-95ca-4e2d-9d86-3c7b4d908c34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:23:05.772396 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 377/752] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:23:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:23:05.773508 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed05a51-95ca-4e2d-9d86-3c7b4d908c34 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:05.811691 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 376/753] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Apr 11 16:23:05 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 16:23:05.812560 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d9e8af-b5ec-4235-a644-7f8883d95bb0 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:05.898014 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed05a51-95ca-4e2d-9d86-3c7b4d908c34 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:05.931053 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc2933-bb98-4067-811f-405710492af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:05.932516 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc2933-bb98-4067-811f-405710492af2 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:05.932804 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc2933-bb98-4067-811f-405710492af2 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:05.933080 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc2933-bb98-4067-811f-405710492af2 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:05.933801 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fc2933-bb98-4067-811f-405710492af2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:05.934110 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fc2933-bb98-4067-811f-405710492af2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:05.935479 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fc2933-bb98-4067-811f-405710492af2 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:05.939237 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d9e8af-b5ec-4235-a644-7f8883d95bb0 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:05.947126 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 378/754] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Apr 11 16:23:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:05.948588 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc2933-bb98-4067-811f-405710492af2 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:05.973232 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c52dcd-4778-435c-9f90-96a3ef686ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:05.973938 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c52dcd-4778-435c-9f90-96a3ef686ee6 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:05.974225 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c52dcd-4778-435c-9f90-96a3ef686ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:05.974496 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c52dcd-4778-435c-9f90-96a3ef686ee6 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:05.975214 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c52dcd-4778-435c-9f90-96a3ef686ee6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:05.975542 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c52dcd-4778-435c-9f90-96a3ef686ee6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:05.977067 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c52dcd-4778-435c-9f90-96a3ef686ee6 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:05.988887 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 377/755] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Apr 11 16:23:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:05.989482 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c52dcd-4778-435c-9f90-96a3ef686ee6 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:06.048887 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc2933-bb98-4067-811f-405710492af2 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:06.082167 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27bb982-ca4e-4dd7-932d-2318a811474e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:06.082894 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27bb982-ca4e-4dd7-932d-2318a811474e None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:06.083177 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27bb982-ca4e-4dd7-932d-2318a811474e None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:06.083450 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27bb982-ca4e-4dd7-932d-2318a811474e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:06.094649 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27bb982-ca4e-4dd7-932d-2318a811474e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:06.095591 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c52dcd-4778-435c-9f90-96a3ef686ee6 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:06.096159 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27bb982-ca4e-4dd7-932d-2318a811474e None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:06.115170 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-f27bb982-ca4e-4dd7-932d-2318a811474e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:23:06.116442 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 379/756] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:23:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:23:06.117227 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27bb982-ca4e-4dd7-932d-2318a811474e None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:06.135285 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c696af85-3a48-43f6-a214-748aef15c143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:06.137123 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696af85-3a48-43f6-a214-748aef15c143 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:06.137715 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696af85-3a48-43f6-a214-748aef15c143 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:06.138238 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696af85-3a48-43f6-a214-748aef15c143 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:06.146716 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c696af85-3a48-43f6-a214-748aef15c143 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:06.148548 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c696af85-3a48-43f6-a214-748aef15c143 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:06.163490 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-c696af85-3a48-43f6-a214-748aef15c143 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 16:23:06.165169 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 378/757] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Apr 11 16:23:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:23:06.166710 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c696af85-3a48-43f6-a214-748aef15c143 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:06.234391 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27bb982-ca4e-4dd7-932d-2318a811474e None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:06.275902 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c696af85-3a48-43f6-a214-748aef15c143 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:06.277761 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f66470-66dc-44eb-a358-38aa79fb7553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:06.279470 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f66470-66dc-44eb-a358-38aa79fb7553 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:06.279793 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f66470-66dc-44eb-a358-38aa79fb7553 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:06.280077 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f66470-66dc-44eb-a358-38aa79fb7553 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:06.288090 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f66470-66dc-44eb-a358-38aa79fb7553 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:06.289820 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f66470-66dc-44eb-a358-38aa79fb7553 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:06.308350 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-01f66470-66dc-44eb-a358-38aa79fb7553 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 16:23:06.314342 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 380/758] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Apr 11 16:23:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:23:06.314342 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f66470-66dc-44eb-a358-38aa79fb7553 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:06.315338 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf28715-bc61-495b-ae55-6b610445237d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:06.316300 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf28715-bc61-495b-ae55-6b610445237d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:06.316869 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf28715-bc61-495b-ae55-6b610445237d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:06.317514 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf28715-bc61-495b-ae55-6b610445237d None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:06.318495 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf28715-bc61-495b-ae55-6b610445237d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:06.318992 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf28715-bc61-495b-ae55-6b610445237d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:06.320628 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf28715-bc61-495b-ae55-6b610445237d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:06.334027 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 379/759] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Apr 11 16:23:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:06.335346 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf28715-bc61-495b-ae55-6b610445237d None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:06.415459 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f66470-66dc-44eb-a358-38aa79fb7553 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:06.461822 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf28715-bc61-495b-ae55-6b610445237d None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:06.462279 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef6a630-d083-40dd-aeea-84ca9f9a41f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:06.463250 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6a630-d083-40dd-aeea-84ca9f9a41f7 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:06.463781 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6a630-d083-40dd-aeea-84ca9f9a41f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:06.464252 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6a630-d083-40dd-aeea-84ca9f9a41f7 None admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:06.465256 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef6a630-d083-40dd-aeea-84ca9f9a41f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:06.465761 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef6a630-d083-40dd-aeea-84ca9f9a41f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:06.467394 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef6a630-d083-40dd-aeea-84ca9f9a41f7 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:06.483781 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 381/760] 10.222.0.43 () {56 vars in 1148 bytes} [Mon Apr 11 16:23:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:06.484996 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef6a630-d083-40dd-aeea-84ca9f9a41f7 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:06.502522 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dbfbf3-7dae-46b8-b0ee-5dbf59eb5b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:06.503232 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dbfbf3-7dae-46b8-b0ee-5dbf59eb5b39 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:06.508705 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dbfbf3-7dae-46b8-b0ee-5dbf59eb5b39 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:06.508705 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dbfbf3-7dae-46b8-b0ee-5dbf59eb5b39 None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:06.508705 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dbfbf3-7dae-46b8-b0ee-5dbf59eb5b39 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:06.508705 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dbfbf3-7dae-46b8-b0ee-5dbf59eb5b39 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:06.508705 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dbfbf3-7dae-46b8-b0ee-5dbf59eb5b39 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:06.526178 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 380/761] 10.222.0.43 () {56 vars in 1148 bytes} [Mon Apr 11 16:23:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:06.527993 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dbfbf3-7dae-46b8-b0ee-5dbf59eb5b39 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:06.612164 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef6a630-d083-40dd-aeea-84ca9f9a41f7 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:06.641509 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dbfbf3-7dae-46b8-b0ee-5dbf59eb5b39 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:06.645541 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f237cd0-97f0-4e84-9bfc-04c9eaf303f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:06.646350 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f237cd0-97f0-4e84-9bfc-04c9eaf303f7 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:06.646637 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f237cd0-97f0-4e84-9bfc-04c9eaf303f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:06.646961 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f237cd0-97f0-4e84-9bfc-04c9eaf303f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:06.654538 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f237cd0-97f0-4e84-9bfc-04c9eaf303f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:06.656056 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f237cd0-97f0-4e84-9bfc-04c9eaf303f7 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:06.670412 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-6f237cd0-97f0-4e84-9bfc-04c9eaf303f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 16:23:06.671937 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 382/762] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Apr 11 16:23:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:23:06.672762 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f237cd0-97f0-4e84-9bfc-04c9eaf303f7 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:06.680588 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bedaa3-a1b8-481c-a288-bd4a82f9bcdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:06.681535 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bedaa3-a1b8-481c-a288-bd4a82f9bcdd None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:06.682033 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bedaa3-a1b8-481c-a288-bd4a82f9bcdd None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:06.682646 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bedaa3-a1b8-481c-a288-bd4a82f9bcdd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:06.683770 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bedaa3-a1b8-481c-a288-bd4a82f9bcdd None admin] RBAC: Adding query filter params (role.id=de92d251e74f470e95b6df12ece586b8, scope.project.id=477b9d41390e455a82e733c4fc6acd6b, user.id=3252c48fdd5747a29fe4ba89e7162216) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:06.684297 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bedaa3-a1b8-481c-a288-bd4a82f9bcdd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:06.685929 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bedaa3-a1b8-481c-a288-bd4a82f9bcdd None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:06.691744 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 381/763] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Apr 11 16:23:06 2022] GET /identity/v3/role_assignments?user.id=3252c48fdd5747a29fe4ba89e7162216&scope.project.id=477b9d41390e455a82e733c4fc6acd6b&role.id=de92d251e74f470e95b6df12ece586b8 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:06.692780 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bedaa3-a1b8-481c-a288-bd4a82f9bcdd None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:06.779544 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f237cd0-97f0-4e84-9bfc-04c9eaf303f7 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:06.805653 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bedaa3-a1b8-481c-a288-bd4a82f9bcdd None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:06.824160 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a30be7-8a54-47e5-b448-b821a6fd81f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:06.825069 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a30be7-8a54-47e5-b448-b821a6fd81f9 None admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:06.825351 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a30be7-8a54-47e5-b448-b821a6fd81f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:06.825627 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a30be7-8a54-47e5-b448-b821a6fd81f9 None admin] PATH_INFO: `/v3/projects/477b9d41390e455a82e733c4fc6acd6b/users/1be2652c984a4283aeee0b937f0555e4/roles/702e5e78b5d744529384b96a390ae92f` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:06.827773 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a30be7-8a54-47e5-b448-b821a6fd81f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=477b9d41390e455a82e733c4fc6acd6b, user_id=1be2652c984a4283aeee0b937f0555e4, role_id=702e5e78b5d744529384b96a390ae92f)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:06.829221 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a30be7-8a54-47e5-b448-b821a6fd81f9 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:06.844442 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a5168-7858-4089-b279-bc270191cf0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:06.851877 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a5168-7858-4089-b279-bc270191cf0f None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:06.851877 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a5168-7858-4089-b279-bc270191cf0f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:06.851877 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a5168-7858-4089-b279-bc270191cf0f None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:06.851877 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47a5168-7858-4089-b279-bc270191cf0f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:06.851877 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47a5168-7858-4089-b279-bc270191cf0f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:06.851877 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47a5168-7858-4089-b279-bc270191cf0f None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:06.865222 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 382/764] 10.222.0.43 () {56 vars in 1148 bytes} [Mon Apr 11 16:23:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:06.871891 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a5168-7858-4089-b279-bc270191cf0f None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:06.906925 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 383/765] 10.222.0.43 () {58 vars in 1439 bytes} [Mon Apr 11 16:23:06 2022] PUT /identity/v3/projects/477b9d41390e455a82e733c4fc6acd6b/users/1be2652c984a4283aeee0b937f0555e4/roles/702e5e78b5d744529384b96a390ae92f => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:23:06.956720 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3c0b8-16ee-446a-8480-1b68610d4c16 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:06.957045 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3c0b8-16ee-446a-8480-1b68610d4c16 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:06.957285 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3c0b8-16ee-446a-8480-1b68610d4c16 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:06.959037 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 384/766] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:23:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 16:23:06.965139 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085771e-a760-4ac4-a4b4-5a1afb2c8df2 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:06.965454 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085771e-a760-4ac4-a4b4-5a1afb2c8df2 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:06.965702 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085771e-a760-4ac4-a4b4-5a1afb2c8df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:06.986082 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-e085771e-a760-4ac4-a4b4-5a1afb2c8df2 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:23:06.987305 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-e085771e-a760-4ac4-a4b4-5a1afb2c8df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:23:06.990189 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a5168-7858-4089-b279-bc270191cf0f None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:07.029856 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1815282-61ba-4fe8-b809-f3d8668d1fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:07.030883 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1815282-61ba-4fe8-b809-f3d8668d1fc2 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:07.031383 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1815282-61ba-4fe8-b809-f3d8668d1fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:07.031883 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1815282-61ba-4fe8-b809-f3d8668d1fc2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:07.033061 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1815282-61ba-4fe8-b809-f3d8668d1fc2 None admin] RBAC: Adding query filter params (role.id=702e5e78b5d744529384b96a390ae92f, scope.project.id=477b9d41390e455a82e733c4fc6acd6b, user.id=bb193a1a7abd430fbbcccab970e4f37c) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:07.033577 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1815282-61ba-4fe8-b809-f3d8668d1fc2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:07.035314 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1815282-61ba-4fe8-b809-f3d8668d1fc2 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:07.042624 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 383/767] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Apr 11 16:23:06 2022] GET /identity/v3/role_assignments?user.id=bb193a1a7abd430fbbcccab970e4f37c&scope.project.id=477b9d41390e455a82e733c4fc6acd6b&role.id=702e5e78b5d744529384b96a390ae92f => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:07.065856 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 385/768] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:23:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:23:07.090998 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1815282-61ba-4fe8-b809-f3d8668d1fc2 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:07.234335 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1815282-61ba-4fe8-b809-f3d8668d1fc2 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:07.274179 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de78db5-ab51-492a-b5e2-f39da89e5f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:07.275004 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de78db5-ab51-492a-b5e2-f39da89e5f8f None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:07.275354 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de78db5-ab51-492a-b5e2-f39da89e5f8f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:07.275659 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de78db5-ab51-492a-b5e2-f39da89e5f8f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:07.276324 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de78db5-ab51-492a-b5e2-f39da89e5f8f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:07.277689 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de78db5-ab51-492a-b5e2-f39da89e5f8f None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:07.291687 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-7de78db5-ab51-492a-b5e2-f39da89e5f8f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 11 16:23:07.293415 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 384/769] 10.222.0.43 () {56 vars in 1129 bytes} [Mon Apr 11 16:23:07 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:23:07.299111 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e085771e-a760-4ac4-a4b4-5a1afb2c8df2 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:07.406749 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e085771e-a760-4ac4-a4b4-5a1afb2c8df2 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:07.451228 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a9f6b1-90e3-4d6d-9cb6-d8222b633c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:07.451941 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9f6b1-90e3-4d6d-9cb6-d8222b633c4a None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:07.452227 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9f6b1-90e3-4d6d-9cb6-d8222b633c4a None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:07.452508 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9f6b1-90e3-4d6d-9cb6-d8222b633c4a None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:07.453225 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a9f6b1-90e3-4d6d-9cb6-d8222b633c4a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:07.453537 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a9f6b1-90e3-4d6d-9cb6-d8222b633c4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:07.454900 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a9f6b1-90e3-4d6d-9cb6-d8222b633c4a None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:07.463129 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 386/770] 10.222.0.43 () {56 vars in 1124 bytes} [Mon Apr 11 16:23:07 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:07.469609 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de78db5-ab51-492a-b5e2-f39da89e5f8f None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:07.610869 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de78db5-ab51-492a-b5e2-f39da89e5f8f None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:07.653125 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33358c7c-42f1-4b05-b752-eb202419744c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:07.654141 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33358c7c-42f1-4b05-b752-eb202419744c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:07.654640 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33358c7c-42f1-4b05-b752-eb202419744c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:07.655104 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33358c7c-42f1-4b05-b752-eb202419744c None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:07.656028 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33358c7c-42f1-4b05-b752-eb202419744c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:07.656530 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33358c7c-42f1-4b05-b752-eb202419744c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:07.658092 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33358c7c-42f1-4b05-b752-eb202419744c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:07.669191 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 385/771] 10.222.0.43 () {56 vars in 1124 bytes} [Mon Apr 11 16:23:07 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:07.675229 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a9f6b1-90e3-4d6d-9cb6-d8222b633c4a None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:07.805946 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a9f6b1-90e3-4d6d-9cb6-d8222b633c4a None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:07.843637 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735553b2-8590-4070-8067-e5ea97150748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:07.844315 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735553b2-8590-4070-8067-e5ea97150748 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:07.844601 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735553b2-8590-4070-8067-e5ea97150748 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:07.844874 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735553b2-8590-4070-8067-e5ea97150748 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:07.845664 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735553b2-8590-4070-8067-e5ea97150748 None admin] RBAC: Adding query filter params (interface=public, service_id=18812fc467c74f23b2516371a49a1d5e, region_id=RegionOne) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:07.845975 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735553b2-8590-4070-8067-e5ea97150748 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:07.847330 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735553b2-8590-4070-8067-e5ea97150748 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:07.857771 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 387/772] 10.222.0.43 () {56 vars in 1251 bytes} [Mon Apr 11 16:23:07 2022] GET /identity/v3/endpoints?service_id=18812fc467c74f23b2516371a49a1d5e&interface=public®ion_id=RegionOne => generated 194 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:07.863216 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33358c7c-42f1-4b05-b752-eb202419744c None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:07.998533 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33358c7c-42f1-4b05-b752-eb202419744c None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:08.038990 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a65ca5-a5d3-4753-811b-31e31f0d9c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:08.039689 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a65ca5-a5d3-4753-811b-31e31f0d9c22 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:08.039975 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a65ca5-a5d3-4753-811b-31e31f0d9c22 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:08.040251 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a65ca5-a5d3-4753-811b-31e31f0d9c22 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:08.041466 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a65ca5-a5d3-4753-811b-31e31f0d9c22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:08.042829 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a65ca5-a5d3-4753-811b-31e31f0d9c22 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:08.048538 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 386/773] 10.222.0.43 () {56 vars in 1087 bytes} [Mon Apr 11 16:23:07 2022] GET /identity/v3/services => generated 772 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:08.175697 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda80a3-6728-4b9a-bba5-8bc39e37909a None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:08.176201 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda80a3-6728-4b9a-bba5-8bc39e37909a None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:08.176201 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda80a3-6728-4b9a-bba5-8bc39e37909a None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:08.177910 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 388/774] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:23:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:23:08.183939 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25b9fa-6bbb-4c4b-9752-1bd9ca7f1c6b None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:08.184273 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25b9fa-6bbb-4c4b-9752-1bd9ca7f1c6b None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:08.184504 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25b9fa-6bbb-4c4b-9752-1bd9ca7f1c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:08.208722 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-4f25b9fa-6bbb-4c4b-9752-1bd9ca7f1c6b None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:23:08.209962 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-4f25b9fa-6bbb-4c4b-9752-1bd9ca7f1c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:23:08.297840 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 387/775] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:23:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:23:08.321583 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cda80a3-6728-4b9a-bba5-8bc39e37909a None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:08.432171 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cda80a3-6728-4b9a-bba5-8bc39e37909a None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:08.471776 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db8f0a-c973-4b87-bd7c-22d01239ce74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:08.471776 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db8f0a-c973-4b87-bd7c-22d01239ce74 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:08.471776 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db8f0a-c973-4b87-bd7c-22d01239ce74 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:08.471776 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db8f0a-c973-4b87-bd7c-22d01239ce74 None admin] PATH_INFO: `/v3/services/network` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:08.472163 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5db8f0a-c973-4b87-bd7c-22d01239ce74 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:08.472948 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5db8f0a-c973-4b87-bd7c-22d01239ce74 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:08.486503 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-d5db8f0a-c973-4b87-bd7c-22d01239ce74 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Apr 11 16:23:08.488135 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 389/776] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Apr 11 16:23:08 2022] GET /identity/v3/services/network => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:23:08.496691 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f25b9fa-6bbb-4c4b-9752-1bd9ca7f1c6b None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:08.651957 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f25b9fa-6bbb-4c4b-9752-1bd9ca7f1c6b None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:08.704278 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc45086-b08b-412d-a210-10081fe48310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:08.704875 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc45086-b08b-412d-a210-10081fe48310 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:08.705159 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc45086-b08b-412d-a210-10081fe48310 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:08.705437 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc45086-b08b-412d-a210-10081fe48310 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:08.706156 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc45086-b08b-412d-a210-10081fe48310 None admin] RBAC: Adding query filter params (name=network) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:08.706467 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc45086-b08b-412d-a210-10081fe48310 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:08.707929 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc45086-b08b-412d-a210-10081fe48310 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:08.712979 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 388/777] 10.222.0.43 () {56 vars in 1112 bytes} [Mon Apr 11 16:23:08 2022] GET /identity/v3/services?name=network => generated 124 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:08.718481 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db8f0a-c973-4b87-bd7c-22d01239ce74 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:08.866126 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db8f0a-c973-4b87-bd7c-22d01239ce74 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:08.900660 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663de6a8-5059-472c-975c-1cfc25f8cd4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:08.901718 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663de6a8-5059-472c-975c-1cfc25f8cd4d None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:08.902216 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663de6a8-5059-472c-975c-1cfc25f8cd4d None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:08.902689 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663de6a8-5059-472c-975c-1cfc25f8cd4d None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:08.903612 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663de6a8-5059-472c-975c-1cfc25f8cd4d None admin] RBAC: Adding query filter params (type=network) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:08.904185 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663de6a8-5059-472c-975c-1cfc25f8cd4d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:08.905796 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663de6a8-5059-472c-975c-1cfc25f8cd4d None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:08.911152 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 390/778] 10.222.0.43 () {56 vars in 1112 bytes} [Mon Apr 11 16:23:08 2022] GET /identity/v3/services?type=network => generated 350 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:08.917598 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc45086-b08b-412d-a210-10081fe48310 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:09.015864 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc45086-b08b-412d-a210-10081fe48310 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:09.049987 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1152c58f-a73d-43cc-a02a-f3efc5c686e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:09.051032 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1152c58f-a73d-43cc-a02a-f3efc5c686e7 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:09.051550 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1152c58f-a73d-43cc-a02a-f3efc5c686e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:09.052031 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1152c58f-a73d-43cc-a02a-f3efc5c686e7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:09.053050 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1152c58f-a73d-43cc-a02a-f3efc5c686e7 None admin] RBAC: Adding query filter params (interface=public, service_id=d0d728d7e4d0483c85f0a3cef90d3811, region_id=RegionOne) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:09.053575 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1152c58f-a73d-43cc-a02a-f3efc5c686e7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:09.055250 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1152c58f-a73d-43cc-a02a-f3efc5c686e7 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:09.064886 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 389/779] 10.222.0.43 () {56 vars in 1251 bytes} [Mon Apr 11 16:23:08 2022] GET /identity/v3/endpoints?service_id=d0d728d7e4d0483c85f0a3cef90d3811&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:09.070963 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663de6a8-5059-472c-975c-1cfc25f8cd4d None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:09.175581 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663de6a8-5059-472c-975c-1cfc25f8cd4d None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:09.211031 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8059bc-0c38-46b7-9a64-8143f30c96ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:09.212368 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8059bc-0c38-46b7-9a64-8143f30c96ce None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:09.212656 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8059bc-0c38-46b7-9a64-8143f30c96ce None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:09.212935 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8059bc-0c38-46b7-9a64-8143f30c96ce None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:09.213635 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8059bc-0c38-46b7-9a64-8143f30c96ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:09.215009 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8059bc-0c38-46b7-9a64-8143f30c96ce None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:09.224612 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 391/780] 10.222.0.43 () {56 vars in 1087 bytes} [Mon Apr 11 16:23:09 2022] GET /identity/v3/services => generated 772 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:09.522841 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d52daac-53d4-4c53-a25f-2b929dcefcc1 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:09.523185 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d52daac-53d4-4c53-a25f-2b929dcefcc1 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:09.523406 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d52daac-53d4-4c53-a25f-2b929dcefcc1 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:09.525150 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 390/781] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:23:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:23:09.530683 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3423e3a4-2d17-4684-9bdb-81e0bf57be4d None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:09.530978 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3423e3a4-2d17-4684-9bdb-81e0bf57be4d None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:09.531259 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3423e3a4-2d17-4684-9bdb-81e0bf57be4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:09.551371 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-3423e3a4-2d17-4684-9bdb-81e0bf57be4d None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:23:09.552664 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-3423e3a4-2d17-4684-9bdb-81e0bf57be4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:23:09.624872 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 392/782] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:23:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:23:09.648392 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d52daac-53d4-4c53-a25f-2b929dcefcc1 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:09.784894 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d52daac-53d4-4c53-a25f-2b929dcefcc1 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:09.827303 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e15a719-2526-4d38-853b-2b954f5fa676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:09.828185 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15a719-2526-4d38-853b-2b954f5fa676 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:09.828482 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15a719-2526-4d38-853b-2b954f5fa676 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:09.828760 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15a719-2526-4d38-853b-2b954f5fa676 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:09.843501 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e15a719-2526-4d38-853b-2b954f5fa676 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:23:09.850772 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-2e15a719-2526-4d38-853b-2b954f5fa676 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 16:23:09.853434 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 391/783] 10.222.0.43 () {56 vars in 1102 bytes} [Mon Apr 11 16:23:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:23:09.858448 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3423e3a4-2d17-4684-9bdb-81e0bf57be4d None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:09.958460 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3423e3a4-2d17-4684-9bdb-81e0bf57be4d None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:09.962240 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e50579-7dfe-4efb-b76e-f13a07abd827 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:09.962531 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e50579-7dfe-4efb-b76e-f13a07abd827 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:09.962811 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e50579-7dfe-4efb-b76e-f13a07abd827 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:09.964388 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 392/784] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:23:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:23:09.969241 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70caf5-1934-4b9d-b0db-3f1275c683d1 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:09.969524 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70caf5-1934-4b9d-b0db-3f1275c683d1 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:09.969802 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70caf5-1934-4b9d-b0db-3f1275c683d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:09.997471 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bee57e-d053-4976-be38-63195d95d1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:09.998512 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bee57e-d053-4976-be38-63195d95d1d0 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:09.998977 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bee57e-d053-4976-be38-63195d95d1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:09.999438 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bee57e-d053-4976-be38-63195d95d1d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:10.000393 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bee57e-d053-4976-be38-63195d95d1d0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:10.000518 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-fe70caf5-1934-4b9d-b0db-3f1275c683d1 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:23:10.001005 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bee57e-d053-4976-be38-63195d95d1d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:10.001662 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-fe70caf5-1934-4b9d-b0db-3f1275c683d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:23:10.002755 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bee57e-d053-4976-be38-63195d95d1d0 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:10.015038 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 393/785] 10.222.0.43 () {56 vars in 1103 bytes} [Mon Apr 11 16:23:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:10.020293 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bee57e-d053-4976-be38-63195d95d1d0 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:10.119557 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 393/786] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:23:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:23:10.121502 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c10f7a-14c2-48bf-b7f7-55cfc39719c0 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:10.122010 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c10f7a-14c2-48bf-b7f7-55cfc39719c0 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:10.122469 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c10f7a-14c2-48bf-b7f7-55cfc39719c0 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:10.124263 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 394/787] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:23:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:23:10.130580 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32074b75-3dbe-4184-8708-dff055bfad57 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:10.131123 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32074b75-3dbe-4184-8708-dff055bfad57 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:10.131607 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32074b75-3dbe-4184-8708-dff055bfad57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:10.149073 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-32074b75-3dbe-4184-8708-dff055bfad57 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:23:10.151081 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-32074b75-3dbe-4184-8708-dff055bfad57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:23:10.151592 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bee57e-d053-4976-be38-63195d95d1d0 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:10.188865 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ce240f-c7a2-442c-b809-188e53f0286a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:10.189774 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce240f-c7a2-442c-b809-188e53f0286a None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:10.190142 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce240f-c7a2-442c-b809-188e53f0286a None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:10.190485 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce240f-c7a2-442c-b809-188e53f0286a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:10.202389 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ce240f-c7a2-442c-b809-188e53f0286a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:10.203993 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ce240f-c7a2-442c-b809-188e53f0286a None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:10.221082 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 395/788] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:23:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:23:10.221219 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-33ce240f-c7a2-442c-b809-188e53f0286a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:23:10.222592 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32074b75-3dbe-4184-8708-dff055bfad57 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:10.231593 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 394/789] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:23:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:23:10.234962 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ce240f-c7a2-442c-b809-188e53f0286a None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:10.343351 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ce240f-c7a2-442c-b809-188e53f0286a None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:10.357307 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32074b75-3dbe-4184-8708-dff055bfad57 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:10.388654 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102f1a5d-10a7-4e8d-9eb2-3f2d6e4b9750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:10.389289 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f1a5d-10a7-4e8d-9eb2-3f2d6e4b9750 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:10.389578 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f1a5d-10a7-4e8d-9eb2-3f2d6e4b9750 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:10.389859 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f1a5d-10a7-4e8d-9eb2-3f2d6e4b9750 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:10.390858 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102f1a5d-10a7-4e8d-9eb2-3f2d6e4b9750 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:10.391172 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102f1a5d-10a7-4e8d-9eb2-3f2d6e4b9750 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:10.393338 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102f1a5d-10a7-4e8d-9eb2-3f2d6e4b9750 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:10.397693 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b8bc0d-2b60-4a65-9ff7-b67ac9015710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:10.398747 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8bc0d-2b60-4a65-9ff7-b67ac9015710 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:10.399235 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8bc0d-2b60-4a65-9ff7-b67ac9015710 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:10.400250 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8bc0d-2b60-4a65-9ff7-b67ac9015710 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:10.411669 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 395/790] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Apr 11 16:23:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:10.412805 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102f1a5d-10a7-4e8d-9eb2-3f2d6e4b9750 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:10.417045 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b8bc0d-2b60-4a65-9ff7-b67ac9015710 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:23:10.426290 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-b7b8bc0d-2b60-4a65-9ff7-b67ac9015710 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 16:23:10.428709 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 396/791] 10.222.0.43 () {56 vars in 1096 bytes} [Mon Apr 11 16:23:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:23:10.429835 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b8bc0d-2b60-4a65-9ff7-b67ac9015710 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:10.522864 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102f1a5d-10a7-4e8d-9eb2-3f2d6e4b9750 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:10.550877 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b8bc0d-2b60-4a65-9ff7-b67ac9015710 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:10.558076 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371f92e0-57d9-4f27-8acd-79162190345e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:10.558877 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f92e0-57d9-4f27-8acd-79162190345e None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:10.559154 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f92e0-57d9-4f27-8acd-79162190345e None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:10.559431 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f92e0-57d9-4f27-8acd-79162190345e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:10.569859 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371f92e0-57d9-4f27-8acd-79162190345e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:23:10.577040 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-371f92e0-57d9-4f27-8acd-79162190345e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 16:23:10.582887 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 396/792] 10.222.0.43 () {56 vars in 1096 bytes} [Mon Apr 11 16:23:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:23:10.583777 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371f92e0-57d9-4f27-8acd-79162190345e None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:10.589440 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f845c0-f315-41fd-b1d7-b19920371317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:10.590591 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f845c0-f315-41fd-b1d7-b19920371317 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:10.591124 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f845c0-f315-41fd-b1d7-b19920371317 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:10.591634 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f845c0-f315-41fd-b1d7-b19920371317 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:10.600050 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f845c0-f315-41fd-b1d7-b19920371317 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:10.601843 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f845c0-f315-41fd-b1d7-b19920371317 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:10.617658 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-c8f845c0-f315-41fd-b1d7-b19920371317 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 11 16:23:10.624473 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 397/793] 10.222.0.43 () {56 vars in 1117 bytes} [Mon Apr 11 16:23:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:23:10.625564 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f845c0-f315-41fd-b1d7-b19920371317 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:10.690739 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371f92e0-57d9-4f27-8acd-79162190345e None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:10.725339 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2347da0e-2447-4e7b-954f-d3820f472ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:10.726011 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2347da0e-2447-4e7b-954f-d3820f472ac1 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:10.726290 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2347da0e-2447-4e7b-954f-d3820f472ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:10.726563 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2347da0e-2447-4e7b-954f-d3820f472ac1 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:10.727311 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2347da0e-2447-4e7b-954f-d3820f472ac1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:10.727645 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2347da0e-2447-4e7b-954f-d3820f472ac1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:10.729522 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2347da0e-2447-4e7b-954f-d3820f472ac1 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:10.742830 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f845c0-f315-41fd-b1d7-b19920371317 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:10.744239 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 397/794] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Apr 11 16:23:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:10.745318 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2347da0e-2447-4e7b-954f-d3820f472ac1 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:10.781009 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cbb300-a058-40e5-8b92-b1e1876ca4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:10.782092 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cbb300-a058-40e5-8b92-b1e1876ca4c7 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:10.782579 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cbb300-a058-40e5-8b92-b1e1876ca4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:10.783084 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cbb300-a058-40e5-8b92-b1e1876ca4c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:10.784148 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cbb300-a058-40e5-8b92-b1e1876ca4c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:10.784660 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cbb300-a058-40e5-8b92-b1e1876ca4c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:10.786224 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cbb300-a058-40e5-8b92-b1e1876ca4c7 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:10.796049 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 398/795] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Apr 11 16:23:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:10.797295 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cbb300-a058-40e5-8b92-b1e1876ca4c7 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:10.852297 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2347da0e-2447-4e7b-954f-d3820f472ac1 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:10.892747 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b548aeef-684b-4c69-b3ba-9d68cfb15fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:10.893425 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b548aeef-684b-4c69-b3ba-9d68cfb15fe1 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:10.893706 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b548aeef-684b-4c69-b3ba-9d68cfb15fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:10.893980 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b548aeef-684b-4c69-b3ba-9d68cfb15fe1 None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:10.894816 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b548aeef-684b-4c69-b3ba-9d68cfb15fe1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:10.895124 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b548aeef-684b-4c69-b3ba-9d68cfb15fe1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:10.896895 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b548aeef-684b-4c69-b3ba-9d68cfb15fe1 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:10.909443 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cbb300-a058-40e5-8b92-b1e1876ca4c7 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:10.919059 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 398/796] 10.222.0.43 () {56 vars in 1149 bytes} [Mon Apr 11 16:23:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:10.919059 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b548aeef-684b-4c69-b3ba-9d68cfb15fe1 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:10.949183 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a28d164-fdda-47eb-ae85-191c9f89fde0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:10.950209 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28d164-fdda-47eb-ae85-191c9f89fde0 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:10.950638 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28d164-fdda-47eb-ae85-191c9f89fde0 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:10.951116 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28d164-fdda-47eb-ae85-191c9f89fde0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:10.963345 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a28d164-fdda-47eb-ae85-191c9f89fde0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:10.965065 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a28d164-fdda-47eb-ae85-191c9f89fde0 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:10.981909 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-2a28d164-fdda-47eb-ae85-191c9f89fde0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:23:10.983688 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 399/797] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:23:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:23:10.984641 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a28d164-fdda-47eb-ae85-191c9f89fde0 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:11.024540 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b548aeef-684b-4c69-b3ba-9d68cfb15fe1 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:11.060724 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56318ff3-0702-491d-ab30-8f638b188ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:11.062029 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56318ff3-0702-491d-ab30-8f638b188ed5 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:11.062029 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56318ff3-0702-491d-ab30-8f638b188ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:11.062227 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56318ff3-0702-491d-ab30-8f638b188ed5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:11.074891 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56318ff3-0702-491d-ab30-8f638b188ed5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:11.076391 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56318ff3-0702-491d-ab30-8f638b188ed5 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:11.088866 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a28d164-fdda-47eb-ae85-191c9f89fde0 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:11.093284 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-56318ff3-0702-491d-ab30-8f638b188ed5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:23:11.098794 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 399/798] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:23:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:23:11.098794 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56318ff3-0702-491d-ab30-8f638b188ed5 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:11.125841 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5f9383-b555-4184-b946-6c8975476da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:11.126648 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f9383-b555-4184-b946-6c8975476da8 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:11.126930 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f9383-b555-4184-b946-6c8975476da8 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:11.127207 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f9383-b555-4184-b946-6c8975476da8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:11.138122 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5f9383-b555-4184-b946-6c8975476da8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:11.139601 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5f9383-b555-4184-b946-6c8975476da8 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:11.158179 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-2d5f9383-b555-4184-b946-6c8975476da8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:23:11.164900 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 400/799] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:23:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:23:11.164900 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a14dc8-009c-4da5-ae99-feec59de14ab None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:11.164900 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a14dc8-009c-4da5-ae99-feec59de14ab None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:11.164900 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a14dc8-009c-4da5-ae99-feec59de14ab None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:11.164900 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 401/800] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:23:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:23:11.164900 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a14dc8-009c-4da5-ae99-feec59de14ab None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:11.212236 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56318ff3-0702-491d-ab30-8f638b188ed5 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:11.247653 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650349ea-0f16-429a-85d6-00c8a5ed2e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:11.248399 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650349ea-0f16-429a-85d6-00c8a5ed2e81 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:11.248620 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650349ea-0f16-429a-85d6-00c8a5ed2e81 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:11.248899 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650349ea-0f16-429a-85d6-00c8a5ed2e81 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:11.249623 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650349ea-0f16-429a-85d6-00c8a5ed2e81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:11.249934 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650349ea-0f16-429a-85d6-00c8a5ed2e81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:11.251300 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650349ea-0f16-429a-85d6-00c8a5ed2e81 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:11.263178 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 400/801] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Apr 11 16:23:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:11.263954 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650349ea-0f16-429a-85d6-00c8a5ed2e81 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:11.272988 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a14dc8-009c-4da5-ae99-feec59de14ab None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:11.308811 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ccbce2-ce09-4552-aec2-f5398254a111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:11.309492 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ccbce2-ce09-4552-aec2-f5398254a111 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:11.309782 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ccbce2-ce09-4552-aec2-f5398254a111 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:11.310065 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ccbce2-ce09-4552-aec2-f5398254a111 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:11.310799 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ccbce2-ce09-4552-aec2-f5398254a111 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:11.311113 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ccbce2-ce09-4552-aec2-f5398254a111 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:11.312518 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ccbce2-ce09-4552-aec2-f5398254a111 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:11.324340 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 402/802] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Apr 11 16:23:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:11.325567 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c0f4f3-e207-4430-9010-cb8e2ffa379a None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:11.325860 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c0f4f3-e207-4430-9010-cb8e2ffa379a None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:11.326141 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c0f4f3-e207-4430-9010-cb8e2ffa379a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:11.342696 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-a8c0f4f3-e207-4430-9010-cb8e2ffa379a None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:23:11.343939 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a8c0f4f3-e207-4430-9010-cb8e2ffa379a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:23:11.376067 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650349ea-0f16-429a-85d6-00c8a5ed2e81 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:11.410359 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090d4f63-b898-4e7e-bf78-263cf521caab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:11.411028 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d4f63-b898-4e7e-bf78-263cf521caab None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:11.411313 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d4f63-b898-4e7e-bf78-263cf521caab None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:11.411702 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d4f63-b898-4e7e-bf78-263cf521caab None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:11.412347 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090d4f63-b898-4e7e-bf78-263cf521caab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:11.412657 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090d4f63-b898-4e7e-bf78-263cf521caab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:11.423660 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 403/803] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:23:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:23:11.423803 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090d4f63-b898-4e7e-bf78-263cf521caab None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:11.423898 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c0f4f3-e207-4430-9010-cb8e2ffa379a None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:11.431046 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 401/804] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Apr 11 16:23:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:11.431989 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090d4f63-b898-4e7e-bf78-263cf521caab None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:11.543659 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c0f4f3-e207-4430-9010-cb8e2ffa379a None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:11.552788 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090d4f63-b898-4e7e-bf78-263cf521caab None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:11.577947 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b57ffa-3474-4ea5-9624-2eb77b020fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:11.578782 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b57ffa-3474-4ea5-9624-2eb77b020fe4 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:11.579066 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b57ffa-3474-4ea5-9624-2eb77b020fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:11.579344 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b57ffa-3474-4ea5-9624-2eb77b020fe4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:11.586335 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b57ffa-3474-4ea5-9624-2eb77b020fe4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:11.587866 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b57ffa-3474-4ea5-9624-2eb77b020fe4 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:11.588304 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc8d852-2504-4043-85d1-8c1bce1fb0f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:11.589420 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc8d852-2504-4043-85d1-8c1bce1fb0f0 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:11.589783 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc8d852-2504-4043-85d1-8c1bce1fb0f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:11.590134 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc8d852-2504-4043-85d1-8c1bce1fb0f0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:11.597540 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc8d852-2504-4043-85d1-8c1bce1fb0f0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:11.599006 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc8d852-2504-4043-85d1-8c1bce1fb0f0 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:11.601999 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-14b57ffa-3474-4ea5-9624-2eb77b020fe4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 11 16:23:11.603906 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 404/805] 10.222.0.43 () {56 vars in 1096 bytes} [Mon Apr 11 16:23:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:23:11.604731 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b57ffa-3474-4ea5-9624-2eb77b020fe4 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:11.617148 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-3cc8d852-2504-4043-85d1-8c1bce1fb0f0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 11 16:23:11.619799 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 402/806] 10.222.0.43 () {56 vars in 1093 bytes} [Mon Apr 11 16:23:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:23:11.620994 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc8d852-2504-4043-85d1-8c1bce1fb0f0 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:11.712276 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b57ffa-3474-4ea5-9624-2eb77b020fe4 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:11.721961 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc8d852-2504-4043-85d1-8c1bce1fb0f0 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:11.746111 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5eca29-388c-44af-9866-957568b31330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:11.746840 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5eca29-388c-44af-9866-957568b31330 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:11.747115 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5eca29-388c-44af-9866-957568b31330 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:11.747390 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5eca29-388c-44af-9866-957568b31330 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:11.754016 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5eca29-388c-44af-9866-957568b31330 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:11.755658 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5eca29-388c-44af-9866-957568b31330 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:11.758227 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c739d-a9e0-4d06-8a74-de1add040283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:11.759094 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c739d-a9e0-4d06-8a74-de1add040283 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:11.759397 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c739d-a9e0-4d06-8a74-de1add040283 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:11.759760 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c739d-a9e0-4d06-8a74-de1add040283 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:11.760422 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2c739d-a9e0-4d06-8a74-de1add040283 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:11.761781 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2c739d-a9e0-4d06-8a74-de1add040283 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:11.769963 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-ed5eca29-388c-44af-9866-957568b31330 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 16:23:11.771312 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 405/807] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Apr 11 16:23:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:23:11.772401 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5eca29-388c-44af-9866-957568b31330 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:11.772971 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-8a2c739d-a9e0-4d06-8a74-de1add040283 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 11 16:23:11.774290 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 403/808] 10.222.0.43 () {56 vars in 1129 bytes} [Mon Apr 11 16:23:11 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:23:11.777110 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c739d-a9e0-4d06-8a74-de1add040283 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:11.880446 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c739d-a9e0-4d06-8a74-de1add040283 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:11.892930 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5eca29-388c-44af-9866-957568b31330 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:11.914300 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d8bdb-f363-4447-b437-57e108bcbf24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:11.915085 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d8bdb-f363-4447-b437-57e108bcbf24 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:11.915901 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d8bdb-f363-4447-b437-57e108bcbf24 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:11.916180 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d8bdb-f363-4447-b437-57e108bcbf24 None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:11.917018 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2d8bdb-f363-4447-b437-57e108bcbf24 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:11.917325 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2d8bdb-f363-4447-b437-57e108bcbf24 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:11.918762 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2d8bdb-f363-4447-b437-57e108bcbf24 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:11.930443 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd20ede5-71c9-4dcf-9352-d75ff406ac6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:11.931678 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20ede5-71c9-4dcf-9352-d75ff406ac6e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:11.931965 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20ede5-71c9-4dcf-9352-d75ff406ac6e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:11.932244 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20ede5-71c9-4dcf-9352-d75ff406ac6e None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:11.933095 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd20ede5-71c9-4dcf-9352-d75ff406ac6e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:11.933404 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd20ede5-71c9-4dcf-9352-d75ff406ac6e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:11.934813 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd20ede5-71c9-4dcf-9352-d75ff406ac6e None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:11.941164 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 404/809] 10.222.0.43 () {56 vars in 1133 bytes} [Mon Apr 11 16:23:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:11.941164 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d8bdb-f363-4447-b437-57e108bcbf24 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:11.961625 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 406/810] 10.222.0.43 () {56 vars in 1135 bytes} [Mon Apr 11 16:23:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:11.961625 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd20ede5-71c9-4dcf-9352-d75ff406ac6e None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:12.047077 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d8bdb-f363-4447-b437-57e108bcbf24 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:12.052606 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd20ede5-71c9-4dcf-9352-d75ff406ac6e None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:12.079081 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ea9124-1bcc-4283-ba8d-c97001569970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:12.079766 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ea9124-1bcc-4283-ba8d-c97001569970 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:12.080044 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ea9124-1bcc-4283-ba8d-c97001569970 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:12.080322 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ea9124-1bcc-4283-ba8d-c97001569970 None admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:12.081095 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ea9124-1bcc-4283-ba8d-c97001569970 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:12.081405 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ea9124-1bcc-4283-ba8d-c97001569970 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:12.082965 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ea9124-1bcc-4283-ba8d-c97001569970 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:12.084789 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575d975-bf72-4377-aea3-455fcaff8fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:12.085441 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575d975-bf72-4377-aea3-455fcaff8fcd None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:12.085723 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575d975-bf72-4377-aea3-455fcaff8fcd None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:12.085999 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575d975-bf72-4377-aea3-455fcaff8fcd None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:12.086698 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4575d975-bf72-4377-aea3-455fcaff8fcd None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:12.087657 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4575d975-bf72-4377-aea3-455fcaff8fcd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:12.089133 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4575d975-bf72-4377-aea3-455fcaff8fcd None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:12.093407 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 407/811] 10.222.0.43 () {56 vars in 1124 bytes} [Mon Apr 11 16:23:11 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:12.094177 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575d975-bf72-4377-aea3-455fcaff8fcd None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:12.094698 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 405/812] 10.222.0.43 () {56 vars in 1148 bytes} [Mon Apr 11 16:23:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:12.095418 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ea9124-1bcc-4283-ba8d-c97001569970 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:12.188368 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ea9124-1bcc-4283-ba8d-c97001569970 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:12.190264 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575d975-bf72-4377-aea3-455fcaff8fcd None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:12.220979 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10052cf-5c5d-4183-bc59-de032e946d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:12.221764 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10052cf-5c5d-4183-bc59-de032e946d44 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:12.222042 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10052cf-5c5d-4183-bc59-de032e946d44 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:12.222310 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10052cf-5c5d-4183-bc59-de032e946d44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:12.222846 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf2cf9-6aa5-4e3d-a0e9-4cd47db5c73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:12.223480 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf2cf9-6aa5-4e3d-a0e9-4cd47db5c73c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:12.223789 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf2cf9-6aa5-4e3d-a0e9-4cd47db5c73c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:12.224060 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf2cf9-6aa5-4e3d-a0e9-4cd47db5c73c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:12.232423 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10052cf-5c5d-4183-bc59-de032e946d44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:12.233875 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10052cf-5c5d-4183-bc59-de032e946d44 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:12.250242 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-b10052cf-5c5d-4183-bc59-de032e946d44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:23:12.251433 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 406/813] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:23:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:23:12.252663 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676faa23-5a35-405c-98a1-4924580bd00f None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:12.252949 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676faa23-5a35-405c-98a1-4924580bd00f None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:12.253234 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676faa23-5a35-405c-98a1-4924580bd00f None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:12.256542 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 407/814] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:23:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:23:12.256542 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676faa23-5a35-405c-98a1-4924580bd00f None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:12.291308 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cf2cf9-6aa5-4e3d-a0e9-4cd47db5c73c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:12.292793 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cf2cf9-6aa5-4e3d-a0e9-4cd47db5c73c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:12.351425 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676faa23-5a35-405c-98a1-4924580bd00f None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:12.382801 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b793699e-1e54-4498-bbd3-cbfd12e1a8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:12.383084 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 408/815] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Apr 11 16:23:12 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 16:23:12.383465 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b793699e-1e54-4498-bbd3-cbfd12e1a8c2 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:12.384298 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b793699e-1e54-4498-bbd3-cbfd12e1a8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:12.384579 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b793699e-1e54-4498-bbd3-cbfd12e1a8c2 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:12.384773 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf2cf9-6aa5-4e3d-a0e9-4cd47db5c73c None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:12.385283 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b793699e-1e54-4498-bbd3-cbfd12e1a8c2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:12.385589 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b793699e-1e54-4498-bbd3-cbfd12e1a8c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:12.386966 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b793699e-1e54-4498-bbd3-cbfd12e1a8c2 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:12.396471 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 408/816] 10.222.0.43 () {56 vars in 1124 bytes} [Mon Apr 11 16:23:12 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:12.396471 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b793699e-1e54-4498-bbd3-cbfd12e1a8c2 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:12.476998 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf2cf9-6aa5-4e3d-a0e9-4cd47db5c73c None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:12.488158 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b793699e-1e54-4498-bbd3-cbfd12e1a8c2 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:12.522723 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e339aef8-d93c-4858-8857-b540e6d7dc96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:12.523652 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339aef8-d93c-4858-8857-b540e6d7dc96 None admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:12.523934 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339aef8-d93c-4858-8857-b540e6d7dc96 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:12.524206 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339aef8-d93c-4858-8857-b540e6d7dc96 None admin] PATH_INFO: `/v3/projects/477b9d41390e455a82e733c4fc6acd6b/users/3252c48fdd5747a29fe4ba89e7162216/roles/de92d251e74f470e95b6df12ece586b8` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:12.524653 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e93f477-faeb-4cae-9a2f-3197f247daa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:12.525392 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e93f477-faeb-4cae-9a2f-3197f247daa8 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:12.525710 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e93f477-faeb-4cae-9a2f-3197f247daa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:12.525990 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e93f477-faeb-4cae-9a2f-3197f247daa8 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:12.526739 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e93f477-faeb-4cae-9a2f-3197f247daa8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:12.527028 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e93f477-faeb-4cae-9a2f-3197f247daa8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:12.528502 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e93f477-faeb-4cae-9a2f-3197f247daa8 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:12.539420 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e339aef8-d93c-4858-8857-b540e6d7dc96 None admin] RBAC: Authorizing `identity:create_grant(project_id=477b9d41390e455a82e733c4fc6acd6b, user_id=3252c48fdd5747a29fe4ba89e7162216, role_id=de92d251e74f470e95b6df12ece586b8)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:12.541453 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e339aef8-d93c-4858-8857-b540e6d7dc96 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:12.541853 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 409/817] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Apr 11 16:23:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:12.543232 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a1c19-0aec-4029-97be-d6bbff5bafdc None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:12.543548 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a1c19-0aec-4029-97be-d6bbff5bafdc None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:12.543824 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a1c19-0aec-4029-97be-d6bbff5bafdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:12.560830 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-4f4a1c19-0aec-4029-97be-d6bbff5bafdc None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:23:12.562040 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-4f4a1c19-0aec-4029-97be-d6bbff5bafdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:23:12.627291 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 410/818] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:23:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:23:12.628195 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4a1c19-0aec-4029-97be-d6bbff5bafdc None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:12.630732 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 409/819] 10.222.0.43 () {58 vars in 1439 bytes} [Mon Apr 11 16:23:12 2022] PUT /identity/v3/projects/477b9d41390e455a82e733c4fc6acd6b/users/3252c48fdd5747a29fe4ba89e7162216/roles/de92d251e74f470e95b6df12ece586b8 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:23:12.631537 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e339aef8-d93c-4858-8857-b540e6d7dc96 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:12.761389 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4a1c19-0aec-4029-97be-d6bbff5bafdc None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:12.764521 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e339aef8-d93c-4858-8857-b540e6d7dc96 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:12.800830 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eb27a5-3ffb-4422-b613-dedd22b19c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:12.801688 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb27a5-3ffb-4422-b613-dedd22b19c8b None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:12.801970 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb27a5-3ffb-4422-b613-dedd22b19c8b None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:12.802246 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb27a5-3ffb-4422-b613-dedd22b19c8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:12.803395 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d982f7-5b08-4182-837d-383c69772c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:12.804130 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d982f7-5b08-4182-837d-383c69772c98 None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:12.804417 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d982f7-5b08-4182-837d-383c69772c98 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:12.804693 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d982f7-5b08-4182-837d-383c69772c98 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:12.805459 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d982f7-5b08-4182-837d-383c69772c98 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:12.807757 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d982f7-5b08-4182-837d-383c69772c98 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:12.815123 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eb27a5-3ffb-4422-b613-dedd22b19c8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:12.816640 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eb27a5-3ffb-4422-b613-dedd22b19c8b None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:12.835240 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-79eb27a5-3ffb-4422-b613-dedd22b19c8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:23:12.836846 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 411/820] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:23:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:23:12.837577 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eb27a5-3ffb-4422-b613-dedd22b19c8b None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:12.936111 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 410/821] 10.222.0.43 () {60 vars in 1144 bytes} [Mon Apr 11 16:23:12 2022] POST /identity/v3/endpoints => generated 346 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:23:12.937397 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d982f7-5b08-4182-837d-383c69772c98 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:12.939829 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eb27a5-3ffb-4422-b613-dedd22b19c8b None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:12.991440 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af99c839-c741-40ea-bdab-fb19ed3a9eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:12.992743 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99c839-c741-40ea-bdab-fb19ed3a9eaa None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:12.993102 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99c839-c741-40ea-bdab-fb19ed3a9eaa None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:12.993383 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99c839-c741-40ea-bdab-fb19ed3a9eaa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:13.001172 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af99c839-c741-40ea-bdab-fb19ed3a9eaa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:13.002665 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af99c839-c741-40ea-bdab-fb19ed3a9eaa None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:13.018492 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-af99c839-c741-40ea-bdab-fb19ed3a9eaa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 16:23:13.020178 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 412/822] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Apr 11 16:23:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:23:13.021059 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af99c839-c741-40ea-bdab-fb19ed3a9eaa None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:13.061438 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d982f7-5b08-4182-837d-383c69772c98 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:13.105912 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff10091c-3cd7-42d5-ad23-d3e912dc7d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:13.107279 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff10091c-3cd7-42d5-ad23-d3e912dc7d74 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:13.107591 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff10091c-3cd7-42d5-ad23-d3e912dc7d74 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:13.107870 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff10091c-3cd7-42d5-ad23-d3e912dc7d74 None admin] PATH_INFO: `/v3/services/network` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:13.108920 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff10091c-3cd7-42d5-ad23-d3e912dc7d74 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:13.110934 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff10091c-3cd7-42d5-ad23-d3e912dc7d74 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:13.126721 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-ff10091c-3cd7-42d5-ad23-d3e912dc7d74 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Apr 11 16:23:13.128269 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 411/823] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Apr 11 16:23:12 2022] GET /identity/v3/services/network => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:23:13.128959 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff10091c-3cd7-42d5-ad23-d3e912dc7d74 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:13.134346 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af99c839-c741-40ea-bdab-fb19ed3a9eaa None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:13.175133 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f3f4c1-3ea5-48dd-ae93-6d4078408be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:13.176424 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f3f4c1-3ea5-48dd-ae93-6d4078408be2 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:13.176424 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f3f4c1-3ea5-48dd-ae93-6d4078408be2 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:13.176424 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f3f4c1-3ea5-48dd-ae93-6d4078408be2 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:13.178031 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f3f4c1-3ea5-48dd-ae93-6d4078408be2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:13.178302 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f3f4c1-3ea5-48dd-ae93-6d4078408be2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:13.179737 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f3f4c1-3ea5-48dd-ae93-6d4078408be2 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:13.198235 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 413/824] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Apr 11 16:23:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:13.198235 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f3f4c1-3ea5-48dd-ae93-6d4078408be2 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:13.235801 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff10091c-3cd7-42d5-ad23-d3e912dc7d74 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:13.270555 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60d138b-97b4-4acf-b397-90ed568d27e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:13.271586 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60d138b-97b4-4acf-b397-90ed568d27e7 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:13.272074 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60d138b-97b4-4acf-b397-90ed568d27e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:13.272546 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60d138b-97b4-4acf-b397-90ed568d27e7 None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:13.273676 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60d138b-97b4-4acf-b397-90ed568d27e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:13.274251 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60d138b-97b4-4acf-b397-90ed568d27e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:13.276397 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60d138b-97b4-4acf-b397-90ed568d27e7 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:13.289216 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 412/825] 10.222.0.43 () {56 vars in 1148 bytes} [Mon Apr 11 16:23:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:13.290452 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60d138b-97b4-4acf-b397-90ed568d27e7 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:13.296405 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f3f4c1-3ea5-48dd-ae93-6d4078408be2 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:13.331044 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae12e21-2b54-4b48-8d01-fd82f814dfff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:13.331751 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae12e21-2b54-4b48-8d01-fd82f814dfff None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:13.332038 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae12e21-2b54-4b48-8d01-fd82f814dfff None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:13.332316 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae12e21-2b54-4b48-8d01-fd82f814dfff None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:13.333153 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae12e21-2b54-4b48-8d01-fd82f814dfff None admin] RBAC: Adding query filter params (name=network) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:13.333330 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae12e21-2b54-4b48-8d01-fd82f814dfff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:13.334687 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae12e21-2b54-4b48-8d01-fd82f814dfff None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:13.340466 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 414/826] 10.222.0.43 () {56 vars in 1112 bytes} [Mon Apr 11 16:23:13 2022] GET /identity/v3/services?name=network => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:13.341434 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae12e21-2b54-4b48-8d01-fd82f814dfff None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:13.394575 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60d138b-97b4-4acf-b397-90ed568d27e7 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:13.430038 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a8d942-b6d9-4724-be7a-c34c5c88fd75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:13.431239 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a8d942-b6d9-4724-be7a-c34c5c88fd75 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:13.431757 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a8d942-b6d9-4724-be7a-c34c5c88fd75 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:13.432254 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a8d942-b6d9-4724-be7a-c34c5c88fd75 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:13.439500 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a8d942-b6d9-4724-be7a-c34c5c88fd75 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:13.441238 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a8d942-b6d9-4724-be7a-c34c5c88fd75 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:13.442948 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae12e21-2b54-4b48-8d01-fd82f814dfff None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:13.455260 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-a0a8d942-b6d9-4724-be7a-c34c5c88fd75 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 16:23:13.461434 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 413/827] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Apr 11 16:23:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:23:13.463055 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a8d942-b6d9-4724-be7a-c34c5c88fd75 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:13.478996 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab9371f-c878-4d28-8987-062114d177f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:13.479925 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9371f-c878-4d28-8987-062114d177f1 None admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:13.480211 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9371f-c878-4d28-8987-062114d177f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:13.480900 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9371f-c878-4d28-8987-062114d177f1 None admin] PATH_INFO: `/v3/projects/477b9d41390e455a82e733c4fc6acd6b/users/bb193a1a7abd430fbbcccab970e4f37c/roles/702e5e78b5d744529384b96a390ae92f` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:13.482471 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab9371f-c878-4d28-8987-062114d177f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=477b9d41390e455a82e733c4fc6acd6b, user_id=bb193a1a7abd430fbbcccab970e4f37c, role_id=702e5e78b5d744529384b96a390ae92f)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:13.483924 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab9371f-c878-4d28-8987-062114d177f1 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:13.573171 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 415/828] 10.222.0.43 () {58 vars in 1439 bytes} [Mon Apr 11 16:23:13 2022] PUT /identity/v3/projects/477b9d41390e455a82e733c4fc6acd6b/users/bb193a1a7abd430fbbcccab970e4f37c/roles/702e5e78b5d744529384b96a390ae92f => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:23:13.574201 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab9371f-c878-4d28-8987-062114d177f1 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:13.577772 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a8d942-b6d9-4724-be7a-c34c5c88fd75 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:13.619022 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ec6d5-2f91-4c7c-94c1-653106d5a4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:13.621607 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ec6d5-2f91-4c7c-94c1-653106d5a4aa None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:13.622147 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ec6d5-2f91-4c7c-94c1-653106d5a4aa None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:13.622629 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ec6d5-2f91-4c7c-94c1-653106d5a4aa None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:13.623938 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925ec6d5-2f91-4c7c-94c1-653106d5a4aa None admin] RBAC: Adding query filter params (type=network) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:13.625331 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925ec6d5-2f91-4c7c-94c1-653106d5a4aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:13.627796 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925ec6d5-2f91-4c7c-94c1-653106d5a4aa None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:13.639654 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 414/829] 10.222.0.43 () {56 vars in 1112 bytes} [Mon Apr 11 16:23:13 2022] GET /identity/v3/services?type=network => generated 350 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:13.646990 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ec6d5-2f91-4c7c-94c1-653106d5a4aa None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:13.786170 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab9371f-c878-4d28-8987-062114d177f1 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:13.829009 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ddd892-adf3-4052-a189-1a3f774f0f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:13.829723 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ddd892-adf3-4052-a189-1a3f774f0f0f None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:13.830006 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ddd892-adf3-4052-a189-1a3f774f0f0f None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:13.830291 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ddd892-adf3-4052-a189-1a3f774f0f0f None admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:13.831083 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ddd892-adf3-4052-a189-1a3f774f0f0f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:13.831399 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ddd892-adf3-4052-a189-1a3f774f0f0f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:13.832919 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ddd892-adf3-4052-a189-1a3f774f0f0f None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:13.835028 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ec6d5-2f91-4c7c-94c1-653106d5a4aa None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:13.847740 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 416/830] 10.222.0.43 () {56 vars in 1148 bytes} [Mon Apr 11 16:23:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:13.854362 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ddd892-adf3-4052-a189-1a3f774f0f0f None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:13.874187 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2115ef03-06b9-4d51-aa92-e53b364b43c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:13.875312 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115ef03-06b9-4d51-aa92-e53b364b43c7 None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:13.875776 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115ef03-06b9-4d51-aa92-e53b364b43c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:13.876061 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115ef03-06b9-4d51-aa92-e53b364b43c7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:13.876873 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2115ef03-06b9-4d51-aa92-e53b364b43c7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:13.878779 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2115ef03-06b9-4d51-aa92-e53b364b43c7 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:13.981513 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 415/831] 10.222.0.43 () {60 vars in 1144 bytes} [Mon Apr 11 16:23:13 2022] POST /identity/v3/endpoints => generated 327 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:23:13.987918 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ddd892-adf3-4052-a189-1a3f774f0f0f None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:14.040213 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa2b81a-3fce-472b-9579-0a9e99dbd8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:14.041725 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa2b81a-3fce-472b-9579-0a9e99dbd8c5 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:14.042490 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa2b81a-3fce-472b-9579-0a9e99dbd8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:14.043254 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa2b81a-3fce-472b-9579-0a9e99dbd8c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:14.045137 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa2b81a-3fce-472b-9579-0a9e99dbd8c5 None admin] RBAC: Adding query filter params (role.id=702e5e78b5d744529384b96a390ae92f, scope.project.id=477b9d41390e455a82e733c4fc6acd6b, user.id=1be2652c984a4283aeee0b937f0555e4) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:14.045901 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa2b81a-3fce-472b-9579-0a9e99dbd8c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:14.047601 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa2b81a-3fce-472b-9579-0a9e99dbd8c5 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:14.061027 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 417/832] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Apr 11 16:23:13 2022] GET /identity/v3/role_assignments?user.id=1be2652c984a4283aeee0b937f0555e4&scope.project.id=477b9d41390e455a82e733c4fc6acd6b&role.id=702e5e78b5d744529384b96a390ae92f => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:23:15.050800 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06485795-488e-4639-aae7-f21e524725b2 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:15.051947 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06485795-488e-4639-aae7-f21e524725b2 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:15.052245 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06485795-488e-4639-aae7-f21e524725b2 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:15.053993 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 416/833] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:23:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:23:15.060446 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b7159-0173-4187-89b8-4ecddfec08eb None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:15.060965 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b7159-0173-4187-89b8-4ecddfec08eb None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:15.061037 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b7159-0173-4187-89b8-4ecddfec08eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:15.077984 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-9c7b7159-0173-4187-89b8-4ecddfec08eb None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:23:15.079489 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-9c7b7159-0173-4187-89b8-4ecddfec08eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:23:15.153010 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 418/834] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:23:15 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:23:15.178535 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06485795-488e-4639-aae7-f21e524725b2 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:15.286428 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06485795-488e-4639-aae7-f21e524725b2 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:15.322605 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5111664-be17-4527-9cb9-dad4d58c07cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:15.323334 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5111664-be17-4527-9cb9-dad4d58c07cb None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:15.323651 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5111664-be17-4527-9cb9-dad4d58c07cb None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:15.323935 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5111664-be17-4527-9cb9-dad4d58c07cb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:15.334154 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5111664-be17-4527-9cb9-dad4d58c07cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:23:15.342413 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-a5111664-be17-4527-9cb9-dad4d58c07cb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 16:23:15.343923 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 417/835] 10.222.0.43 () {56 vars in 1102 bytes} [Mon Apr 11 16:23:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:23:15.349653 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b7159-0173-4187-89b8-4ecddfec08eb None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:15.455264 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b7159-0173-4187-89b8-4ecddfec08eb None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:15.494942 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c68b572-45a3-4ae1-a777-66951e53447a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:15.495663 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68b572-45a3-4ae1-a777-66951e53447a None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:15.495955 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68b572-45a3-4ae1-a777-66951e53447a None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:15.496235 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68b572-45a3-4ae1-a777-66951e53447a None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:15.496992 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c68b572-45a3-4ae1-a777-66951e53447a None admin] RBAC: Adding query filter params (name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:15.497305 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c68b572-45a3-4ae1-a777-66951e53447a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:15.498680 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c68b572-45a3-4ae1-a777-66951e53447a None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:15.507574 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 419/836] 10.222.0.43 () {56 vars in 1103 bytes} [Mon Apr 11 16:23:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:15.514633 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5111664-be17-4527-9cb9-dad4d58c07cb None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:15.568945 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51641f8-0e75-438c-aa85-f6410cefbb88 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:15.569653 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51641f8-0e75-438c-aa85-f6410cefbb88 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:15.569943 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51641f8-0e75-438c-aa85-f6410cefbb88 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:15.572924 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 420/837] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:23:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 16:23:15.577932 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae9b77-73ef-4d00-b9ab-9ca38f47049f None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:15.578222 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae9b77-73ef-4d00-b9ab-9ca38f47049f None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:15.578503 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae9b77-73ef-4d00-b9ab-9ca38f47049f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:15.606810 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-68ae9b77-73ef-4d00-b9ab-9ca38f47049f None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:23:15.608060 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-68ae9b77-73ef-4d00-b9ab-9ca38f47049f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:23:15.639089 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5111664-be17-4527-9cb9-dad4d58c07cb None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:15.673814 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866c5dc8-295f-40e6-b701-da77c56fb3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:15.675013 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866c5dc8-295f-40e6-b701-da77c56fb3a2 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:15.675541 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866c5dc8-295f-40e6-b701-da77c56fb3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:15.676017 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866c5dc8-295f-40e6-b701-da77c56fb3a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:15.688076 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866c5dc8-295f-40e6-b701-da77c56fb3a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:15.689854 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866c5dc8-295f-40e6-b701-da77c56fb3a2 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:15.699539 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 421/838] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:23:15 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 16:23:15.710135 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-866c5dc8-295f-40e6-b701-da77c56fb3a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:23:15.711787 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 418/839] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:23:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:23:15.717363 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae9b77-73ef-4d00-b9ab-9ca38f47049f None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:15.723739 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866c5dc8-295f-40e6-b701-da77c56fb3a2 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:15.834000 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae9b77-73ef-4d00-b9ab-9ca38f47049f None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:15.841025 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866c5dc8-295f-40e6-b701-da77c56fb3a2 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:15.871419 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1b2048-163c-44e7-b80d-fc4cb2b08a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:15.872631 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b2048-163c-44e7-b80d-fc4cb2b08a82 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:15.873118 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b2048-163c-44e7-b80d-fc4cb2b08a82 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:15.873618 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b2048-163c-44e7-b80d-fc4cb2b08a82 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:15.874485 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1b2048-163c-44e7-b80d-fc4cb2b08a82 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:15.876117 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1b2048-163c-44e7-b80d-fc4cb2b08a82 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:15.876820 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d83a835-f68e-4950-8bce-c0366591949d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:15.877499 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d83a835-f68e-4950-8bce-c0366591949d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:15.877784 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d83a835-f68e-4950-8bce-c0366591949d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:15.878062 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d83a835-f68e-4950-8bce-c0366591949d None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:15.878791 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d83a835-f68e-4950-8bce-c0366591949d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:15.879098 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d83a835-f68e-4950-8bce-c0366591949d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:15.880621 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d83a835-f68e-4950-8bce-c0366591949d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:15.890309 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-0d1b2048-163c-44e7-b80d-fc4cb2b08a82 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 11 16:23:15.895544 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 419/840] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Apr 11 16:23:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:15.895685 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 422/841] 10.222.0.43 () {56 vars in 1114 bytes} [Mon Apr 11 16:23:15 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:23:15.901595 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d83a835-f68e-4950-8bce-c0366591949d None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:15.904060 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1b2048-163c-44e7-b80d-fc4cb2b08a82 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:16.001371 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d83a835-f68e-4950-8bce-c0366591949d None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:16.005190 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1b2048-163c-44e7-b80d-fc4cb2b08a82 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:16.036023 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff5f604-0497-4455-a19e-4faf54245ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:16.036829 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5f604-0497-4455-a19e-4faf54245ad7 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:16.037110 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5f604-0497-4455-a19e-4faf54245ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:16.037383 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5f604-0497-4455-a19e-4faf54245ad7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:16.042004 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be178b0-aa9a-40e6-90c7-3dcef784c3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:16.042957 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be178b0-aa9a-40e6-90c7-3dcef784c3b0 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:16.043463 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be178b0-aa9a-40e6-90c7-3dcef784c3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:16.043978 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be178b0-aa9a-40e6-90c7-3dcef784c3b0 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:16.044884 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be178b0-aa9a-40e6-90c7-3dcef784c3b0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:16.045064 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff5f604-0497-4455-a19e-4faf54245ad7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:16.045555 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be178b0-aa9a-40e6-90c7-3dcef784c3b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:16.046641 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff5f604-0497-4455-a19e-4faf54245ad7 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:16.047406 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be178b0-aa9a-40e6-90c7-3dcef784c3b0 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:16.057103 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 423/842] 10.222.0.43 () {56 vars in 1114 bytes} [Mon Apr 11 16:23:15 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:23:16.058292 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be178b0-aa9a-40e6-90c7-3dcef784c3b0 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:16.061249 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-2ff5f604-0497-4455-a19e-4faf54245ad7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 11 16:23:16.067183 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 420/843] 10.222.0.43 () {56 vars in 1117 bytes} [Mon Apr 11 16:23:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:23:16.068389 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff5f604-0497-4455-a19e-4faf54245ad7 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:16.161245 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be178b0-aa9a-40e6-90c7-3dcef784c3b0 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:16.169002 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff5f604-0497-4455-a19e-4faf54245ad7 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:16.194806 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d06de37-cec7-43d1-bda9-d861666ee58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:16.195543 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d06de37-cec7-43d1-bda9-d861666ee58f None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:16.196407 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d06de37-cec7-43d1-bda9-d861666ee58f None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:16.196681 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d06de37-cec7-43d1-bda9-d861666ee58f None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:16.197381 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d06de37-cec7-43d1-bda9-d861666ee58f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:16.197686 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d06de37-cec7-43d1-bda9-d861666ee58f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:16.199038 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d06de37-cec7-43d1-bda9-d861666ee58f None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:16.202596 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b63b532-3690-4646-9fa0-f6f438517a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:16.211983 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63b532-3690-4646-9fa0-f6f438517a38 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:16.212217 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 424/844] 10.222.0.43 () {56 vars in 1114 bytes} [Mon Apr 11 16:23:16 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:16.212315 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63b532-3690-4646-9fa0-f6f438517a38 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:16.212315 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63b532-3690-4646-9fa0-f6f438517a38 None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:16.212461 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3b6a1-7844-4fcf-9fe9-def5a702ce03 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:16.212740 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b63b532-3690-4646-9fa0-f6f438517a38 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:16.212834 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3b6a1-7844-4fcf-9fe9-def5a702ce03 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:16.212915 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b63b532-3690-4646-9fa0-f6f438517a38 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:16.212993 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3b6a1-7844-4fcf-9fe9-def5a702ce03 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:16.213069 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b63b532-3690-4646-9fa0-f6f438517a38 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:16.213156 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 425/845] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:23:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:23:16.214494 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed4aa8b-330f-44ca-9999-92bc1e0e28b1 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:16.214885 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed4aa8b-330f-44ca-9999-92bc1e0e28b1 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:16.215229 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed4aa8b-330f-44ca-9999-92bc1e0e28b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:16.231963 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 421/846] 10.222.0.43 () {56 vars in 1149 bytes} [Mon Apr 11 16:23:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:16.237935 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b63b532-3690-4646-9fa0-f6f438517a38 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:16.244010 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-aed4aa8b-330f-44ca-9999-92bc1e0e28b1 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:23:16.245679 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-aed4aa8b-330f-44ca-9999-92bc1e0e28b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:23:16.322075 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 426/847] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:23:16 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:23:16.354051 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed4aa8b-330f-44ca-9999-92bc1e0e28b1 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:16.358307 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b63b532-3690-4646-9fa0-f6f438517a38 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:16.394001 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652ff7b4-eaa3-4927-8f8d-8eaef873ac44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:16.395052 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ff7b4-eaa3-4927-8f8d-8eaef873ac44 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:16.395721 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ff7b4-eaa3-4927-8f8d-8eaef873ac44 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:16.396196 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ff7b4-eaa3-4927-8f8d-8eaef873ac44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:16.470156 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652ff7b4-eaa3-4927-8f8d-8eaef873ac44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:16.472167 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652ff7b4-eaa3-4927-8f8d-8eaef873ac44 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:16.483304 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed4aa8b-330f-44ca-9999-92bc1e0e28b1 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:16.520226 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce57cb06-a417-4fad-adb8-121320411b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:16.521745 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce57cb06-a417-4fad-adb8-121320411b37 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:16.522119 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce57cb06-a417-4fad-adb8-121320411b37 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:16.522465 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce57cb06-a417-4fad-adb8-121320411b37 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:16.535962 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce57cb06-a417-4fad-adb8-121320411b37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:23:16.546698 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-ce57cb06-a417-4fad-adb8-121320411b37 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 16:23:16.548546 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 427/848] 10.222.0.43 () {56 vars in 1096 bytes} [Mon Apr 11 16:23:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:23:16.554261 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce57cb06-a417-4fad-adb8-121320411b37 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:16.596562 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 422/849] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Apr 11 16:23:16 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 11 16:23:16.603348 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652ff7b4-eaa3-4927-8f8d-8eaef873ac44 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:16.663802 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce57cb06-a417-4fad-adb8-121320411b37 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:16.704712 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516b5528-6ffd-4dfb-bb28-6c79be7e9274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:16.705401 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b5528-6ffd-4dfb-bb28-6c79be7e9274 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:16.705692 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b5528-6ffd-4dfb-bb28-6c79be7e9274 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:16.705968 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b5528-6ffd-4dfb-bb28-6c79be7e9274 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:16.706731 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516b5528-6ffd-4dfb-bb28-6c79be7e9274 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:16.707031 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516b5528-6ffd-4dfb-bb28-6c79be7e9274 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:16.708495 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516b5528-6ffd-4dfb-bb28-6c79be7e9274 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:16.723240 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 428/850] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Apr 11 16:23:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:16.723240 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066d5f3-14c5-4233-b543-44ecffe1c3b4 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:16.723240 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066d5f3-14c5-4233-b543-44ecffe1c3b4 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:16.723240 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066d5f3-14c5-4233-b543-44ecffe1c3b4 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:16.723240 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 429/851] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:23:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:23:16.724764 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8066d5f3-14c5-4233-b543-44ecffe1c3b4 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:16.734002 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652ff7b4-eaa3-4927-8f8d-8eaef873ac44 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:16.771729 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec7a8a-9f69-4118-b66e-10bde45c8f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:16.772556 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec7a8a-9f69-4118-b66e-10bde45c8f6f None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:16.772838 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec7a8a-9f69-4118-b66e-10bde45c8f6f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:16.773109 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec7a8a-9f69-4118-b66e-10bde45c8f6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:16.783739 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ec7a8a-9f69-4118-b66e-10bde45c8f6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:16.785283 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ec7a8a-9f69-4118-b66e-10bde45c8f6f None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:16.801897 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-49ec7a8a-9f69-4118-b66e-10bde45c8f6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:23:16.803169 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 423/852] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:23:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:23:16.804437 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc8275-1acc-43b8-b32d-636299c44041 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:16.804791 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc8275-1acc-43b8-b32d-636299c44041 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:16.805212 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc8275-1acc-43b8-b32d-636299c44041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:16.822846 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-2ddc8275-1acc-43b8-b32d-636299c44041 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:23:16.824066 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-2ddc8275-1acc-43b8-b32d-636299c44041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:23:16.833504 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8066d5f3-14c5-4233-b543-44ecffe1c3b4 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:16.869839 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd435ffc-5a2f-4cd4-bd77-f12e9938d250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:16.870762 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd435ffc-5a2f-4cd4-bd77-f12e9938d250 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:16.871045 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd435ffc-5a2f-4cd4-bd77-f12e9938d250 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:16.871319 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd435ffc-5a2f-4cd4-bd77-f12e9938d250 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:16.881722 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd435ffc-5a2f-4cd4-bd77-f12e9938d250 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:16.883717 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd435ffc-5a2f-4cd4-bd77-f12e9938d250 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:16.891577 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 424/853] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:23:16 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:23:16.891723 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc8275-1acc-43b8-b32d-636299c44041 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:16.904777 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-fd435ffc-5a2f-4cd4-bd77-f12e9938d250 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:23:16.906501 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 430/854] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:23:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:23:16.912704 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd435ffc-5a2f-4cd4-bd77-f12e9938d250 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:16.998298 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc8275-1acc-43b8-b32d-636299c44041 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:17.009591 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd435ffc-5a2f-4cd4-bd77-f12e9938d250 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:17.032661 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17714452-eb03-4fc9-b8b9-d50f413c2dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:17.033589 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17714452-eb03-4fc9-b8b9-d50f413c2dc8 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:17.034014 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17714452-eb03-4fc9-b8b9-d50f413c2dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:17.034427 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17714452-eb03-4fc9-b8b9-d50f413c2dc8 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:17.035365 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17714452-eb03-4fc9-b8b9-d50f413c2dc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:17.035862 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17714452-eb03-4fc9-b8b9-d50f413c2dc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:17.037415 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17714452-eb03-4fc9-b8b9-d50f413c2dc8 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:17.042053 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8b18f5-8d83-49e5-a992-8fc8e34da4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:17.042745 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b18f5-8d83-49e5-a992-8fc8e34da4b7 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:17.043030 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b18f5-8d83-49e5-a992-8fc8e34da4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:17.043308 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b18f5-8d83-49e5-a992-8fc8e34da4b7 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:17.044061 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8b18f5-8d83-49e5-a992-8fc8e34da4b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:17.044369 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8b18f5-8d83-49e5-a992-8fc8e34da4b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:17.045831 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8b18f5-8d83-49e5-a992-8fc8e34da4b7 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:17.050629 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 425/855] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Apr 11 16:23:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:17.051632 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17714452-eb03-4fc9-b8b9-d50f413c2dc8 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:17.062690 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 431/856] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Apr 11 16:23:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:17.062690 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8b18f5-8d83-49e5-a992-8fc8e34da4b7 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:17.153103 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17714452-eb03-4fc9-b8b9-d50f413c2dc8 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:17.160626 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8b18f5-8d83-49e5-a992-8fc8e34da4b7 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:17.186569 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92003983-89c2-4ef6-aa39-b0339a76389a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:17.187386 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92003983-89c2-4ef6-aa39-b0339a76389a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:17.187702 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92003983-89c2-4ef6-aa39-b0339a76389a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:17.187973 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92003983-89c2-4ef6-aa39-b0339a76389a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:17.188626 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92003983-89c2-4ef6-aa39-b0339a76389a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:17.189973 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92003983-89c2-4ef6-aa39-b0339a76389a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:17.198617 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c327070d-fbe9-4378-b84a-1191a3b28154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:17.199412 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c327070d-fbe9-4378-b84a-1191a3b28154 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:17.199720 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c327070d-fbe9-4378-b84a-1191a3b28154 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:17.199994 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c327070d-fbe9-4378-b84a-1191a3b28154 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:17.201834 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-92003983-89c2-4ef6-aa39-b0339a76389a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 11 16:23:17.207555 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 426/857] 10.222.0.43 () {56 vars in 1132 bytes} [Mon Apr 11 16:23:17 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:23:17.207555 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92003983-89c2-4ef6-aa39-b0339a76389a None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:17.210265 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c327070d-fbe9-4378-b84a-1191a3b28154 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:17.211802 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c327070d-fbe9-4378-b84a-1191a3b28154 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:17.225192 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-c327070d-fbe9-4378-b84a-1191a3b28154 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 16:23:17.231091 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 432/858] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Apr 11 16:23:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:23:17.231091 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c327070d-fbe9-4378-b84a-1191a3b28154 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:17.318724 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92003983-89c2-4ef6-aa39-b0339a76389a None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:17.328103 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c327070d-fbe9-4378-b84a-1191a3b28154 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:17.351997 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47831c1-8013-41ea-b814-29f18968ce75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:17.353149 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47831c1-8013-41ea-b814-29f18968ce75 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:17.353430 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47831c1-8013-41ea-b814-29f18968ce75 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:17.353705 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47831c1-8013-41ea-b814-29f18968ce75 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:17.360225 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a5a164-69bb-45ee-be38-174a9d3fc8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:17.360886 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5a164-69bb-45ee-be38-174a9d3fc8b4 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:17.361168 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5a164-69bb-45ee-be38-174a9d3fc8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:17.361266 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47831c1-8013-41ea-b814-29f18968ce75 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:17.361443 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5a164-69bb-45ee-be38-174a9d3fc8b4 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:17.362133 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a5a164-69bb-45ee-be38-174a9d3fc8b4 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:17.362441 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a5a164-69bb-45ee-be38-174a9d3fc8b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:17.362599 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47831c1-8013-41ea-b814-29f18968ce75 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:17.363795 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a5a164-69bb-45ee-be38-174a9d3fc8b4 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:17.373330 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 433/859] 10.222.0.43 () {56 vars in 1126 bytes} [Mon Apr 11 16:23:17 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:17.373330 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a5a164-69bb-45ee-be38-174a9d3fc8b4 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:17.381580 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-c47831c1-8013-41ea-b814-29f18968ce75 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 11 16:23:17.387834 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 427/860] 10.222.0.43 () {56 vars in 1096 bytes} [Mon Apr 11 16:23:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:23:17.387834 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47831c1-8013-41ea-b814-29f18968ce75 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:17.472879 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a5a164-69bb-45ee-be38-174a9d3fc8b4 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:17.491620 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47831c1-8013-41ea-b814-29f18968ce75 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:17.509973 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a27b18-59b2-4774-b4b3-88fc171ab725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:17.510647 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a27b18-59b2-4774-b4b3-88fc171ab725 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:17.510927 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a27b18-59b2-4774-b4b3-88fc171ab725 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:17.511199 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a27b18-59b2-4774-b4b3-88fc171ab725 None admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:17.512011 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a27b18-59b2-4774-b4b3-88fc171ab725 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:17.512319 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a27b18-59b2-4774-b4b3-88fc171ab725 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:17.513805 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a27b18-59b2-4774-b4b3-88fc171ab725 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:17.530987 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f098a47b-a98d-4e82-bb9e-6454a8c4df43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:17.531188 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 434/861] 10.222.0.43 () {56 vars in 1148 bytes} [Mon Apr 11 16:23:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:17.531282 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f098a47b-a98d-4e82-bb9e-6454a8c4df43 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:17.531367 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a27b18-59b2-4774-b4b3-88fc171ab725 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:17.531435 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f098a47b-a98d-4e82-bb9e-6454a8c4df43 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:17.531435 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f098a47b-a98d-4e82-bb9e-6454a8c4df43 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:17.531435 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f098a47b-a98d-4e82-bb9e-6454a8c4df43 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:17.531435 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f098a47b-a98d-4e82-bb9e-6454a8c4df43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:17.531435 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f098a47b-a98d-4e82-bb9e-6454a8c4df43 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:17.533828 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 428/862] 10.222.0.43 () {56 vars in 1126 bytes} [Mon Apr 11 16:23:17 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:17.534786 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f098a47b-a98d-4e82-bb9e-6454a8c4df43 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:17.649298 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f098a47b-a98d-4e82-bb9e-6454a8c4df43 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:17.677749 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a27b18-59b2-4774-b4b3-88fc171ab725 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:17.686264 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa59c1c-3935-4b9d-8581-33a7e499f8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:17.687233 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa59c1c-3935-4b9d-8581-33a7e499f8e6 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:17.687697 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa59c1c-3935-4b9d-8581-33a7e499f8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:17.688137 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa59c1c-3935-4b9d-8581-33a7e499f8e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:17.689181 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa59c1c-3935-4b9d-8581-33a7e499f8e6 None admin] RBAC: Adding query filter params (role.id=de92d251e74f470e95b6df12ece586b8, scope.project.id=477b9d41390e455a82e733c4fc6acd6b, user.id=3252c48fdd5747a29fe4ba89e7162216) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:17.689641 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa59c1c-3935-4b9d-8581-33a7e499f8e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:17.691220 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa59c1c-3935-4b9d-8581-33a7e499f8e6 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:17.703987 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 429/863] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Apr 11 16:23:17 2022] GET /identity/v3/role_assignments?user.id=3252c48fdd5747a29fe4ba89e7162216&scope.project.id=477b9d41390e455a82e733c4fc6acd6b&role.id=de92d251e74f470e95b6df12ece586b8 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:17.719744 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5bf338-8ab8-493d-9e3d-0a5cef74c448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:17.720456 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5bf338-8ab8-493d-9e3d-0a5cef74c448 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:17.720740 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5bf338-8ab8-493d-9e3d-0a5cef74c448 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:17.721017 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5bf338-8ab8-493d-9e3d-0a5cef74c448 None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:17.721879 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5bf338-8ab8-493d-9e3d-0a5cef74c448 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:17.722190 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5bf338-8ab8-493d-9e3d-0a5cef74c448 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:17.723687 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5bf338-8ab8-493d-9e3d-0a5cef74c448 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:17.745485 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 435/864] 10.222.0.43 () {56 vars in 1135 bytes} [Mon Apr 11 16:23:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:17.751318 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa59c1c-3935-4b9d-8581-33a7e499f8e6 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:17.865695 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa59c1c-3935-4b9d-8581-33a7e499f8e6 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:17.904425 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62547325-68cf-4ed7-b54c-cac447bbf6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:17.905008 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62547325-68cf-4ed7-b54c-cac447bbf6c0 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:17.905333 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62547325-68cf-4ed7-b54c-cac447bbf6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:17.905617 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62547325-68cf-4ed7-b54c-cac447bbf6c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:17.975390 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62547325-68cf-4ed7-b54c-cac447bbf6c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:17.978294 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62547325-68cf-4ed7-b54c-cac447bbf6c0 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:18.081947 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 430/865] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Apr 11 16:23:17 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 11 16:23:18.084585 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5bf338-8ab8-493d-9e3d-0a5cef74c448 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:18.189799 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5bf338-8ab8-493d-9e3d-0a5cef74c448 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:18.224277 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8508a7e7-ab9b-4254-a0f8-a2591d5b5a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:18.225083 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508a7e7-ab9b-4254-a0f8-a2591d5b5a72 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:18.225363 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508a7e7-ab9b-4254-a0f8-a2591d5b5a72 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:18.225635 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508a7e7-ab9b-4254-a0f8-a2591d5b5a72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:18.239731 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8508a7e7-ab9b-4254-a0f8-a2591d5b5a72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:18.241816 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8508a7e7-ab9b-4254-a0f8-a2591d5b5a72 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:18.261785 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-8508a7e7-ab9b-4254-a0f8-a2591d5b5a72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:23:18.263386 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 436/866] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:23:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:23:18.269139 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62547325-68cf-4ed7-b54c-cac447bbf6c0 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:18.370625 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62547325-68cf-4ed7-b54c-cac447bbf6c0 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:18.404851 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a60fa2-c935-40f4-b448-144132a095f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:18.405848 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a60fa2-c935-40f4-b448-144132a095f6 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:18.406277 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a60fa2-c935-40f4-b448-144132a095f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:18.406693 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a60fa2-c935-40f4-b448-144132a095f6 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:18.407595 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a60fa2-c935-40f4-b448-144132a095f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:18.408059 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a60fa2-c935-40f4-b448-144132a095f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:18.409574 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a60fa2-c935-40f4-b448-144132a095f6 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:18.426448 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 431/867] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Apr 11 16:23:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:18.428007 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8508a7e7-ab9b-4254-a0f8-a2591d5b5a72 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:18.528815 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8508a7e7-ab9b-4254-a0f8-a2591d5b5a72 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:18.562549 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eee4434-a09b-4cf8-ab64-330f80c86ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:18.563609 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee4434-a09b-4cf8-ab64-330f80c86ed7 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:18.564034 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee4434-a09b-4cf8-ab64-330f80c86ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:18.564449 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee4434-a09b-4cf8-ab64-330f80c86ed7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:18.571473 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eee4434-a09b-4cf8-ab64-330f80c86ed7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:18.573128 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eee4434-a09b-4cf8-ab64-330f80c86ed7 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:18.587242 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-5eee4434-a09b-4cf8-ab64-330f80c86ed7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 16:23:18.593636 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 437/868] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Apr 11 16:23:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:23:18.595136 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a60fa2-c935-40f4-b448-144132a095f6 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:18.620609 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0bff5-6917-4f0d-87b6-64e820d973d9 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:18.621155 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0bff5-6917-4f0d-87b6-64e820d973d9 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:18.621580 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0bff5-6917-4f0d-87b6-64e820d973d9 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:18.623385 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 438/869] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:23:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 16:23:18.629324 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f9eed5-f2f1-4c76-8f1a-e2ae1952f51f None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:18.629615 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f9eed5-f2f1-4c76-8f1a-e2ae1952f51f None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:18.629893 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f9eed5-f2f1-4c76-8f1a-e2ae1952f51f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:18.651330 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-58f9eed5-f2f1-4c76-8f1a-e2ae1952f51f None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:23:18.653116 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-58f9eed5-f2f1-4c76-8f1a-e2ae1952f51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:23:18.710678 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a60fa2-c935-40f4-b448-144132a095f6 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:18.742731 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 439/870] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:23:18 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 16:23:18.750382 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e97290-60b3-4d05-9579-f78dbf248b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:18.751236 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e97290-60b3-4d05-9579-f78dbf248b34 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:18.751711 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e97290-60b3-4d05-9579-f78dbf248b34 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:18.752130 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e97290-60b3-4d05-9579-f78dbf248b34 None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:18.753124 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e97290-60b3-4d05-9579-f78dbf248b34 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:18.753609 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e97290-60b3-4d05-9579-f78dbf248b34 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:18.755277 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e97290-60b3-4d05-9579-f78dbf248b34 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:18.763909 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f9eed5-f2f1-4c76-8f1a-e2ae1952f51f None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:18.775550 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 432/871] 10.222.0.43 () {56 vars in 1148 bytes} [Mon Apr 11 16:23:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:18.780651 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e97290-60b3-4d05-9579-f78dbf248b34 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:18.891882 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e97290-60b3-4d05-9579-f78dbf248b34 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:18.897324 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f9eed5-f2f1-4c76-8f1a-e2ae1952f51f None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:18.927508 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1b8168-53a1-4449-91ca-d04d54039707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:18.928493 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b8168-53a1-4449-91ca-d04d54039707 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:18.928953 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b8168-53a1-4449-91ca-d04d54039707 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:18.929458 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b8168-53a1-4449-91ca-d04d54039707 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:18.931288 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1b8168-53a1-4449-91ca-d04d54039707 None admin] RBAC: Adding query filter params (role.id=702e5e78b5d744529384b96a390ae92f, scope.project.id=477b9d41390e455a82e733c4fc6acd6b, user.id=bb193a1a7abd430fbbcccab970e4f37c) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:18.931859 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1b8168-53a1-4449-91ca-d04d54039707 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:18.933501 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1b8168-53a1-4449-91ca-d04d54039707 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:18.943573 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23df74dd-686f-4e05-b8c0-2b8de9473d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:18.943573 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df74dd-686f-4e05-b8c0-2b8de9473d86 None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:18.943573 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df74dd-686f-4e05-b8c0-2b8de9473d86 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:18.943573 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df74dd-686f-4e05-b8c0-2b8de9473d86 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:18.943982 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23df74dd-686f-4e05-b8c0-2b8de9473d86 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:18.944050 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23df74dd-686f-4e05-b8c0-2b8de9473d86 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:18.948172 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 433/872] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Apr 11 16:23:18 2022] GET /identity/v3/role_assignments?user.id=bb193a1a7abd430fbbcccab970e4f37c&scope.project.id=477b9d41390e455a82e733c4fc6acd6b&role.id=702e5e78b5d744529384b96a390ae92f => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:23:19.032108 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 440/873] 10.222.0.43 () {60 vars in 1141 bytes} [Mon Apr 11 16:23:18 2022] POST /identity/v3/services => generated 251 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:23:19.988452 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12501889-e388-4f00-b177-ac31b3f41190 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:19.988970 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12501889-e388-4f00-b177-ac31b3f41190 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:19.988970 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12501889-e388-4f00-b177-ac31b3f41190 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:19.990854 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 434/874] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:23:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:23:19.997036 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd40b1-5182-4718-aacb-3cbf6b6cfb36 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:19.997485 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd40b1-5182-4718-aacb-3cbf6b6cfb36 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:19.997665 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd40b1-5182-4718-aacb-3cbf6b6cfb36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:20.014991 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-adbd40b1-5182-4718-aacb-3cbf6b6cfb36 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:23:20.016224 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-adbd40b1-5182-4718-aacb-3cbf6b6cfb36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:23:20.092727 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 441/875] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:23:19 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:23:20.116832 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12501889-e388-4f00-b177-ac31b3f41190 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:20.225408 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12501889-e388-4f00-b177-ac31b3f41190 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:20.254137 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110bdca2-a219-4530-9020-86511cc8c221 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:20.254432 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110bdca2-a219-4530-9020-86511cc8c221 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:20.254631 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110bdca2-a219-4530-9020-86511cc8c221 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:20.256261 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 442/876] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:23:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:23:20.262094 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8499c52-4a09-4885-973d-9839d0f4cd7b None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:20.262386 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8499c52-4a09-4885-973d-9839d0f4cd7b None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:20.262672 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8499c52-4a09-4885-973d-9839d0f4cd7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:20.264469 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de4bed0-ec15-4b90-aa70-baf8c9570449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:20.265358 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de4bed0-ec15-4b90-aa70-baf8c9570449 None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:20.265828 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de4bed0-ec15-4b90-aa70-baf8c9570449 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:20.266307 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de4bed0-ec15-4b90-aa70-baf8c9570449 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:20.267220 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de4bed0-ec15-4b90-aa70-baf8c9570449 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:20.268883 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de4bed0-ec15-4b90-aa70-baf8c9570449 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:20.279628 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-e8499c52-4a09-4885-973d-9839d0f4cd7b None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:23:20.281165 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-e8499c52-4a09-4885-973d-9839d0f4cd7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:23:20.348720 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 443/877] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:23:20 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 16:23:20.374264 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8499c52-4a09-4885-973d-9839d0f4cd7b None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:20.396181 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 435/878] 10.222.0.43 () {60 vars in 1141 bytes} [Mon Apr 11 16:23:20 2022] POST /identity/v3/services => generated 269 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:23:20.508108 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8499c52-4a09-4885-973d-9839d0f4cd7b None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:20.553290 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dc032e-d86e-48b0-a0d7-fad8dd0485f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:20.554138 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc032e-d86e-48b0-a0d7-fad8dd0485f0 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:20.554548 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc032e-d86e-48b0-a0d7-fad8dd0485f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:20.555474 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc032e-d86e-48b0-a0d7-fad8dd0485f0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:20.568168 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dc032e-d86e-48b0-a0d7-fad8dd0485f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:23:20.577557 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-44dc032e-d86e-48b0-a0d7-fad8dd0485f0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 11 16:23:20.579196 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 444/879] 10.222.0.43 () {56 vars in 1120 bytes} [Mon Apr 11 16:23:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:23:20.585138 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de4bed0-ec15-4b90-aa70-baf8c9570449 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:20.696598 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de4bed0-ec15-4b90-aa70-baf8c9570449 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:20.730781 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2b85a0-2f6c-4453-93b9-ab187bcae3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:20.731870 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2b85a0-2f6c-4453-93b9-ab187bcae3a4 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:20.732348 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2b85a0-2f6c-4453-93b9-ab187bcae3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:20.732831 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2b85a0-2f6c-4453-93b9-ab187bcae3a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:20.733769 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2b85a0-2f6c-4453-93b9-ab187bcae3a4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:20.734267 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2b85a0-2f6c-4453-93b9-ab187bcae3a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:20.735854 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2b85a0-2f6c-4453-93b9-ab187bcae3a4 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:20.751944 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 436/880] 10.222.0.43 () {56 vars in 1115 bytes} [Mon Apr 11 16:23:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:20.759725 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dc032e-d86e-48b0-a0d7-fad8dd0485f0 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:20.875170 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dc032e-d86e-48b0-a0d7-fad8dd0485f0 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:20.910102 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5e3e48-add0-49c6-9ef4-e1b637eea00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:20.910909 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5e3e48-add0-49c6-9ef4-e1b637eea00b None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:20.911193 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5e3e48-add0-49c6-9ef4-e1b637eea00b None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:20.911469 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5e3e48-add0-49c6-9ef4-e1b637eea00b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:20.922710 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5e3e48-add0-49c6-9ef4-e1b637eea00b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:20.924204 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5e3e48-add0-49c6-9ef4-e1b637eea00b None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:20.941647 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-dc5e3e48-add0-49c6-9ef4-e1b637eea00b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:23:20.943274 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 445/881] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:23:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:23:20.950590 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2b85a0-2f6c-4453-93b9-ab187bcae3a4 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:21.062544 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2b85a0-2f6c-4453-93b9-ab187bcae3a4 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:21.113337 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d641061-53f8-4d1a-ad20-00dc1174badb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:21.114456 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d641061-53f8-4d1a-ad20-00dc1174badb None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:21.114946 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d641061-53f8-4d1a-ad20-00dc1174badb None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:21.115712 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d641061-53f8-4d1a-ad20-00dc1174badb None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:21.116771 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d641061-53f8-4d1a-ad20-00dc1174badb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:21.117302 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d641061-53f8-4d1a-ad20-00dc1174badb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:21.118956 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d641061-53f8-4d1a-ad20-00dc1174badb None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:21.132228 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 437/882] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Apr 11 16:23:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:21.140678 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5e3e48-add0-49c6-9ef4-e1b637eea00b None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:21.250460 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5e3e48-add0-49c6-9ef4-e1b637eea00b None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:21.285653 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5f6940-66c7-4e7b-977e-9b4f0c362c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:21.286475 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f6940-66c7-4e7b-977e-9b4f0c362c9a None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:21.286758 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f6940-66c7-4e7b-977e-9b4f0c362c9a None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:21.287036 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f6940-66c7-4e7b-977e-9b4f0c362c9a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:21.295279 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5f6940-66c7-4e7b-977e-9b4f0c362c9a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:21.296760 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5f6940-66c7-4e7b-977e-9b4f0c362c9a None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:21.311281 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-8c5f6940-66c7-4e7b-977e-9b4f0c362c9a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 11 16:23:21.312948 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 446/883] 10.222.0.43 () {56 vars in 1117 bytes} [Mon Apr 11 16:23:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:23:21.318469 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d641061-53f8-4d1a-ad20-00dc1174badb None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:21.391104 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c0a54d-0354-4558-b072-7db5273c074e None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:21.391760 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c0a54d-0354-4558-b072-7db5273c074e None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:21.392235 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c0a54d-0354-4558-b072-7db5273c074e None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:21.394122 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 447/884] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:23:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:23:21.399995 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67490832-3fec-4d3b-b54e-65cc343236f6 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:21.400632 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67490832-3fec-4d3b-b54e-65cc343236f6 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:21.401117 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67490832-3fec-4d3b-b54e-65cc343236f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:21.430195 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-67490832-3fec-4d3b-b54e-65cc343236f6 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:23:21.430699 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d641061-53f8-4d1a-ad20-00dc1174badb None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:21.432105 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-67490832-3fec-4d3b-b54e-65cc343236f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:23:21.480302 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960e0ae5-87d1-4b34-a3b8-2146d89c3b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:21.481331 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960e0ae5-87d1-4b34-a3b8-2146d89c3b6d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:21.481889 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960e0ae5-87d1-4b34-a3b8-2146d89c3b6d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:21.482409 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960e0ae5-87d1-4b34-a3b8-2146d89c3b6d None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:21.483456 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960e0ae5-87d1-4b34-a3b8-2146d89c3b6d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:21.483990 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960e0ae5-87d1-4b34-a3b8-2146d89c3b6d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:21.485679 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960e0ae5-87d1-4b34-a3b8-2146d89c3b6d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:21.508805 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 438/885] 10.222.0.43 () {56 vars in 1149 bytes} [Mon Apr 11 16:23:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:21.510148 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c23320-f857-4f11-95bc-73c22ed6dcf9 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:21.510599 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c23320-f857-4f11-95bc-73c22ed6dcf9 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:21.511155 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c23320-f857-4f11-95bc-73c22ed6dcf9 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:21.512698 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 448/887] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:23:21 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:23:21.512947 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 439/887] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:23:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:23:21.514364 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c23320-f857-4f11-95bc-73c22ed6dcf9 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:21.520180 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30cc211-15a4-4b12-b142-f29e1fdc9094 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:21.520824 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30cc211-15a4-4b12-b142-f29e1fdc9094 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:21.521293 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30cc211-15a4-4b12-b142-f29e1fdc9094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:21.544534 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-e30cc211-15a4-4b12-b142-f29e1fdc9094 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:23:21.550466 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-e30cc211-15a4-4b12-b142-f29e1fdc9094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:23:21.614072 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 449/888] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:23:21 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 16:23:21.620628 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30cc211-15a4-4b12-b142-f29e1fdc9094 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:21.636087 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c23320-f857-4f11-95bc-73c22ed6dcf9 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:21.674370 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb76b944-1a3f-4f28-b36e-6b77d8582bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:21.675031 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76b944-1a3f-4f28-b36e-6b77d8582bb0 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:21.675321 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76b944-1a3f-4f28-b36e-6b77d8582bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:21.675631 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76b944-1a3f-4f28-b36e-6b77d8582bb0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:21.726516 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30cc211-15a4-4b12-b142-f29e1fdc9094 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:21.753131 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb76b944-1a3f-4f28-b36e-6b77d8582bb0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:21.754589 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb76b944-1a3f-4f28-b36e-6b77d8582bb0 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:21.768408 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca133989-9097-473a-a706-75cda3838716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:21.769222 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca133989-9097-473a-a706-75cda3838716 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:21.769502 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca133989-9097-473a-a706-75cda3838716 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:21.769828 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca133989-9097-473a-a706-75cda3838716 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:21.770489 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca133989-9097-473a-a706-75cda3838716 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:21.771896 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca133989-9097-473a-a706-75cda3838716 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:21.783422 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-ca133989-9097-473a-a706-75cda3838716 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 11 16:23:21.787639 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 450/889] 10.222.0.43 () {56 vars in 1126 bytes} [Mon Apr 11 16:23:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:23:21.787639 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca133989-9097-473a-a706-75cda3838716 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:21.859987 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 440/890] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Apr 11 16:23:21 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 11 16:23:21.861069 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb76b944-1a3f-4f28-b36e-6b77d8582bb0 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:21.913400 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca133989-9097-473a-a706-75cda3838716 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:21.948176 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0946929-c67f-4e30-a1da-c748487ed7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:21.948978 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0946929-c67f-4e30-a1da-c748487ed7ab None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:21.949272 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0946929-c67f-4e30-a1da-c748487ed7ab None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:21.949542 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0946929-c67f-4e30-a1da-c748487ed7ab None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:21.950195 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0946929-c67f-4e30-a1da-c748487ed7ab None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:21.951577 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0946929-c67f-4e30-a1da-c748487ed7ab None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:21.962994 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-a0946929-c67f-4e30-a1da-c748487ed7ab None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 11 16:23:21.964494 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 451/891] 10.222.0.43 () {56 vars in 1114 bytes} [Mon Apr 11 16:23:21 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:23:21.965274 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0946929-c67f-4e30-a1da-c748487ed7ab None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:21.990774 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb76b944-1a3f-4f28-b36e-6b77d8582bb0 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:22.025786 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebaf924-92da-4879-8290-92d370015c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:22.026463 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebaf924-92da-4879-8290-92d370015c28 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:22.026749 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebaf924-92da-4879-8290-92d370015c28 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:22.027028 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebaf924-92da-4879-8290-92d370015c28 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:22.027775 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebaf924-92da-4879-8290-92d370015c28 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:22.028152 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebaf924-92da-4879-8290-92d370015c28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:22.029968 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebaf924-92da-4879-8290-92d370015c28 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:22.040392 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 441/892] 10.222.0.43 () {56 vars in 1122 bytes} [Mon Apr 11 16:23:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:22.040392 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebaf924-92da-4879-8290-92d370015c28 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:22.092900 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0946929-c67f-4e30-a1da-c748487ed7ab None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:22.129163 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35865bd-63a7-462b-bdbe-d6904835f41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:22.129973 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35865bd-63a7-462b-bdbe-d6904835f41d None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:22.130253 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35865bd-63a7-462b-bdbe-d6904835f41d None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:22.130523 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35865bd-63a7-462b-bdbe-d6904835f41d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:22.141378 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebaf924-92da-4879-8290-92d370015c28 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:22.143102 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35865bd-63a7-462b-bdbe-d6904835f41d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:22.144604 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35865bd-63a7-462b-bdbe-d6904835f41d None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:22.161574 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-d35865bd-63a7-462b-bdbe-d6904835f41d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:23:22.168141 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 452/893] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:23:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:23:22.168141 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35865bd-63a7-462b-bdbe-d6904835f41d None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:22.176407 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870629f4-fed3-4081-82da-16c2c8648f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:22.177312 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870629f4-fed3-4081-82da-16c2c8648f7a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:22.177312 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870629f4-fed3-4081-82da-16c2c8648f7a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:22.177604 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870629f4-fed3-4081-82da-16c2c8648f7a None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:22.178307 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870629f4-fed3-4081-82da-16c2c8648f7a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:22.178717 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870629f4-fed3-4081-82da-16c2c8648f7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:22.180727 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870629f4-fed3-4081-82da-16c2c8648f7a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:22.190004 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 442/894] 10.222.0.43 () {56 vars in 1114 bytes} [Mon Apr 11 16:23:22 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:22.190658 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870629f4-fed3-4081-82da-16c2c8648f7a None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:22.266218 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35865bd-63a7-462b-bdbe-d6904835f41d None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:22.290214 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870629f4-fed3-4081-82da-16c2c8648f7a None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:22.299283 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2004582a-66ef-42e2-b708-f83e86e0eb86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:22.300009 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004582a-66ef-42e2-b708-f83e86e0eb86 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:22.300295 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004582a-66ef-42e2-b708-f83e86e0eb86 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:22.300575 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004582a-66ef-42e2-b708-f83e86e0eb86 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:22.301306 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2004582a-66ef-42e2-b708-f83e86e0eb86 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:22.301617 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2004582a-66ef-42e2-b708-f83e86e0eb86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:22.303045 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2004582a-66ef-42e2-b708-f83e86e0eb86 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:22.320369 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 453/895] 10.222.0.43 () {56 vars in 1122 bytes} [Mon Apr 11 16:23:22 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:22.320369 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2004582a-66ef-42e2-b708-f83e86e0eb86 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:22.328190 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c8a04-66c1-420a-8cc3-482a60bb10de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:22.328890 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c8a04-66c1-420a-8cc3-482a60bb10de None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:22.329183 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c8a04-66c1-420a-8cc3-482a60bb10de None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:22.329451 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c8a04-66c1-420a-8cc3-482a60bb10de None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:22.330205 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c8a04-66c1-420a-8cc3-482a60bb10de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:22.330509 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c8a04-66c1-420a-8cc3-482a60bb10de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:22.332008 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c8a04-66c1-420a-8cc3-482a60bb10de None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:22.345828 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 443/896] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Apr 11 16:23:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:22.353027 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c8a04-66c1-420a-8cc3-482a60bb10de None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:22.442479 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2004582a-66ef-42e2-b708-f83e86e0eb86 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:22.484140 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697700a1-f9b7-4e24-9647-4cef12fbf717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:22.485161 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697700a1-f9b7-4e24-9647-4cef12fbf717 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:22.485670 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697700a1-f9b7-4e24-9647-4cef12fbf717 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:22.486142 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697700a1-f9b7-4e24-9647-4cef12fbf717 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:22.487077 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697700a1-f9b7-4e24-9647-4cef12fbf717 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:22.487393 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c8a04-66c1-420a-8cc3-482a60bb10de None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:22.487839 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697700a1-f9b7-4e24-9647-4cef12fbf717 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:22.489441 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697700a1-f9b7-4e24-9647-4cef12fbf717 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:22.496158 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 454/897] 10.222.0.43 () {56 vars in 1114 bytes} [Mon Apr 11 16:23:22 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:22.501563 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697700a1-f9b7-4e24-9647-4cef12fbf717 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:22.539100 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10bd458-ce7d-4a4d-80f2-6a0f3a263b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:22.539995 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10bd458-ce7d-4a4d-80f2-6a0f3a263b3b None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:22.540331 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10bd458-ce7d-4a4d-80f2-6a0f3a263b3b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:22.540614 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10bd458-ce7d-4a4d-80f2-6a0f3a263b3b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:22.549858 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10bd458-ce7d-4a4d-80f2-6a0f3a263b3b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:22.551364 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10bd458-ce7d-4a4d-80f2-6a0f3a263b3b None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:22.566658 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-b10bd458-ce7d-4a4d-80f2-6a0f3a263b3b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 16:23:22.571692 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 444/898] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Apr 11 16:23:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:23:22.575441 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10bd458-ce7d-4a4d-80f2-6a0f3a263b3b None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:22.630242 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697700a1-f9b7-4e24-9647-4cef12fbf717 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:22.677367 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7b5f9a-ccb4-4017-b1fa-aed1377de8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:22.678101 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b5f9a-ccb4-4017-b1fa-aed1377de8a8 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:22.678388 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b5f9a-ccb4-4017-b1fa-aed1377de8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:22.679005 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b5f9a-ccb4-4017-b1fa-aed1377de8a8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:22.680420 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7b5f9a-ccb4-4017-b1fa-aed1377de8a8 None admin] RBAC: Adding query filter params (interface=public, service_id=ec3979ac3c01496aa14790fae76fd6e6, region_id=RegionOne) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:22.680994 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7b5f9a-ccb4-4017-b1fa-aed1377de8a8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:22.682565 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7b5f9a-ccb4-4017-b1fa-aed1377de8a8 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:22.685831 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10bd458-ce7d-4a4d-80f2-6a0f3a263b3b None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:22.689967 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 455/899] 10.222.0.43 () {56 vars in 1251 bytes} [Mon Apr 11 16:23:22 2022] GET /identity/v3/endpoints?service_id=ec3979ac3c01496aa14790fae76fd6e6&interface=public®ion_id=RegionOne => generated 194 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:22.697716 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7b5f9a-ccb4-4017-b1fa-aed1377de8a8 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:22.724225 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b016cb0-bb24-423f-8bfb-09d76c3e39d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:22.725298 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b016cb0-bb24-423f-8bfb-09d76c3e39d8 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:22.725826 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b016cb0-bb24-423f-8bfb-09d76c3e39d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:22.726843 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b016cb0-bb24-423f-8bfb-09d76c3e39d8 None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:22.727930 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b016cb0-bb24-423f-8bfb-09d76c3e39d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:22.728435 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b016cb0-bb24-423f-8bfb-09d76c3e39d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:22.730115 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b016cb0-bb24-423f-8bfb-09d76c3e39d8 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:22.743984 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 445/900] 10.222.0.43 () {56 vars in 1148 bytes} [Mon Apr 11 16:23:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:22.750372 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b016cb0-bb24-423f-8bfb-09d76c3e39d8 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:22.823918 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7b5f9a-ccb4-4017-b1fa-aed1377de8a8 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:22.869652 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b016cb0-bb24-423f-8bfb-09d76c3e39d8 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:22.870795 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe0e56d-d920-454d-bbb8-cbd745d4966a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:22.871822 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe0e56d-d920-454d-bbb8-cbd745d4966a None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:22.873074 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe0e56d-d920-454d-bbb8-cbd745d4966a None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:22.873522 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe0e56d-d920-454d-bbb8-cbd745d4966a None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:22.874364 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe0e56d-d920-454d-bbb8-cbd745d4966a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:22.875892 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe0e56d-d920-454d-bbb8-cbd745d4966a None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:22.883997 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 456/901] 10.222.0.43 () {56 vars in 1087 bytes} [Mon Apr 11 16:23:22 2022] GET /identity/v3/services => generated 1268 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 16:23:22.918756 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fcb040-00c0-4bf2-b960-127cd738e34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:22.919906 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fcb040-00c0-4bf2-b960-127cd738e34c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:22.920476 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fcb040-00c0-4bf2-b960-127cd738e34c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:22.921032 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fcb040-00c0-4bf2-b960-127cd738e34c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:22.922258 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fcb040-00c0-4bf2-b960-127cd738e34c None admin] RBAC: Adding query filter params (role.id=c649101bea4344799d49fb57281b6508, scope.project.id=477b9d41390e455a82e733c4fc6acd6b, user.id=3252c48fdd5747a29fe4ba89e7162216) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:22.922846 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fcb040-00c0-4bf2-b960-127cd738e34c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:22.924609 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fcb040-00c0-4bf2-b960-127cd738e34c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:22.933044 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 446/902] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Apr 11 16:23:22 2022] GET /identity/v3/role_assignments?user.id=3252c48fdd5747a29fe4ba89e7162216&scope.project.id=477b9d41390e455a82e733c4fc6acd6b&role.id=c649101bea4344799d49fb57281b6508 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:22.959001 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff6315-85c5-42be-b5d8-9d44b5e513c3 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:22.959313 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff6315-85c5-42be-b5d8-9d44b5e513c3 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:22.959490 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff6315-85c5-42be-b5d8-9d44b5e513c3 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:22.962675 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 457/903] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:23:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:23:22.968655 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e9620-e033-43d2-81d8-f2cef36d23a6 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:22.968972 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e9620-e033-43d2-81d8-f2cef36d23a6 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:22.969232 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e9620-e033-43d2-81d8-f2cef36d23a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:22.988058 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-7f0e9620-e033-43d2-81d8-f2cef36d23a6 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:23:22.989336 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-7f0e9620-e033-43d2-81d8-f2cef36d23a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:23:23.070861 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 447/904] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:23:22 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:23:23.095260 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ff6315-85c5-42be-b5d8-9d44b5e513c3 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:23.208775 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ff6315-85c5-42be-b5d8-9d44b5e513c3 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:23.244344 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e628d6-7ac2-4b6c-9341-4898d1098eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:23.245090 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e628d6-7ac2-4b6c-9341-4898d1098eae None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:23.245377 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e628d6-7ac2-4b6c-9341-4898d1098eae None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:23.245655 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e628d6-7ac2-4b6c-9341-4898d1098eae None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:23.246409 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e628d6-7ac2-4b6c-9341-4898d1098eae None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:23.247829 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e628d6-7ac2-4b6c-9341-4898d1098eae None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:23.260371 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-a9e628d6-7ac2-4b6c-9341-4898d1098eae None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 11 16:23:23.261929 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 458/905] 10.222.0.43 () {56 vars in 1132 bytes} [Mon Apr 11 16:23:23 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:23:23.267401 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e9620-e033-43d2-81d8-f2cef36d23a6 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:23.373891 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e9620-e033-43d2-81d8-f2cef36d23a6 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:23.408294 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15686bab-b30c-4c48-8759-7a639d9534a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:23.408975 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15686bab-b30c-4c48-8759-7a639d9534a7 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:23.409266 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15686bab-b30c-4c48-8759-7a639d9534a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:23.409550 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15686bab-b30c-4c48-8759-7a639d9534a7 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:23.410270 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15686bab-b30c-4c48-8759-7a639d9534a7 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:23.410676 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15686bab-b30c-4c48-8759-7a639d9534a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:23.412096 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15686bab-b30c-4c48-8759-7a639d9534a7 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:23.417798 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 448/906] 10.222.0.43 () {56 vars in 1126 bytes} [Mon Apr 11 16:23:23 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:23.423334 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e628d6-7ac2-4b6c-9341-4898d1098eae None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:23.527423 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e628d6-7ac2-4b6c-9341-4898d1098eae None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:23.561484 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e847317-6721-4250-99f6-7b21e19b4d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:23.562153 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e847317-6721-4250-99f6-7b21e19b4d69 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:23.562430 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e847317-6721-4250-99f6-7b21e19b4d69 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:23.562731 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e847317-6721-4250-99f6-7b21e19b4d69 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:23.563408 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e847317-6721-4250-99f6-7b21e19b4d69 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:23.563748 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e847317-6721-4250-99f6-7b21e19b4d69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:23.565110 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e847317-6721-4250-99f6-7b21e19b4d69 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:23.570376 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 459/907] 10.222.0.43 () {56 vars in 1126 bytes} [Mon Apr 11 16:23:23 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:23.575900 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15686bab-b30c-4c48-8759-7a639d9534a7 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:23.684835 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15686bab-b30c-4c48-8759-7a639d9534a7 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:23.719362 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4658cf8f-ac59-482b-940c-8e8ab1852da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:23.720067 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4658cf8f-ac59-482b-940c-8e8ab1852da2 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:23.720355 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4658cf8f-ac59-482b-940c-8e8ab1852da2 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:23.720636 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4658cf8f-ac59-482b-940c-8e8ab1852da2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:23.721431 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4658cf8f-ac59-482b-940c-8e8ab1852da2 None admin] RBAC: Adding query filter params (interface=public, service_id=9d26851d8b0d471b823155244df656f8, region_id=RegionOne) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:23.721748 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4658cf8f-ac59-482b-940c-8e8ab1852da2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:23.723101 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4658cf8f-ac59-482b-940c-8e8ab1852da2 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:23.729228 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 449/908] 10.222.0.43 () {56 vars in 1251 bytes} [Mon Apr 11 16:23:23 2022] GET /identity/v3/endpoints?service_id=9d26851d8b0d471b823155244df656f8&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:23.734672 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e847317-6721-4250-99f6-7b21e19b4d69 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:23.849249 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e847317-6721-4250-99f6-7b21e19b4d69 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:23.905301 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228e6b21-0b14-439c-80c5-d7374b284bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:23.906911 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228e6b21-0b14-439c-80c5-d7374b284bd0 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:23.907677 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228e6b21-0b14-439c-80c5-d7374b284bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:23.908425 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228e6b21-0b14-439c-80c5-d7374b284bd0 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:23.909936 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228e6b21-0b14-439c-80c5-d7374b284bd0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:23.912743 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228e6b21-0b14-439c-80c5-d7374b284bd0 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:23.924238 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 460/909] 10.222.0.43 () {56 vars in 1087 bytes} [Mon Apr 11 16:23:23 2022] GET /identity/v3/services => generated 1268 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:23:24.831009 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76a5b6-9acf-47b5-ad1d-a803ecefb71d None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:24.831568 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76a5b6-9acf-47b5-ad1d-a803ecefb71d None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:24.831568 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76a5b6-9acf-47b5-ad1d-a803ecefb71d None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:24.832998 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 450/910] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:23:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:23:24.839133 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c51691-327c-4fb4-bb2a-dd00cd758d9c None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:24.839619 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c51691-327c-4fb4-bb2a-dd00cd758d9c None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:24.839695 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c51691-327c-4fb4-bb2a-dd00cd758d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:24.857932 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-46c51691-327c-4fb4-bb2a-dd00cd758d9c None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:23:24.859141 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-46c51691-327c-4fb4-bb2a-dd00cd758d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:23:24.928311 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 461/911] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:23:24 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:23:24.953317 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb76a5b6-9acf-47b5-ad1d-a803ecefb71d None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:25.065750 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb76a5b6-9acf-47b5-ad1d-a803ecefb71d None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:25.102017 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e757e7-43c9-4408-bccc-6ea33b4e9c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:25.102705 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e757e7-43c9-4408-bccc-6ea33b4e9c3b None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:25.102995 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e757e7-43c9-4408-bccc-6ea33b4e9c3b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:25.103278 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e757e7-43c9-4408-bccc-6ea33b4e9c3b None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:25.104062 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e757e7-43c9-4408-bccc-6ea33b4e9c3b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:25.105436 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e757e7-43c9-4408-bccc-6ea33b4e9c3b None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:25.182925 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 451/912] 10.222.0.43 () {60 vars in 1141 bytes} [Mon Apr 11 16:23:24 2022] POST /identity/v3/services => generated 241 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:23:25.341552 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f54424d-03c3-4e2e-988b-2207167bb48a None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:25.341923 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f54424d-03c3-4e2e-988b-2207167bb48a None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:25.342136 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f54424d-03c3-4e2e-988b-2207167bb48a None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:25.343873 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 462/913] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:23:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:23:25.349640 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cbfb5e-9354-484d-a721-7e5f7d3f6032 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:25.349933 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cbfb5e-9354-484d-a721-7e5f7d3f6032 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:25.350215 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cbfb5e-9354-484d-a721-7e5f7d3f6032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:25.368637 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-76cbfb5e-9354-484d-a721-7e5f7d3f6032 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:23:25.369742 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-76cbfb5e-9354-484d-a721-7e5f7d3f6032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:23:25.378811 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc83339-b7ab-456a-b463-31e7733b8afc None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:25.379088 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc83339-b7ab-456a-b463-31e7733b8afc None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:25.379367 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc83339-b7ab-456a-b463-31e7733b8afc None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:25.380910 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 463/914] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:23:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 16:23:25.386407 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b83dc5d-441d-45f4-8266-8cc341bca191 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:25.386989 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b83dc5d-441d-45f4-8266-8cc341bca191 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:25.386989 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b83dc5d-441d-45f4-8266-8cc341bca191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:25.406010 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-4b83dc5d-441d-45f4-8266-8cc341bca191 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:23:25.407478 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-4b83dc5d-441d-45f4-8266-8cc341bca191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:23:25.458446 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 452/915] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:23:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:23:25.476566 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cbfb5e-9354-484d-a721-7e5f7d3f6032 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:25.509279 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 464/916] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:23:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 16:23:25.528772 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b83dc5d-441d-45f4-8266-8cc341bca191 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:25.595636 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cbfb5e-9354-484d-a721-7e5f7d3f6032 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:25.632635 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e5b09b-8c8d-461c-97c3-f75d561a1914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:25.633426 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e5b09b-8c8d-461c-97c3-f75d561a1914 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:25.633808 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e5b09b-8c8d-461c-97c3-f75d561a1914 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:25.634210 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e5b09b-8c8d-461c-97c3-f75d561a1914 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:25.634932 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e5b09b-8c8d-461c-97c3-f75d561a1914 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:25.636411 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e5b09b-8c8d-461c-97c3-f75d561a1914 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:25.646396 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b83dc5d-441d-45f4-8266-8cc341bca191 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:25.649022 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-a9e5b09b-8c8d-461c-97c3-f75d561a1914 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 11 16:23:25.655368 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 453/917] 10.222.0.43 () {56 vars in 1114 bytes} [Mon Apr 11 16:23:25 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:23:25.656598 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e5b09b-8c8d-461c-97c3-f75d561a1914 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:25.690940 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcb9483-b0ee-4ade-89f5-8518a632464e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:25.692236 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb9483-b0ee-4ade-89f5-8518a632464e None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:25.692615 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb9483-b0ee-4ade-89f5-8518a632464e None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:25.693012 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb9483-b0ee-4ade-89f5-8518a632464e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:25.704133 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcb9483-b0ee-4ade-89f5-8518a632464e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:23:25.712678 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-ffcb9483-b0ee-4ade-89f5-8518a632464e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 11 16:23:25.719005 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 465/918] 10.222.0.43 () {56 vars in 1120 bytes} [Mon Apr 11 16:23:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:23:25.720075 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcb9483-b0ee-4ade-89f5-8518a632464e None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:25.768896 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e5b09b-8c8d-461c-97c3-f75d561a1914 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:25.808707 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4890cafe-5877-4462-a777-4d5f5cbba283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:25.809970 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4890cafe-5877-4462-a777-4d5f5cbba283 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:25.810656 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4890cafe-5877-4462-a777-4d5f5cbba283 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:25.811098 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4890cafe-5877-4462-a777-4d5f5cbba283 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:25.812166 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4890cafe-5877-4462-a777-4d5f5cbba283 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:25.812640 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4890cafe-5877-4462-a777-4d5f5cbba283 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:25.814814 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4890cafe-5877-4462-a777-4d5f5cbba283 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:25.821947 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 454/919] 10.222.0.43 () {56 vars in 1114 bytes} [Mon Apr 11 16:23:25 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:25.827935 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4890cafe-5877-4462-a777-4d5f5cbba283 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:25.833492 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcb9483-b0ee-4ade-89f5-8518a632464e None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:25.869663 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2881e455-c375-40e8-8e97-c7aa0c22dbfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:25.870339 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2881e455-c375-40e8-8e97-c7aa0c22dbfa None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:25.870683 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2881e455-c375-40e8-8e97-c7aa0c22dbfa None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:25.870961 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2881e455-c375-40e8-8e97-c7aa0c22dbfa None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:25.871756 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2881e455-c375-40e8-8e97-c7aa0c22dbfa None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:25.872068 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2881e455-c375-40e8-8e97-c7aa0c22dbfa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:25.873428 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2881e455-c375-40e8-8e97-c7aa0c22dbfa None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:25.887991 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 466/920] 10.222.0.43 () {56 vars in 1115 bytes} [Mon Apr 11 16:23:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:25.889281 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2881e455-c375-40e8-8e97-c7aa0c22dbfa None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:25.954954 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4890cafe-5877-4462-a777-4d5f5cbba283 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:25.999408 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334eb210-36bf-452a-b37c-795dca2a9c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:26.000291 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334eb210-36bf-452a-b37c-795dca2a9c9d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:26.000641 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334eb210-36bf-452a-b37c-795dca2a9c9d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:26.001015 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334eb210-36bf-452a-b37c-795dca2a9c9d None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:26.001612 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2881e455-c375-40e8-8e97-c7aa0c22dbfa None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:26.001869 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334eb210-36bf-452a-b37c-795dca2a9c9d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:26.002241 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334eb210-36bf-452a-b37c-795dca2a9c9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:26.003705 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334eb210-36bf-452a-b37c-795dca2a9c9d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:26.014111 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 455/921] 10.222.0.43 () {56 vars in 1114 bytes} [Mon Apr 11 16:23:25 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:26.015003 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334eb210-36bf-452a-b37c-795dca2a9c9d None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:26.044680 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e794d9-436a-4b35-bb1b-f2ac7170c1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:26.045648 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e794d9-436a-4b35-bb1b-f2ac7170c1b5 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:26.045939 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e794d9-436a-4b35-bb1b-f2ac7170c1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:26.046217 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e794d9-436a-4b35-bb1b-f2ac7170c1b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:26.062388 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e794d9-436a-4b35-bb1b-f2ac7170c1b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:26.063886 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e794d9-436a-4b35-bb1b-f2ac7170c1b5 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:26.081009 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-32e794d9-436a-4b35-bb1b-f2ac7170c1b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:23:26.082544 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 467/922] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:23:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:23:26.090866 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e794d9-436a-4b35-bb1b-f2ac7170c1b5 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:26.136616 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334eb210-36bf-452a-b37c-795dca2a9c9d None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:26.188978 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef21956-67ee-4eb5-9091-a1c42c532e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:26.189961 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef21956-67ee-4eb5-9091-a1c42c532e7b None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:26.190443 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef21956-67ee-4eb5-9091-a1c42c532e7b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:26.190903 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef21956-67ee-4eb5-9091-a1c42c532e7b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:26.192218 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef21956-67ee-4eb5-9091-a1c42c532e7b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:26.194770 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef21956-67ee-4eb5-9091-a1c42c532e7b None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:26.230303 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e794d9-436a-4b35-bb1b-f2ac7170c1b5 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:26.265699 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ab71b5-3980-4e61-9d95-376e1b1eaaa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:26.266372 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab71b5-3980-4e61-9d95-376e1b1eaaa2 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:26.266658 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab71b5-3980-4e61-9d95-376e1b1eaaa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:26.266937 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab71b5-3980-4e61-9d95-376e1b1eaaa2 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:26.267713 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ab71b5-3980-4e61-9d95-376e1b1eaaa2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:26.268040 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ab71b5-3980-4e61-9d95-376e1b1eaaa2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:26.269541 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ab71b5-3980-4e61-9d95-376e1b1eaaa2 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:26.284935 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 468/923] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Apr 11 16:23:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:23:26.292764 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ab71b5-3980-4e61-9d95-376e1b1eaaa2 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:26.295756 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 456/924] 10.222.0.43 () {60 vars in 1144 bytes} [Mon Apr 11 16:23:26 2022] POST /identity/v3/endpoints => generated 346 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:23:26.356280 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbd9774-97c3-40c2-9a50-f7c4c438f21d None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:26.356606 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbd9774-97c3-40c2-9a50-f7c4c438f21d None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:26.356851 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbd9774-97c3-40c2-9a50-f7c4c438f21d None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:26.358496 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 457/925] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:23:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 16:23:26.363913 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d10481-096b-43cd-ad59-3da6fd3d7821 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:26.364197 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d10481-096b-43cd-ad59-3da6fd3d7821 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:26.364486 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d10481-096b-43cd-ad59-3da6fd3d7821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:26.383550 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-90d10481-096b-43cd-ad59-3da6fd3d7821 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:23:26.384943 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-90d10481-096b-43cd-ad59-3da6fd3d7821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:23:26.433721 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ab71b5-3980-4e61-9d95-376e1b1eaaa2 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:26.486211 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adace7f8-b7bd-431d-8389-a5914f71a084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:26.487151 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adace7f8-b7bd-431d-8389-a5914f71a084 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:26.487443 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adace7f8-b7bd-431d-8389-a5914f71a084 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:26.487744 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adace7f8-b7bd-431d-8389-a5914f71a084 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:26.488869 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 458/926] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:23:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 16:23:26.500058 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adace7f8-b7bd-431d-8389-a5914f71a084 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:26.501926 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adace7f8-b7bd-431d-8389-a5914f71a084 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:26.513621 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d10481-096b-43cd-ad59-3da6fd3d7821 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:26.518712 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-adace7f8-b7bd-431d-8389-a5914f71a084 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 11 16:23:26.520337 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 469/927] 10.222.0.43 () {56 vars in 1117 bytes} [Mon Apr 11 16:23:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:23:26.527428 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adace7f8-b7bd-431d-8389-a5914f71a084 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:26.646176 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d10481-096b-43cd-ad59-3da6fd3d7821 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:26.658437 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adace7f8-b7bd-431d-8389-a5914f71a084 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:26.690285 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34c0e99-522d-4050-9aa3-e5afa9b7b5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:26.691146 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c0e99-522d-4050-9aa3-e5afa9b7b5ec None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:26.691703 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c0e99-522d-4050-9aa3-e5afa9b7b5ec None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:26.691988 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c0e99-522d-4050-9aa3-e5afa9b7b5ec None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:26.692661 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34c0e99-522d-4050-9aa3-e5afa9b7b5ec None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:26.694548 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34c0e99-522d-4050-9aa3-e5afa9b7b5ec None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:26.697173 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07009a5-d604-4e49-a665-52cb07def428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:26.698114 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07009a5-d604-4e49-a665-52cb07def428 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:26.698612 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07009a5-d604-4e49-a665-52cb07def428 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:26.699085 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07009a5-d604-4e49-a665-52cb07def428 None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:26.700194 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07009a5-d604-4e49-a665-52cb07def428 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:26.700709 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07009a5-d604-4e49-a665-52cb07def428 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:26.702328 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07009a5-d604-4e49-a665-52cb07def428 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:26.707398 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-a34c0e99-522d-4050-9aa3-e5afa9b7b5ec None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 11 16:23:26.708948 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 459/928] 10.222.0.43 () {56 vars in 1132 bytes} [Mon Apr 11 16:23:26 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:23:26.715185 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34c0e99-522d-4050-9aa3-e5afa9b7b5ec None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:26.724174 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 470/929] 10.222.0.43 () {56 vars in 1149 bytes} [Mon Apr 11 16:23:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:23:26.730399 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07009a5-d604-4e49-a665-52cb07def428 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:26.827392 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34c0e99-522d-4050-9aa3-e5afa9b7b5ec None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:26.855338 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07009a5-d604-4e49-a665-52cb07def428 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:26.863218 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d3c7e-64ca-4637-aa24-aef51c8e7bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:26.864144 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d3c7e-64ca-4637-aa24-aef51c8e7bec None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:26.864588 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d3c7e-64ca-4637-aa24-aef51c8e7bec None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:26.865272 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d3c7e-64ca-4637-aa24-aef51c8e7bec None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:26.866162 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806d3c7e-64ca-4637-aa24-aef51c8e7bec None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:26.866626 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806d3c7e-64ca-4637-aa24-aef51c8e7bec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:26.868147 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806d3c7e-64ca-4637-aa24-aef51c8e7bec None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:26.878016 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 460/930] 10.222.0.43 () {56 vars in 1126 bytes} [Mon Apr 11 16:23:26 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:23:26.879077 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d3c7e-64ca-4637-aa24-aef51c8e7bec None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:26.891873 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dc47e8-d804-4c46-89ee-960574a26f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:26.892725 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc47e8-d804-4c46-89ee-960574a26f44 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:26.893006 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc47e8-d804-4c46-89ee-960574a26f44 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:26.893329 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc47e8-d804-4c46-89ee-960574a26f44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:26.904562 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dc47e8-d804-4c46-89ee-960574a26f44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:26.906088 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dc47e8-d804-4c46-89ee-960574a26f44 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:26.924031 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-00dc47e8-d804-4c46-89ee-960574a26f44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:23:26.929998 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 471/931] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:23:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:23:26.931017 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dc47e8-d804-4c46-89ee-960574a26f44 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:26.984626 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d3c7e-64ca-4637-aa24-aef51c8e7bec None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:27.020146 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c4c0d-762a-4820-b236-ebb8f8d4bad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:27.021142 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c4c0d-762a-4820-b236-ebb8f8d4bad2 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:27.021605 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c4c0d-762a-4820-b236-ebb8f8d4bad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:27.022627 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c4c0d-762a-4820-b236-ebb8f8d4bad2 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:27.023538 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456c4c0d-762a-4820-b236-ebb8f8d4bad2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:27.024026 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456c4c0d-762a-4820-b236-ebb8f8d4bad2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:27.025575 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456c4c0d-762a-4820-b236-ebb8f8d4bad2 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:27.035342 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 461/932] 10.222.0.43 () {56 vars in 1126 bytes} [Mon Apr 11 16:23:26 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:27.035764 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dc47e8-d804-4c46-89ee-960574a26f44 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:27.036682 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c4c0d-762a-4820-b236-ebb8f8d4bad2 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:27.072288 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e719d694-f42a-4280-8577-a4daea72e09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:27.072961 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e719d694-f42a-4280-8577-a4daea72e09a None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:27.073269 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e719d694-f42a-4280-8577-a4daea72e09a None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:27.073504 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e719d694-f42a-4280-8577-a4daea72e09a None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:27.074990 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e719d694-f42a-4280-8577-a4daea72e09a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:27.074990 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e719d694-f42a-4280-8577-a4daea72e09a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:27.076020 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e719d694-f42a-4280-8577-a4daea72e09a None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:27.095583 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 472/933] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Apr 11 16:23:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:27.097324 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e719d694-f42a-4280-8577-a4daea72e09a None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:27.169724 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c4c0d-762a-4820-b236-ebb8f8d4bad2 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:27.205152 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf3320f-e799-4999-aee4-1fb33c33bc4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:27.205775 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf3320f-e799-4999-aee4-1fb33c33bc4c None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:27.206136 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf3320f-e799-4999-aee4-1fb33c33bc4c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:27.206485 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf3320f-e799-4999-aee4-1fb33c33bc4c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:27.207370 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf3320f-e799-4999-aee4-1fb33c33bc4c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:27.208825 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf3320f-e799-4999-aee4-1fb33c33bc4c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:27.229315 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e719d694-f42a-4280-8577-a4daea72e09a None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:27.268169 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918b619f-40ca-4cf9-8983-762e9744378f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:27.269256 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b619f-40ca-4cf9-8983-762e9744378f None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:27.269760 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b619f-40ca-4cf9-8983-762e9744378f None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:27.270206 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b619f-40ca-4cf9-8983-762e9744378f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:27.277788 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918b619f-40ca-4cf9-8983-762e9744378f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:27.279459 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918b619f-40ca-4cf9-8983-762e9744378f None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:27.293882 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-918b619f-40ca-4cf9-8983-762e9744378f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 16:23:27.299727 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 473/934] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Apr 11 16:23:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:23:27.301132 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918b619f-40ca-4cf9-8983-762e9744378f None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:27.360598 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 462/935] 10.222.0.43 () {60 vars in 1144 bytes} [Mon Apr 11 16:23:27 2022] POST /identity/v3/endpoints => generated 347 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:23:27.414037 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918b619f-40ca-4cf9-8983-762e9744378f None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:27.460534 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf601197-cca2-4e09-8b7c-310045828516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:27.461679 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf601197-cca2-4e09-8b7c-310045828516 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:27.462205 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf601197-cca2-4e09-8b7c-310045828516 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:27.462693 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf601197-cca2-4e09-8b7c-310045828516 None admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:27.463740 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf601197-cca2-4e09-8b7c-310045828516 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:27.464252 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf601197-cca2-4e09-8b7c-310045828516 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:27.465927 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf601197-cca2-4e09-8b7c-310045828516 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:27.481315 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 474/936] 10.222.0.43 () {56 vars in 1148 bytes} [Mon Apr 11 16:23:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:23:27.488143 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf3320f-e799-4999-aee4-1fb33c33bc4c None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:27.603745 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf3320f-e799-4999-aee4-1fb33c33bc4c None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:27.639590 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd13a48-9d21-42d7-9006-2acded0a7fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:27.640469 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd13a48-9d21-42d7-9006-2acded0a7fcf None admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:27.640751 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd13a48-9d21-42d7-9006-2acded0a7fcf None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:27.640943 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011566b4-4cc0-42ca-a481-c17c9cae4b35 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:27.641042 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd13a48-9d21-42d7-9006-2acded0a7fcf None admin] PATH_INFO: `/v3/projects/477b9d41390e455a82e733c4fc6acd6b/users/3252c48fdd5747a29fe4ba89e7162216/roles/c649101bea4344799d49fb57281b6508` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:27.641237 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011566b4-4cc0-42ca-a481-c17c9cae4b35 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:27.641590 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011566b4-4cc0-42ca-a481-c17c9cae4b35 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:27.643255 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd13a48-9d21-42d7-9006-2acded0a7fcf None admin] RBAC: Authorizing `identity:create_grant(project_id=477b9d41390e455a82e733c4fc6acd6b, user_id=3252c48fdd5747a29fe4ba89e7162216, role_id=c649101bea4344799d49fb57281b6508)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:27.644275 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 475/937] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:23:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:23:27.644774 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd13a48-9d21-42d7-9006-2acded0a7fcf None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:27.649282 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb0c6f-6e62-4ba9-8c88-15c61f921653 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:27.649538 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb0c6f-6e62-4ba9-8c88-15c61f921653 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:27.649852 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb0c6f-6e62-4ba9-8c88-15c61f921653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:27.668688 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-abdb0c6f-6e62-4ba9-8c88-15c61f921653 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:23:27.669979 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-abdb0c6f-6e62-4ba9-8c88-15c61f921653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:23:27.720079 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 463/938] 10.222.0.43 () {58 vars in 1439 bytes} [Mon Apr 11 16:23:27 2022] PUT /identity/v3/projects/477b9d41390e455a82e733c4fc6acd6b/users/3252c48fdd5747a29fe4ba89e7162216/roles/c649101bea4344799d49fb57281b6508 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:23:27.745948 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 476/939] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:23:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:23:27.770813 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd13a48-9d21-42d7-9006-2acded0a7fcf None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:27.889850 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd13a48-9d21-42d7-9006-2acded0a7fcf None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:27.927762 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec0fea0-b3ea-496f-b848-caf4e3d41dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:27.929138 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec0fea0-b3ea-496f-b848-caf4e3d41dee None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:27.929420 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec0fea0-b3ea-496f-b848-caf4e3d41dee None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:27.929837 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec0fea0-b3ea-496f-b848-caf4e3d41dee None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:27.930507 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec0fea0-b3ea-496f-b848-caf4e3d41dee None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:27.931965 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec0fea0-b3ea-496f-b848-caf4e3d41dee None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:27.945531 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-7ec0fea0-b3ea-496f-b848-caf4e3d41dee None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 11 16:23:27.947079 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 464/940] 10.222.0.43 () {56 vars in 1126 bytes} [Mon Apr 11 16:23:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:23:27.953236 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb0c6f-6e62-4ba9-8c88-15c61f921653 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:28.063476 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb0c6f-6e62-4ba9-8c88-15c61f921653 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:28.101280 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29608bd-8cbe-40c5-a2bf-0638fcb07358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:28.102303 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29608bd-8cbe-40c5-a2bf-0638fcb07358 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:28.102788 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29608bd-8cbe-40c5-a2bf-0638fcb07358 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:28.103285 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29608bd-8cbe-40c5-a2bf-0638fcb07358 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:28.104227 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29608bd-8cbe-40c5-a2bf-0638fcb07358 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:28.104753 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29608bd-8cbe-40c5-a2bf-0638fcb07358 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:28.106324 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29608bd-8cbe-40c5-a2bf-0638fcb07358 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:28.115687 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 477/941] 10.222.0.43 () {56 vars in 1122 bytes} [Mon Apr 11 16:23:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:28.120613 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec0fea0-b3ea-496f-b848-caf4e3d41dee None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:28.228978 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec0fea0-b3ea-496f-b848-caf4e3d41dee None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:28.263618 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97946d07-f355-4eb1-b698-17e269b58664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:28.264304 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97946d07-f355-4eb1-b698-17e269b58664 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:28.264589 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97946d07-f355-4eb1-b698-17e269b58664 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:28.264865 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97946d07-f355-4eb1-b698-17e269b58664 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:28.265584 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97946d07-f355-4eb1-b698-17e269b58664 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:28.265890 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97946d07-f355-4eb1-b698-17e269b58664 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:28.267254 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97946d07-f355-4eb1-b698-17e269b58664 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:28.273898 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 465/942] 10.222.0.43 () {56 vars in 1122 bytes} [Mon Apr 11 16:23:28 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:28.280332 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29608bd-8cbe-40c5-a2bf-0638fcb07358 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:28.383170 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29608bd-8cbe-40c5-a2bf-0638fcb07358 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:28.421284 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f5895e-4e39-49b3-b662-070434ea75dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:28.422372 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5895e-4e39-49b3-b662-070434ea75dd None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:28.422922 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5895e-4e39-49b3-b662-070434ea75dd None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:28.423416 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5895e-4e39-49b3-b662-070434ea75dd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:28.424448 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f5895e-4e39-49b3-b662-070434ea75dd None admin] RBAC: Adding query filter params (interface=public, service_id=f66e3e41c19f475985aa856d3ce8ba3c, region_id=RegionOne) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:28.424966 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f5895e-4e39-49b3-b662-070434ea75dd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:28.426571 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f5895e-4e39-49b3-b662-070434ea75dd None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:28.437754 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 478/943] 10.222.0.43 () {56 vars in 1251 bytes} [Mon Apr 11 16:23:28 2022] GET /identity/v3/endpoints?service_id=f66e3e41c19f475985aa856d3ce8ba3c&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:28.439457 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97946d07-f355-4eb1-b698-17e269b58664 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:28.554586 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97946d07-f355-4eb1-b698-17e269b58664 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:28.589295 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c518a899-d59b-49d7-856b-8be2b38ed449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:28.589968 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c518a899-d59b-49d7-856b-8be2b38ed449 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:28.590253 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c518a899-d59b-49d7-856b-8be2b38ed449 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:28.590525 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c518a899-d59b-49d7-856b-8be2b38ed449 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:28.591203 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c518a899-d59b-49d7-856b-8be2b38ed449 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:28.592592 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c518a899-d59b-49d7-856b-8be2b38ed449 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:28.609720 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 466/944] 10.222.0.43 () {56 vars in 1087 bytes} [Mon Apr 11 16:23:28 2022] GET /identity/v3/services => generated 1497 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:23:28.793920 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5feb25c-12eb-455e-97c5-7d400eb72297 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:28.794293 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5feb25c-12eb-455e-97c5-7d400eb72297 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:28.794480 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5feb25c-12eb-455e-97c5-7d400eb72297 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:28.796691 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 479/945] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:23:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:23:28.801721 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc687675-3fd9-49b6-8343-b6d61765ee61 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:28.802029 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc687675-3fd9-49b6-8343-b6d61765ee61 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:28.802306 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc687675-3fd9-49b6-8343-b6d61765ee61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:28.824689 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-bc687675-3fd9-49b6-8343-b6d61765ee61 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:23:28.825834 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-bc687675-3fd9-49b6-8343-b6d61765ee61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:23:28.899994 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 467/946] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:23:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:23:28.926074 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5feb25c-12eb-455e-97c5-7d400eb72297 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:29.028884 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5feb25c-12eb-455e-97c5-7d400eb72297 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:29.066424 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420d8c66-5d8b-4cb8-a9ce-55da13b5a634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:29.067163 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d8c66-5d8b-4cb8-a9ce-55da13b5a634 None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:29.067449 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d8c66-5d8b-4cb8-a9ce-55da13b5a634 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:29.067759 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d8c66-5d8b-4cb8-a9ce-55da13b5a634 None admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:29.068473 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420d8c66-5d8b-4cb8-a9ce-55da13b5a634 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:29.069922 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420d8c66-5d8b-4cb8-a9ce-55da13b5a634 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:29.071269 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.common [None req-420d8c66-5d8b-4cb8-a9ce-55da13b5a634 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Apr 11 16:23:29.141037 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.sql.core [None req-420d8c66-5d8b-4cb8-a9ce-55da13b5a634 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Apr 11 16:23:29.141037 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Apr 11 16:23:29.141037 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [parameters: {'id': 'b04cceaef94d42f4a6108be95be8e0d6', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Apr 11 16:23:29.141037 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80241) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Apr 11 16:23:29.148791 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-420d8c66-5d8b-4cb8-a9ce-55da13b5a634 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b04cceaef94d42f4a6108be95be8e0d6.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b04cceaef94d42f4a6108be95be8e0d6. Apr 11 16:23:29.151077 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 480/947] 10.222.0.43 () {60 vars in 1140 bytes} [Mon Apr 11 16:23:28 2022] POST /identity/v3/projects => generated 262 bytes in 225 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:23:29.161791 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc687675-3fd9-49b6-8343-b6d61765ee61 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:29.273472 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc687675-3fd9-49b6-8343-b6d61765ee61 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:29.325252 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac27d579-1861-4c75-90c0-d826ceca6886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:29.326089 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac27d579-1861-4c75-90c0-d826ceca6886 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:29.326380 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac27d579-1861-4c75-90c0-d826ceca6886 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:29.326654 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac27d579-1861-4c75-90c0-d826ceca6886 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:29.334192 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac27d579-1861-4c75-90c0-d826ceca6886 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:29.336275 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac27d579-1861-4c75-90c0-d826ceca6886 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:29.355408 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-ac27d579-1861-4c75-90c0-d826ceca6886 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 16:23:29.357189 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 468/948] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Apr 11 16:23:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:23:29.362870 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420d8c66-5d8b-4cb8-a9ce-55da13b5a634 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:29.506925 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420d8c66-5d8b-4cb8-a9ce-55da13b5a634 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:29.561352 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e627614-85d9-41fa-b075-e2362698b717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:29.562553 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e627614-85d9-41fa-b075-e2362698b717 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:29.563106 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e627614-85d9-41fa-b075-e2362698b717 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:29.563579 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e627614-85d9-41fa-b075-e2362698b717 None admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:29.564670 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e627614-85d9-41fa-b075-e2362698b717 None admin] RBAC: Adding query filter params (name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:29.565133 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e627614-85d9-41fa-b075-e2362698b717 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:29.568342 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e627614-85d9-41fa-b075-e2362698b717 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:29.599596 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 481/949] 10.222.0.43 () {56 vars in 1112 bytes} [Mon Apr 11 16:23:29 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:30.022602 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d1706-d029-4dad-93cc-b13ac6dc2948 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:30.022890 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d1706-d029-4dad-93cc-b13ac6dc2948 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:30.023171 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d1706-d029-4dad-93cc-b13ac6dc2948 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:30.025168 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 469/950] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:23:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:23:30.031033 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95984a81-ec52-4f8b-9033-693d75da5f14 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:30.031570 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95984a81-ec52-4f8b-9033-693d75da5f14 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:30.031649 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95984a81-ec52-4f8b-9033-693d75da5f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:30.050252 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-95984a81-ec52-4f8b-9033-693d75da5f14 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:23:30.051827 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-95984a81-ec52-4f8b-9033-693d75da5f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:23:30.124925 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 482/951] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:23:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:23:30.147948 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7d1706-d029-4dad-93cc-b13ac6dc2948 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:30.260317 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7d1706-d029-4dad-93cc-b13ac6dc2948 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:30.301041 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edef8fd2-8d99-4ced-a884-6f03d69b5ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:30.302069 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef8fd2-8d99-4ced-a884-6f03d69b5ad8 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:30.302495 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef8fd2-8d99-4ced-a884-6f03d69b5ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:30.302974 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef8fd2-8d99-4ced-a884-6f03d69b5ad8 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:30.303952 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edef8fd2-8d99-4ced-a884-6f03d69b5ad8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:30.305447 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edef8fd2-8d99-4ced-a884-6f03d69b5ad8 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:30.316754 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-edef8fd2-8d99-4ced-a884-6f03d69b5ad8 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Apr 11 16:23:30.318995 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 470/952] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Apr 11 16:23:30 2022] GET /identity/v3/services/compute => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:23:30.326434 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95984a81-ec52-4f8b-9033-693d75da5f14 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:30.387393 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1bd3f-062d-4e87-83f0-cfe07ec33981 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:30.387656 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1bd3f-062d-4e87-83f0-cfe07ec33981 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:30.387940 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1bd3f-062d-4e87-83f0-cfe07ec33981 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:30.389624 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 471/953] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:23:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 16:23:30.394866 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1debe04c-f7bc-4067-be99-36509f03d6c7 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:30.395157 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1debe04c-f7bc-4067-be99-36509f03d6c7 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:30.395442 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1debe04c-f7bc-4067-be99-36509f03d6c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:30.413122 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-1debe04c-f7bc-4067-be99-36509f03d6c7 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:23:30.414379 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-1debe04c-f7bc-4067-be99-36509f03d6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:23:30.437854 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95984a81-ec52-4f8b-9033-693d75da5f14 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:30.482142 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e744971e-1374-44ed-a925-866ba2bafef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:30.483345 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e744971e-1374-44ed-a925-866ba2bafef0 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:30.483808 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e744971e-1374-44ed-a925-866ba2bafef0 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:30.484381 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e744971e-1374-44ed-a925-866ba2bafef0 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:30.485699 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e744971e-1374-44ed-a925-866ba2bafef0 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:30.486305 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e744971e-1374-44ed-a925-866ba2bafef0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:30.488377 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e744971e-1374-44ed-a925-866ba2bafef0 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:30.496321 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 483/955] 10.222.0.43 () {56 vars in 1112 bytes} [Mon Apr 11 16:23:30 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:30.499730 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 472/955] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:23:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 16:23:30.505466 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e744971e-1374-44ed-a925-866ba2bafef0 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:30.522382 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1debe04c-f7bc-4067-be99-36509f03d6c7 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:30.628139 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e744971e-1374-44ed-a925-866ba2bafef0 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:30.654974 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1debe04c-f7bc-4067-be99-36509f03d6c7 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:30.668488 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfcc5c4-a4ab-4da7-a995-980476ce4752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:30.669515 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfcc5c4-a4ab-4da7-a995-980476ce4752 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:30.669995 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfcc5c4-a4ab-4da7-a995-980476ce4752 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:30.670464 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfcc5c4-a4ab-4da7-a995-980476ce4752 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:30.671365 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfcc5c4-a4ab-4da7-a995-980476ce4752 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:30.671900 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfcc5c4-a4ab-4da7-a995-980476ce4752 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:30.673502 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfcc5c4-a4ab-4da7-a995-980476ce4752 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:30.678917 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 484/956] 10.222.0.43 () {56 vars in 1112 bytes} [Mon Apr 11 16:23:30 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:30.701700 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a41eea-cab6-4170-bc8a-530f5d97f32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:30.702971 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a41eea-cab6-4170-bc8a-530f5d97f32c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:30.703533 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a41eea-cab6-4170-bc8a-530f5d97f32c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:30.704026 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a41eea-cab6-4170-bc8a-530f5d97f32c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:30.717247 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a41eea-cab6-4170-bc8a-530f5d97f32c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:23:30.726128 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-d1a41eea-cab6-4170-bc8a-530f5d97f32c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 11 16:23:30.728143 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 473/957] 10.222.0.43 () {56 vars in 1120 bytes} [Mon Apr 11 16:23:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:23:30.734501 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfcc5c4-a4ab-4da7-a995-980476ce4752 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:30.863754 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfcc5c4-a4ab-4da7-a995-980476ce4752 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:30.905871 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8b944a-9dd0-4289-a180-00878690fe53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:30.906486 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b944a-9dd0-4289-a180-00878690fe53 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:30.906771 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b944a-9dd0-4289-a180-00878690fe53 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:30.907051 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b944a-9dd0-4289-a180-00878690fe53 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:30.907847 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8b944a-9dd0-4289-a180-00878690fe53 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:30.908159 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8b944a-9dd0-4289-a180-00878690fe53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:30.909539 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8b944a-9dd0-4289-a180-00878690fe53 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:30.918908 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 485/958] 10.222.0.43 () {56 vars in 1115 bytes} [Mon Apr 11 16:23:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:30.924735 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a41eea-cab6-4170-bc8a-530f5d97f32c None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:31.028610 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a41eea-cab6-4170-bc8a-530f5d97f32c None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:31.062567 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a08ed-9475-4720-b9a1-769f8d67cb43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:31.063758 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a08ed-9475-4720-b9a1-769f8d67cb43 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:31.064243 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a08ed-9475-4720-b9a1-769f8d67cb43 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:31.064738 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a08ed-9475-4720-b9a1-769f8d67cb43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:31.076399 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86a08ed-9475-4720-b9a1-769f8d67cb43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:31.078131 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86a08ed-9475-4720-b9a1-769f8d67cb43 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:31.095669 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-f86a08ed-9475-4720-b9a1-769f8d67cb43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:23:31.097468 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 474/959] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:23:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:23:31.103250 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8b944a-9dd0-4289-a180-00878690fe53 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:31.209574 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8b944a-9dd0-4289-a180-00878690fe53 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:31.230922 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb66b52-658f-4e7a-802e-fcc85e8675ac None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:31.231225 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb66b52-658f-4e7a-802e-fcc85e8675ac None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:31.231494 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb66b52-658f-4e7a-802e-fcc85e8675ac None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:31.233138 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 475/960] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:23:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:23:31.238054 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9906828f-9373-4553-bc98-70e9c4942b23 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:31.238306 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9906828f-9373-4553-bc98-70e9c4942b23 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:31.238593 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9906828f-9373-4553-bc98-70e9c4942b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:31.246077 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef2ef5a-62ba-4f0c-b55e-0e8e5fa11c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:31.247021 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2ef5a-62ba-4f0c-b55e-0e8e5fa11c7e None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:31.247625 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2ef5a-62ba-4f0c-b55e-0e8e5fa11c7e None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:31.248090 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2ef5a-62ba-4f0c-b55e-0e8e5fa11c7e None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:31.249002 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef2ef5a-62ba-4f0c-b55e-0e8e5fa11c7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:31.249515 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef2ef5a-62ba-4f0c-b55e-0e8e5fa11c7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:31.251062 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef2ef5a-62ba-4f0c-b55e-0e8e5fa11c7e None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:31.257587 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-9906828f-9373-4553-bc98-70e9c4942b23 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:23:31.259493 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-9906828f-9373-4553-bc98-70e9c4942b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:23:31.263558 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 486/961] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Apr 11 16:23:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:31.268992 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef2ef5a-62ba-4f0c-b55e-0e8e5fa11c7e None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:31.347723 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 476/962] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:23:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:23:31.368616 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9906828f-9373-4553-bc98-70e9c4942b23 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:31.373779 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef2ef5a-62ba-4f0c-b55e-0e8e5fa11c7e None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:31.407785 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb463a21-d30d-4cc8-977d-ac057bf77fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:31.408592 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb463a21-d30d-4cc8-977d-ac057bf77fd0 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:31.408871 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb463a21-d30d-4cc8-977d-ac057bf77fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:31.409141 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb463a21-d30d-4cc8-977d-ac057bf77fd0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:31.416709 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb463a21-d30d-4cc8-977d-ac057bf77fd0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:31.418168 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb463a21-d30d-4cc8-977d-ac057bf77fd0 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:31.433243 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-cb463a21-d30d-4cc8-977d-ac057bf77fd0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 11 16:23:31.439189 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 487/963] 10.222.0.43 () {56 vars in 1117 bytes} [Mon Apr 11 16:23:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:23:31.440382 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb463a21-d30d-4cc8-977d-ac057bf77fd0 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:31.494260 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9906828f-9373-4553-bc98-70e9c4942b23 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:31.542148 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4410d09-6588-4587-858e-3a00a0763955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:31.542750 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb463a21-d30d-4cc8-977d-ac057bf77fd0 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:31.543687 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4410d09-6588-4587-858e-3a00a0763955 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:31.544340 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4410d09-6588-4587-858e-3a00a0763955 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:31.545576 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4410d09-6588-4587-858e-3a00a0763955 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:31.546495 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4410d09-6588-4587-858e-3a00a0763955 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:31.548421 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4410d09-6588-4587-858e-3a00a0763955 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:31.564032 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-c4410d09-6588-4587-858e-3a00a0763955 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 11 16:23:31.566062 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 477/964] 10.222.0.43 () {56 vars in 1126 bytes} [Mon Apr 11 16:23:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:23:31.573119 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4410d09-6588-4587-858e-3a00a0763955 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:31.582035 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5aa703-ade4-4632-8c15-69dd6a5efdf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:31.582718 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5aa703-ade4-4632-8c15-69dd6a5efdf5 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:31.583001 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5aa703-ade4-4632-8c15-69dd6a5efdf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:31.583276 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5aa703-ade4-4632-8c15-69dd6a5efdf5 None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:31.584708 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5aa703-ade4-4632-8c15-69dd6a5efdf5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:31.585018 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5aa703-ade4-4632-8c15-69dd6a5efdf5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:31.586627 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5aa703-ade4-4632-8c15-69dd6a5efdf5 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:31.614676 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 488/965] 10.222.0.43 () {56 vars in 1149 bytes} [Mon Apr 11 16:23:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:23:31.617515 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5aa703-ade4-4632-8c15-69dd6a5efdf5 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:31.710206 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4410d09-6588-4587-858e-3a00a0763955 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:31.735163 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5aa703-ade4-4632-8c15-69dd6a5efdf5 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:31.753055 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5d9613-0c18-44da-931b-d79cf7581cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:31.753889 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d9613-0c18-44da-931b-d79cf7581cd0 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:31.754169 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d9613-0c18-44da-931b-d79cf7581cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:31.754443 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d9613-0c18-44da-931b-d79cf7581cd0 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:31.755484 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5d9613-0c18-44da-931b-d79cf7581cd0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:31.756121 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5d9613-0c18-44da-931b-d79cf7581cd0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:31.758943 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5d9613-0c18-44da-931b-d79cf7581cd0 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:31.771163 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 478/966] 10.222.0.43 () {56 vars in 1122 bytes} [Mon Apr 11 16:23:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:23:31.772534 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bfc298-5508-4049-a725-beb650505597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:31.773198 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bfc298-5508-4049-a725-beb650505597 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:31.773533 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bfc298-5508-4049-a725-beb650505597 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:31.773792 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bfc298-5508-4049-a725-beb650505597 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:31.780876 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5d9613-0c18-44da-931b-d79cf7581cd0 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:31.871622 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bfc298-5508-4049-a725-beb650505597 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:31.875272 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bfc298-5508-4049-a725-beb650505597 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:31.919752 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5d9613-0c18-44da-931b-d79cf7581cd0 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:31.962577 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af7d4cb-319f-45bb-9393-cd973fce6066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:31.963871 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af7d4cb-319f-45bb-9393-cd973fce6066 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:31.967864 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af7d4cb-319f-45bb-9393-cd973fce6066 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:31.968300 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af7d4cb-319f-45bb-9393-cd973fce6066 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:31.969201 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af7d4cb-319f-45bb-9393-cd973fce6066 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:31.969722 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af7d4cb-319f-45bb-9393-cd973fce6066 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:31.971333 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af7d4cb-319f-45bb-9393-cd973fce6066 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:31.977261 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 479/967] 10.222.0.43 () {56 vars in 1122 bytes} [Mon Apr 11 16:23:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:23:31.983343 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af7d4cb-319f-45bb-9393-cd973fce6066 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:31.998566 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 489/968] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Apr 11 16:23:31 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 11 16:23:32.006987 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bfc298-5508-4049-a725-beb650505597 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:32.098143 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af7d4cb-319f-45bb-9393-cd973fce6066 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:32.122272 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bfc298-5508-4049-a725-beb650505597 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:32.140340 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0958c6-7ba1-4804-b72a-b3173495b814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:32.141267 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0958c6-7ba1-4804-b72a-b3173495b814 None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:32.141691 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0958c6-7ba1-4804-b72a-b3173495b814 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:32.142106 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0958c6-7ba1-4804-b72a-b3173495b814 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:32.142984 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0958c6-7ba1-4804-b72a-b3173495b814 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:32.144513 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0958c6-7ba1-4804-b72a-b3173495b814 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:32.160542 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b83e1-f2e7-4651-82a1-a99f400bdb91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:32.166248 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b83e1-f2e7-4651-82a1-a99f400bdb91 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:32.166248 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b83e1-f2e7-4651-82a1-a99f400bdb91 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:32.166248 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b83e1-f2e7-4651-82a1-a99f400bdb91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:32.172516 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2b83e1-f2e7-4651-82a1-a99f400bdb91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:32.173951 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2b83e1-f2e7-4651-82a1-a99f400bdb91 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:32.190780 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-bf2b83e1-f2e7-4651-82a1-a99f400bdb91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:23:32.192314 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 490/969] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:23:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:23:32.197854 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b83e1-f2e7-4651-82a1-a99f400bdb91 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:32.241090 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 480/970] 10.222.0.43 () {60 vars in 1144 bytes} [Mon Apr 11 16:23:31 2022] POST /identity/v3/endpoints => generated 349 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:23:32.270818 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c19de97-2420-486e-8ef6-f594d30010c7 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:32.271006 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c19de97-2420-486e-8ef6-f594d30010c7 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:32.271943 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c19de97-2420-486e-8ef6-f594d30010c7 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:32.273707 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 481/971] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:23:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 16:23:32.279157 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50d7eda-466c-4ee2-b5b2-0b39e6a0c452 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:32.279445 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50d7eda-466c-4ee2-b5b2-0b39e6a0c452 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:32.279769 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50d7eda-466c-4ee2-b5b2-0b39e6a0c452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:32.298100 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-d50d7eda-466c-4ee2-b5b2-0b39e6a0c452 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:23:32.299347 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-d50d7eda-466c-4ee2-b5b2-0b39e6a0c452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:23:32.317864 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b83e1-f2e7-4651-82a1-a99f400bdb91 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:32.374307 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e0d69-0b03-4f86-a1b6-1074199a456d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:32.374997 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e0d69-0b03-4f86-a1b6-1074199a456d None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:32.375283 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e0d69-0b03-4f86-a1b6-1074199a456d None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:32.375780 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e0d69-0b03-4f86-a1b6-1074199a456d None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:32.376691 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0e0d69-0b03-4f86-a1b6-1074199a456d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:32.377005 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0e0d69-0b03-4f86-a1b6-1074199a456d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:32.378338 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 482/972] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:23:32 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 16:23:32.380075 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0e0d69-0b03-4f86-a1b6-1074199a456d None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:32.397103 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 491/973] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Apr 11 16:23:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:23:32.408808 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50d7eda-466c-4ee2-b5b2-0b39e6a0c452 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:32.411402 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e0d69-0b03-4f86-a1b6-1074199a456d None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:32.529817 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50d7eda-466c-4ee2-b5b2-0b39e6a0c452 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:32.534632 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e0d69-0b03-4f86-a1b6-1074199a456d None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:32.564947 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9908ac-48c7-4c2b-ac41-4a49f4c22050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:32.569411 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9908ac-48c7-4c2b-ac41-4a49f4c22050 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:32.569411 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9908ac-48c7-4c2b-ac41-4a49f4c22050 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:32.569411 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9908ac-48c7-4c2b-ac41-4a49f4c22050 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:32.570919 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079423e1-fd26-46a8-8436-38dda7d969c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:32.571641 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079423e1-fd26-46a8-8436-38dda7d969c6 None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:32.571974 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079423e1-fd26-46a8-8436-38dda7d969c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:32.572254 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079423e1-fd26-46a8-8436-38dda7d969c6 None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:32.572968 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079423e1-fd26-46a8-8436-38dda7d969c6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:32.573644 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9908ac-48c7-4c2b-ac41-4a49f4c22050 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:32.574403 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079423e1-fd26-46a8-8436-38dda7d969c6 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:32.575077 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9908ac-48c7-4c2b-ac41-4a49f4c22050 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:32.588709 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-6c9908ac-48c7-4c2b-ac41-4a49f4c22050 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 16:23:32.590088 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 483/974] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Apr 11 16:23:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:23:32.595686 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9908ac-48c7-4c2b-ac41-4a49f4c22050 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:32.634509 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.sql.core [None req-079423e1-fd26-46a8-8436-38dda7d969c6 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Apr 11 16:23:32.634509 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Apr 11 16:23:32.634509 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [parameters: {'user_id': 'c418b44f63574042987fe5ba72b25f15', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Apr 11 16:23:32.634509 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80241) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Apr 11 16:23:32.643671 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-079423e1-fd26-46a8-8436-38dda7d969c6 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Apr 11 16:23:32.651482 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 492/975] 10.222.0.43 () {60 vars in 1131 bytes} [Mon Apr 11 16:23:32 2022] POST /identity/v3/users => generated 160 bytes in 237 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:23:32.655402 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079423e1-fd26-46a8-8436-38dda7d969c6 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:32.726214 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9908ac-48c7-4c2b-ac41-4a49f4c22050 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:32.769229 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079423e1-fd26-46a8-8436-38dda7d969c6 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:32.778943 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effd3870-49e5-421c-9754-5095a00b14c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:32.779954 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd3870-49e5-421c-9754-5095a00b14c1 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:32.780079 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd3870-49e5-421c-9754-5095a00b14c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:32.780462 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd3870-49e5-421c-9754-5095a00b14c1 None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:32.781354 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effd3870-49e5-421c-9754-5095a00b14c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:32.781739 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effd3870-49e5-421c-9754-5095a00b14c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:32.783302 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effd3870-49e5-421c-9754-5095a00b14c1 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:32.803441 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 484/976] 10.222.0.43 () {56 vars in 1148 bytes} [Mon Apr 11 16:23:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:23:32.805242 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effd3870-49e5-421c-9754-5095a00b14c1 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:32.811699 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d147d4b6-cecc-479a-95df-5f34ac307da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:32.812743 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d147d4b6-cecc-479a-95df-5f34ac307da9 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:32.813210 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d147d4b6-cecc-479a-95df-5f34ac307da9 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:32.813684 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d147d4b6-cecc-479a-95df-5f34ac307da9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:32.824809 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d147d4b6-cecc-479a-95df-5f34ac307da9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:32.827173 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d147d4b6-cecc-479a-95df-5f34ac307da9 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:32.845421 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-d147d4b6-cecc-479a-95df-5f34ac307da9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 11 16:23:32.853175 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 493/977] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Apr 11 16:23:32 2022] GET /identity/v3/users/cinder => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:23:32.854116 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d147d4b6-cecc-479a-95df-5f34ac307da9 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:32.926597 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effd3870-49e5-421c-9754-5095a00b14c1 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:32.962826 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d147d4b6-cecc-479a-95df-5f34ac307da9 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:32.964580 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82459e9-885e-4325-a78e-2f3d45c07090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:32.965495 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82459e9-885e-4325-a78e-2f3d45c07090 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:32.966003 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82459e9-885e-4325-a78e-2f3d45c07090 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:32.966493 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82459e9-885e-4325-a78e-2f3d45c07090 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:32.967546 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82459e9-885e-4325-a78e-2f3d45c07090 None admin] RBAC: Adding query filter params (role.id=c649101bea4344799d49fb57281b6508, scope.project.id=477b9d41390e455a82e733c4fc6acd6b, user.id=3252c48fdd5747a29fe4ba89e7162216) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:32.968071 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82459e9-885e-4325-a78e-2f3d45c07090 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:32.969690 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82459e9-885e-4325-a78e-2f3d45c07090 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:32.976861 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 485/978] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Apr 11 16:23:32 2022] GET /identity/v3/role_assignments?user.id=3252c48fdd5747a29fe4ba89e7162216&scope.project.id=477b9d41390e455a82e733c4fc6acd6b&role.id=c649101bea4344799d49fb57281b6508 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:23:33.002688 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084845c2-26c4-438b-991f-da722359eabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:33.003913 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084845c2-26c4-438b-991f-da722359eabb None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:33.004466 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084845c2-26c4-438b-991f-da722359eabb None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:33.004947 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084845c2-26c4-438b-991f-da722359eabb None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:33.007349 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084845c2-26c4-438b-991f-da722359eabb None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:33.007959 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084845c2-26c4-438b-991f-da722359eabb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:33.009727 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084845c2-26c4-438b-991f-da722359eabb None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:33.056564 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 494/979] 10.222.0.43 () {56 vars in 1101 bytes} [Mon Apr 11 16:23:32 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:23:33.091814 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13291876-2e82-49c0-8a1e-3566828ef63e None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:33.092559 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13291876-2e82-49c0-8a1e-3566828ef63e None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:33.093050 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13291876-2e82-49c0-8a1e-3566828ef63e None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:33.095102 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 486/980] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:23:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:23:33.100970 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a4c919-3130-4ebb-9fb4-06944a26032f None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:33.101288 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a4c919-3130-4ebb-9fb4-06944a26032f None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:33.101534 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a4c919-3130-4ebb-9fb4-06944a26032f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:33.121999 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-20a4c919-3130-4ebb-9fb4-06944a26032f None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:23:33.123680 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-20a4c919-3130-4ebb-9fb4-06944a26032f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:23:33.205444 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 495/981] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:23:33 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:23:33.231093 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13291876-2e82-49c0-8a1e-3566828ef63e None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:33.347541 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13291876-2e82-49c0-8a1e-3566828ef63e None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:33.384066 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09607397-0eac-4167-ac45-5283a30fa124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:33.384846 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09607397-0eac-4167-ac45-5283a30fa124 None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:33.385019 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09607397-0eac-4167-ac45-5283a30fa124 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:33.385299 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09607397-0eac-4167-ac45-5283a30fa124 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:33.386041 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09607397-0eac-4167-ac45-5283a30fa124 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:33.387436 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09607397-0eac-4167-ac45-5283a30fa124 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:33.455727 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 487/982] 10.222.0.43 () {60 vars in 1141 bytes} [Mon Apr 11 16:23:33 2022] POST /identity/v3/services => generated 242 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:23:34.651647 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ced656-0400-4096-bea5-cb63f3def6f4 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:34.652232 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ced656-0400-4096-bea5-cb63f3def6f4 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:34.652232 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ced656-0400-4096-bea5-cb63f3def6f4 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:34.653741 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 496/983] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:23:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:23:34.658823 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdbf114-906f-4fa0-8d48-54985440ef3e None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:34.659300 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdbf114-906f-4fa0-8d48-54985440ef3e None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:34.659390 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdbf114-906f-4fa0-8d48-54985440ef3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:34.676164 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-acdbf114-906f-4fa0-8d48-54985440ef3e None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:23:34.677958 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-acdbf114-906f-4fa0-8d48-54985440ef3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:23:34.750196 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 488/984] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:23:34 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:23:34.773260 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ced656-0400-4096-bea5-cb63f3def6f4 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:34.871050 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ced656-0400-4096-bea5-cb63f3def6f4 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:34.919542 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720ea5a4-4ea7-4ad0-b0d9-bca2a9ad95ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:34.920354 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ea5a4-4ea7-4ad0-b0d9-bca2a9ad95ec None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:34.920631 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ea5a4-4ea7-4ad0-b0d9-bca2a9ad95ec None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:34.920900 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ea5a4-4ea7-4ad0-b0d9-bca2a9ad95ec None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:34.921548 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720ea5a4-4ea7-4ad0-b0d9-bca2a9ad95ec None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:34.922902 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720ea5a4-4ea7-4ad0-b0d9-bca2a9ad95ec None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:34.935121 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-720ea5a4-4ea7-4ad0-b0d9-bca2a9ad95ec None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 11 16:23:34.936537 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 497/985] 10.222.0.43 () {56 vars in 1126 bytes} [Mon Apr 11 16:23:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:23:34.942196 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdbf114-906f-4fa0-8d48-54985440ef3e None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:35.057064 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdbf114-906f-4fa0-8d48-54985440ef3e None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:35.090253 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b85856-a5dd-454b-8124-c88180c35f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:35.090921 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b85856-a5dd-454b-8124-c88180c35f16 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:35.091200 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b85856-a5dd-454b-8124-c88180c35f16 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:35.091472 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b85856-a5dd-454b-8124-c88180c35f16 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:35.092204 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b85856-a5dd-454b-8124-c88180c35f16 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:35.092510 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b85856-a5dd-454b-8124-c88180c35f16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:35.093871 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b85856-a5dd-454b-8124-c88180c35f16 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:35.103765 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 489/986] 10.222.0.43 () {56 vars in 1122 bytes} [Mon Apr 11 16:23:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:35.105364 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720ea5a4-4ea7-4ad0-b0d9-bca2a9ad95ec None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:35.203541 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720ea5a4-4ea7-4ad0-b0d9-bca2a9ad95ec None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:35.247307 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a77f5-4727-449a-8486-c34a22d5c727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:35.248004 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a77f5-4727-449a-8486-c34a22d5c727 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:35.248286 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a77f5-4727-449a-8486-c34a22d5c727 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:35.248560 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a77f5-4727-449a-8486-c34a22d5c727 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:35.249265 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18a77f5-4727-449a-8486-c34a22d5c727 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:35.249570 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18a77f5-4727-449a-8486-c34a22d5c727 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:35.250937 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18a77f5-4727-449a-8486-c34a22d5c727 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:35.256310 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 498/987] 10.222.0.43 () {56 vars in 1122 bytes} [Mon Apr 11 16:23:35 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:35.261929 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b85856-a5dd-454b-8124-c88180c35f16 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:35.359177 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b85856-a5dd-454b-8124-c88180c35f16 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:35.392613 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b3b54-5f52-4884-8f0e-6ec36bc17cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:35.393437 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b3b54-5f52-4884-8f0e-6ec36bc17cab None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:35.393816 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b3b54-5f52-4884-8f0e-6ec36bc17cab None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:35.394190 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b3b54-5f52-4884-8f0e-6ec36bc17cab None admin] PATH_INFO: `/v3/endpoints` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:35.395092 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8b3b54-5f52-4884-8f0e-6ec36bc17cab None admin] RBAC: Adding query filter params (interface=admin, service_id=f66e3e41c19f475985aa856d3ce8ba3c, region_id=RegionOne) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:35.395551 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8b3b54-5f52-4884-8f0e-6ec36bc17cab None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:35.397703 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8b3b54-5f52-4884-8f0e-6ec36bc17cab None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:35.403216 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 490/988] 10.222.0.43 () {56 vars in 1249 bytes} [Mon Apr 11 16:23:35 2022] GET /identity/v3/endpoints?service_id=f66e3e41c19f475985aa856d3ce8ba3c&interface=admin®ion_id=RegionOne => generated 193 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:23:35.408764 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a77f5-4727-449a-8486-c34a22d5c727 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:35.437322 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ff0ce-31c8-4a1a-ad05-31bbb6b39f0a None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:35.437651 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ff0ce-31c8-4a1a-ad05-31bbb6b39f0a None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:35.437895 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ff0ce-31c8-4a1a-ad05-31bbb6b39f0a None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:35.439308 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 491/989] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:23:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 16:23:35.446450 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50a604-facc-4e9d-9f95-f7d62607d446 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:35.446799 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50a604-facc-4e9d-9f95-f7d62607d446 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:35.447019 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50a604-facc-4e9d-9f95-f7d62607d446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:35.464577 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-ed50a604-facc-4e9d-9f95-f7d62607d446 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:23:35.465816 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ed50a604-facc-4e9d-9f95-f7d62607d446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:23:35.524494 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a77f5-4727-449a-8486-c34a22d5c727 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:35.538960 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 492/990] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:23:35 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 16:23:35.560526 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588c4a45-43d6-45a3-be89-4348105cbd5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:35.561082 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed50a604-facc-4e9d-9f95-f7d62607d446 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:35.561198 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588c4a45-43d6-45a3-be89-4348105cbd5a None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:35.561465 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588c4a45-43d6-45a3-be89-4348105cbd5a None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:35.561737 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588c4a45-43d6-45a3-be89-4348105cbd5a None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:35.562417 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588c4a45-43d6-45a3-be89-4348105cbd5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:35.563872 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588c4a45-43d6-45a3-be89-4348105cbd5a None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:35.579587 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 499/991] 10.222.0.43 () {56 vars in 1087 bytes} [Mon Apr 11 16:23:35 2022] GET /identity/v3/services => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:23:35.728652 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed50a604-facc-4e9d-9f95-f7d62607d446 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:35.764312 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce7ab45-1c6c-437c-83a5-f0c9d4d62ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:35.765108 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7ab45-1c6c-437c-83a5-f0c9d4d62ce8 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:35.765389 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7ab45-1c6c-437c-83a5-f0c9d4d62ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:35.765667 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7ab45-1c6c-437c-83a5-f0c9d4d62ce8 None admin] PATH_INFO: `/v3/services/image` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:35.766324 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce7ab45-1c6c-437c-83a5-f0c9d4d62ce8 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:35.767719 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce7ab45-1c6c-437c-83a5-f0c9d4d62ce8 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:35.778747 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-cce7ab45-1c6c-437c-83a5-f0c9d4d62ce8 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Apr 11 16:23:35.780294 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 493/992] 10.222.0.43 () {56 vars in 1105 bytes} [Mon Apr 11 16:23:35 2022] GET /identity/v3/services/image => generated 86 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:23:35.789341 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588c4a45-43d6-45a3-be89-4348105cbd5a None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:35.838934 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa36c4a-4ec3-4070-bf0c-cf8d5d4053c9 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:35.839228 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa36c4a-4ec3-4070-bf0c-cf8d5d4053c9 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:35.839530 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa36c4a-4ec3-4070-bf0c-cf8d5d4053c9 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:35.840907 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 494/993] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:23:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 16:23:35.845959 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc09efe-addc-4955-84f8-920363e04623 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:35.846249 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc09efe-addc-4955-84f8-920363e04623 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:35.846979 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc09efe-addc-4955-84f8-920363e04623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:35.866673 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-0fc09efe-addc-4955-84f8-920363e04623 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:23:35.867989 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0fc09efe-addc-4955-84f8-920363e04623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:23:35.898154 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588c4a45-43d6-45a3-be89-4348105cbd5a None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:35.937127 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b06efe-ca97-47d7-be3a-7a671d17c5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:35.937853 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b06efe-ca97-47d7-be3a-7a671d17c5eb None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:35.938145 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b06efe-ca97-47d7-be3a-7a671d17c5eb None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:35.938466 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b06efe-ca97-47d7-be3a-7a671d17c5eb None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:35.939208 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b06efe-ca97-47d7-be3a-7a671d17c5eb None admin] RBAC: Adding query filter params (name=image) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:35.939535 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b06efe-ca97-47d7-be3a-7a671d17c5eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:35.940971 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b06efe-ca97-47d7-be3a-7a671d17c5eb None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:35.945144 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 495/994] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:23:35 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 16:23:35.954039 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 500/995] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:23:35 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:35.955441 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc09efe-addc-4955-84f8-920363e04623 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:35.969483 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b06efe-ca97-47d7-be3a-7a671d17c5eb None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:36.058069 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc09efe-addc-4955-84f8-920363e04623 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:36.067769 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b06efe-ca97-47d7-be3a-7a671d17c5eb None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:36.091054 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624addf2-a7c1-4a05-8c5f-49d6148e98a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:36.091754 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624addf2-a7c1-4a05-8c5f-49d6148e98a5 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:36.092043 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624addf2-a7c1-4a05-8c5f-49d6148e98a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:36.092323 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624addf2-a7c1-4a05-8c5f-49d6148e98a5 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:36.093036 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624addf2-a7c1-4a05-8c5f-49d6148e98a5 None admin] RBAC: Adding query filter params (type=image) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:36.093349 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624addf2-a7c1-4a05-8c5f-49d6148e98a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:36.094728 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624addf2-a7c1-4a05-8c5f-49d6148e98a5 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:36.100064 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 496/996] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:23:35 2022] GET /identity/v3/services?type=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:23:36.101891 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c22b05-98f1-49f8-9ba2-a175393406db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:36.102701 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c22b05-98f1-49f8-9ba2-a175393406db None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:36.102978 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c22b05-98f1-49f8-9ba2-a175393406db None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:36.103238 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c22b05-98f1-49f8-9ba2-a175393406db None admin] PATH_INFO: `/v3/services/compute` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:36.103934 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c22b05-98f1-49f8-9ba2-a175393406db None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:36.105352 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c22b05-98f1-49f8-9ba2-a175393406db None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:36.119140 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-51c22b05-98f1-49f8-9ba2-a175393406db None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Apr 11 16:23:36.125336 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 501/997] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Apr 11 16:23:35 2022] GET /identity/v3/services/compute => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:23:36.127078 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624addf2-a7c1-4a05-8c5f-49d6148e98a5 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:36.232413 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624addf2-a7c1-4a05-8c5f-49d6148e98a5 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:36.267712 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e219a5aa-c248-4173-a576-a8b8a22108c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:36.268398 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e219a5aa-c248-4173-a576-a8b8a22108c2 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:36.268682 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e219a5aa-c248-4173-a576-a8b8a22108c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:36.268955 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e219a5aa-c248-4173-a576-a8b8a22108c2 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:36.269674 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e219a5aa-c248-4173-a576-a8b8a22108c2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:36.269982 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e219a5aa-c248-4173-a576-a8b8a22108c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:36.272049 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e219a5aa-c248-4173-a576-a8b8a22108c2 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:36.284149 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 497/998] 10.222.0.43 () {56 vars in 1112 bytes} [Mon Apr 11 16:23:36 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:36.284347 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c22b05-98f1-49f8-9ba2-a175393406db None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:36.388257 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c22b05-98f1-49f8-9ba2-a175393406db None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:36.423238 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db264c8f-1d1e-4401-9895-563e8bbd4478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:36.423951 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db264c8f-1d1e-4401-9895-563e8bbd4478 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:36.424237 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db264c8f-1d1e-4401-9895-563e8bbd4478 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:36.424514 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db264c8f-1d1e-4401-9895-563e8bbd4478 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:36.425221 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db264c8f-1d1e-4401-9895-563e8bbd4478 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:36.425530 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db264c8f-1d1e-4401-9895-563e8bbd4478 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:36.427618 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db264c8f-1d1e-4401-9895-563e8bbd4478 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:36.437248 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 502/999] 10.222.0.43 () {56 vars in 1112 bytes} [Mon Apr 11 16:23:36 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:36.438370 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e219a5aa-c248-4173-a576-a8b8a22108c2 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:36.545608 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e219a5aa-c248-4173-a576-a8b8a22108c2 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:36.577898 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65e73f2-da07-42f2-a74f-47d0d7527d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:36.578567 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e73f2-da07-42f2-a74f-47d0d7527d34 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:36.578851 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e73f2-da07-42f2-a74f-47d0d7527d34 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:36.579124 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e73f2-da07-42f2-a74f-47d0d7527d34 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:36.579941 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65e73f2-da07-42f2-a74f-47d0d7527d34 None admin] RBAC: Adding query filter params (interface=public, service_id=0b053af720354707991e9330fc8d70d6, region_id=RegionOne) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:36.580256 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65e73f2-da07-42f2-a74f-47d0d7527d34 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:36.581599 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65e73f2-da07-42f2-a74f-47d0d7527d34 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:36.591567 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 498/1000] 10.222.0.43 () {56 vars in 1251 bytes} [Mon Apr 11 16:23:36 2022] GET /identity/v3/endpoints?service_id=0b053af720354707991e9330fc8d70d6&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:36.592728 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db264c8f-1d1e-4401-9895-563e8bbd4478 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:36.698702 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db264c8f-1d1e-4401-9895-563e8bbd4478 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:36.732406 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f87e44-5902-4eda-ae93-47432fff8370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:36.733082 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f87e44-5902-4eda-ae93-47432fff8370 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:36.733418 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f87e44-5902-4eda-ae93-47432fff8370 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:36.733701 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f87e44-5902-4eda-ae93-47432fff8370 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:36.734386 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f87e44-5902-4eda-ae93-47432fff8370 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:36.735782 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f87e44-5902-4eda-ae93-47432fff8370 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:36.742816 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 503/1001] 10.222.0.43 () {56 vars in 1087 bytes} [Mon Apr 11 16:23:36 2022] GET /identity/v3/services => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 16:23:38.000209 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd0cf7e-ebe9-4f71-be4e-1b97a17a4a42 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:38.000763 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd0cf7e-ebe9-4f71-be4e-1b97a17a4a42 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:38.000763 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd0cf7e-ebe9-4f71-be4e-1b97a17a4a42 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:38.003563 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 499/1002] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:23:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:23:38.007777 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc3c5b3-6e1f-432c-93a3-8bac0cd2557a None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:38.008200 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc3c5b3-6e1f-432c-93a3-8bac0cd2557a None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:38.008408 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc3c5b3-6e1f-432c-93a3-8bac0cd2557a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:38.027597 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-1bc3c5b3-6e1f-432c-93a3-8bac0cd2557a None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:23:38.029308 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-1bc3c5b3-6e1f-432c-93a3-8bac0cd2557a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:23:38.107568 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 504/1003] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:23:38 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:23:38.131942 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd0cf7e-ebe9-4f71-be4e-1b97a17a4a42 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:38.230333 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd0cf7e-ebe9-4f71-be4e-1b97a17a4a42 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:38.262114 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e06623-f720-422d-92db-59d378cf934a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:38.263192 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e06623-f720-422d-92db-59d378cf934a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:38.263675 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e06623-f720-422d-92db-59d378cf934a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:38.264109 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e06623-f720-422d-92db-59d378cf934a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:38.264918 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e06623-f720-422d-92db-59d378cf934a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:38.266400 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e06623-f720-422d-92db-59d378cf934a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:38.278117 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-71e06623-f720-422d-92db-59d378cf934a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 11 16:23:38.279743 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 500/1004] 10.222.0.43 () {56 vars in 1126 bytes} [Mon Apr 11 16:23:38 2022] GET /identity/v3/services/object-store => generated 93 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:23:38.285579 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc3c5b3-6e1f-432c-93a3-8bac0cd2557a None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:38.379075 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc3c5b3-6e1f-432c-93a3-8bac0cd2557a None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:38.413330 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71de9a2b-be92-4748-92f1-3ef22586fed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:38.413997 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de9a2b-be92-4748-92f1-3ef22586fed5 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:38.414277 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de9a2b-be92-4748-92f1-3ef22586fed5 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:38.414567 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de9a2b-be92-4748-92f1-3ef22586fed5 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:38.415243 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71de9a2b-be92-4748-92f1-3ef22586fed5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:38.415580 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71de9a2b-be92-4748-92f1-3ef22586fed5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:38.416931 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71de9a2b-be92-4748-92f1-3ef22586fed5 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:38.421754 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 505/1005] 10.222.0.43 () {56 vars in 1122 bytes} [Mon Apr 11 16:23:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:23:38.427370 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e06623-f720-422d-92db-59d378cf934a None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:38.528904 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e06623-f720-422d-92db-59d378cf934a None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:38.561293 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c7a57d-4b06-4441-9be3-cb1b6e40d183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:38.561959 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7a57d-4b06-4441-9be3-cb1b6e40d183 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:38.562239 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7a57d-4b06-4441-9be3-cb1b6e40d183 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:38.562514 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7a57d-4b06-4441-9be3-cb1b6e40d183 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:38.563217 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c7a57d-4b06-4441-9be3-cb1b6e40d183 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:38.563543 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c7a57d-4b06-4441-9be3-cb1b6e40d183 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:38.564946 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c7a57d-4b06-4441-9be3-cb1b6e40d183 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:38.574815 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 501/1006] 10.222.0.43 () {56 vars in 1122 bytes} [Mon Apr 11 16:23:38 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:38.575937 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71de9a2b-be92-4748-92f1-3ef22586fed5 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:38.672487 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71de9a2b-be92-4748-92f1-3ef22586fed5 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:38.705160 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9fd4be-1274-45c1-bded-474203e708c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:38.705816 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9fd4be-1274-45c1-bded-474203e708c8 None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:38.706094 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9fd4be-1274-45c1-bded-474203e708c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:38.706365 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9fd4be-1274-45c1-bded-474203e708c8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:38.707105 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9fd4be-1274-45c1-bded-474203e708c8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:38.709067 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9fd4be-1274-45c1-bded-474203e708c8 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:38.744630 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f5a734-7c41-4330-b3b6-2f19b20cd35c None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:38.744917 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f5a734-7c41-4330-b3b6-2f19b20cd35c None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:38.745193 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f5a734-7c41-4330-b3b6-2f19b20cd35c None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:38.746612 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 502/1007] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:23:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 16:23:38.751465 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc17d8a-956a-4b44-80e1-67fdbd841408 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:38.751770 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc17d8a-956a-4b44-80e1-67fdbd841408 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:38.755853 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc17d8a-956a-4b44-80e1-67fdbd841408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:38.769157 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-7fc17d8a-956a-4b44-80e1-67fdbd841408 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:23:38.770973 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-7fc17d8a-956a-4b44-80e1-67fdbd841408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:23:38.795812 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 506/1008] 10.222.0.43 () {60 vars in 1144 bytes} [Mon Apr 11 16:23:38 2022] POST /identity/v3/endpoints => generated 325 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:23:38.849335 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 503/1009] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:23:38 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 16:23:38.874519 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9fd4be-1274-45c1-bded-474203e708c8 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:38.988482 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9fd4be-1274-45c1-bded-474203e708c8 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:39.025350 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946c3ddb-9838-4189-9345-d2e9929336a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:39.026120 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c3ddb-9838-4189-9345-d2e9929336a7 None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:39.026324 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c3ddb-9838-4189-9345-d2e9929336a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:39.026599 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c3ddb-9838-4189-9345-d2e9929336a7 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:39.027360 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946c3ddb-9838-4189-9345-d2e9929336a7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:39.028801 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946c3ddb-9838-4189-9345-d2e9929336a7 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:39.146948 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 507/1010] 10.222.0.43 () {60 vars in 1141 bytes} [Mon Apr 11 16:23:38 2022] POST /identity/v3/services => generated 242 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:23:39.403779 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c39ae-eb4a-42e8-b4be-83545b6daddd None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:39.404387 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c39ae-eb4a-42e8-b4be-83545b6daddd None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:39.404387 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c39ae-eb4a-42e8-b4be-83545b6daddd None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:39.405756 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 504/1011] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:23:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:23:39.411452 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b56f054-6de7-4b91-9060-ba72be55c0a9 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:39.411935 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b56f054-6de7-4b91-9060-ba72be55c0a9 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:39.412206 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b56f054-6de7-4b91-9060-ba72be55c0a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:39.429209 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-5b56f054-6de7-4b91-9060-ba72be55c0a9 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:23:39.430401 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-5b56f054-6de7-4b91-9060-ba72be55c0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:23:39.504375 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 508/1012] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:23:39 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:23:39.527926 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18c39ae-eb4a-42e8-b4be-83545b6daddd None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:39.626165 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18c39ae-eb4a-42e8-b4be-83545b6daddd None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:39.659633 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fcfc67-302e-4ca9-8def-d6e3b696473b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:39.660359 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fcfc67-302e-4ca9-8def-d6e3b696473b None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:39.660639 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fcfc67-302e-4ca9-8def-d6e3b696473b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:39.661461 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fcfc67-302e-4ca9-8def-d6e3b696473b None admin] PATH_INFO: `/v3/services/compute` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:39.662293 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fcfc67-302e-4ca9-8def-d6e3b696473b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:39.663677 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fcfc67-302e-4ca9-8def-d6e3b696473b None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:39.674462 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-21fcfc67-302e-4ca9-8def-d6e3b696473b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Apr 11 16:23:39.675811 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 505/1013] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Apr 11 16:23:39 2022] GET /identity/v3/services/compute => generated 88 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:23:39.681800 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b56f054-6de7-4b91-9060-ba72be55c0a9 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:39.780355 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b56f054-6de7-4b91-9060-ba72be55c0a9 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:39.819048 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9e35f6-29cb-49c3-ba98-106b66da8ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:39.819819 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e35f6-29cb-49c3-ba98-106b66da8ea5 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:39.820105 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e35f6-29cb-49c3-ba98-106b66da8ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:39.820380 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e35f6-29cb-49c3-ba98-106b66da8ea5 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:39.821093 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9e35f6-29cb-49c3-ba98-106b66da8ea5 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:39.821398 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9e35f6-29cb-49c3-ba98-106b66da8ea5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:39.822771 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9e35f6-29cb-49c3-ba98-106b66da8ea5 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:39.828013 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 509/1014] 10.222.0.43 () {56 vars in 1112 bytes} [Mon Apr 11 16:23:39 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:39.833582 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fcfc67-302e-4ca9-8def-d6e3b696473b None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:39.930818 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fcfc67-302e-4ca9-8def-d6e3b696473b None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:39.963063 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fde296-7171-45b3-b1db-910f2889d55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:39.963777 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fde296-7171-45b3-b1db-910f2889d55c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:39.964062 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fde296-7171-45b3-b1db-910f2889d55c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:39.964339 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fde296-7171-45b3-b1db-910f2889d55c None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:39.965135 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fde296-7171-45b3-b1db-910f2889d55c None admin] RBAC: Adding query filter params (type=compute) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:39.965473 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fde296-7171-45b3-b1db-910f2889d55c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:39.966876 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fde296-7171-45b3-b1db-910f2889d55c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:39.972994 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 506/1015] 10.222.0.43 () {56 vars in 1112 bytes} [Mon Apr 11 16:23:39 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:39.979300 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9e35f6-29cb-49c3-ba98-106b66da8ea5 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:40.076631 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9e35f6-29cb-49c3-ba98-106b66da8ea5 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:40.110051 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd32fb4-5ebf-4096-976d-cb486568d0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:40.110711 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd32fb4-5ebf-4096-976d-cb486568d0ab None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:40.110989 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd32fb4-5ebf-4096-976d-cb486568d0ab None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:40.111261 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd32fb4-5ebf-4096-976d-cb486568d0ab None admin] PATH_INFO: `/v3/endpoints` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:40.112034 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd32fb4-5ebf-4096-976d-cb486568d0ab None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:40.113643 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd32fb4-5ebf-4096-976d-cb486568d0ab None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:40.205214 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 510/1016] 10.222.0.43 () {60 vars in 1144 bytes} [Mon Apr 11 16:23:39 2022] POST /identity/v3/endpoints => generated 334 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:23:41.192031 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45381ab2-23c9-489c-ae7a-16dd762326a8 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:41.192638 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45381ab2-23c9-489c-ae7a-16dd762326a8 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:41.192848 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45381ab2-23c9-489c-ae7a-16dd762326a8 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:41.194399 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 507/1017] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:23:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:23:41.199823 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80508dbd-3e69-44c5-8df3-ee8dbbf3465e None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:41.200223 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80508dbd-3e69-44c5-8df3-ee8dbbf3465e None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:41.200387 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80508dbd-3e69-44c5-8df3-ee8dbbf3465e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:41.217832 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-80508dbd-3e69-44c5-8df3-ee8dbbf3465e None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:23:41.219024 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-80508dbd-3e69-44c5-8df3-ee8dbbf3465e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:23:41.291057 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 511/1018] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:23:41 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:23:41.316126 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45381ab2-23c9-489c-ae7a-16dd762326a8 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:41.419298 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45381ab2-23c9-489c-ae7a-16dd762326a8 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:41.456147 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febeb8b5-82d4-44b4-8a2e-80485b277cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:41.457319 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febeb8b5-82d4-44b4-8a2e-80485b277cb1 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:41.458902 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febeb8b5-82d4-44b4-8a2e-80485b277cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:41.459390 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febeb8b5-82d4-44b4-8a2e-80485b277cb1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:41.460860 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febeb8b5-82d4-44b4-8a2e-80485b277cb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:41.462497 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febeb8b5-82d4-44b4-8a2e-80485b277cb1 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:41.464669 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 508/1019] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:23:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:41.470345 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80508dbd-3e69-44c5-8df3-ee8dbbf3465e None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:41.502784 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e73d2e-a0dd-4c8c-b224-37f6e9bc6eaa None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:41.503102 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e73d2e-a0dd-4c8c-b224-37f6e9bc6eaa None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:41.503358 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e73d2e-a0dd-4c8c-b224-37f6e9bc6eaa None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:41.505216 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 509/1020] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:23:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 16:23:41.510207 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc61f1d1-f3d7-4c43-9476-cef781444bf5 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:41.510498 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc61f1d1-f3d7-4c43-9476-cef781444bf5 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:41.510779 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc61f1d1-f3d7-4c43-9476-cef781444bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:41.527023 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-cc61f1d1-f3d7-4c43-9476-cef781444bf5 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:23:41.528260 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-cc61f1d1-f3d7-4c43-9476-cef781444bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:23:41.574412 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80508dbd-3e69-44c5-8df3-ee8dbbf3465e None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:41.595226 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 510/1021] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:23:41 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 16:23:41.608485 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca548f7-18cf-45bb-89c9-ef30efee2bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:41.609421 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca548f7-18cf-45bb-89c9-ef30efee2bd7 None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:41.609889 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca548f7-18cf-45bb-89c9-ef30efee2bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:41.610347 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca548f7-18cf-45bb-89c9-ef30efee2bd7 None admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:41.611247 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca548f7-18cf-45bb-89c9-ef30efee2bd7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:41.613145 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca548f7-18cf-45bb-89c9-ef30efee2bd7 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:41.619936 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc61f1d1-f3d7-4c43-9476-cef781444bf5 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:41.700750 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 512/1022] 10.222.0.43 () {60 vars in 1141 bytes} [Mon Apr 11 16:23:41 2022] POST /identity/v3/projects => generated 311 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:23:41.716270 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc61f1d1-f3d7-4c43-9476-cef781444bf5 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:41.755100 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5842625c-2292-4fee-a158-f42991e3c0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:41.756475 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5842625c-2292-4fee-a158-f42991e3c0fa None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:41.756985 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5842625c-2292-4fee-a158-f42991e3c0fa None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:41.757457 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5842625c-2292-4fee-a158-f42991e3c0fa None admin] PATH_INFO: `/v3/services/image` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:41.758341 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5842625c-2292-4fee-a158-f42991e3c0fa None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:41.760001 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5842625c-2292-4fee-a158-f42991e3c0fa None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:41.772194 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-5842625c-2292-4fee-a158-f42991e3c0fa None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Apr 11 16:23:41.773688 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 511/1023] 10.222.0.43 () {56 vars in 1105 bytes} [Mon Apr 11 16:23:41 2022] GET /identity/v3/services/image => generated 86 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:23:41.779549 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca548f7-18cf-45bb-89c9-ef30efee2bd7 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:41.886821 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca548f7-18cf-45bb-89c9-ef30efee2bd7 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:41.922473 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f63aa-d519-4393-b5bd-be80e5ed45c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:41.923156 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f63aa-d519-4393-b5bd-be80e5ed45c9 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:41.923440 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f63aa-d519-4393-b5bd-be80e5ed45c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:41.923755 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f63aa-d519-4393-b5bd-be80e5ed45c9 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:41.924467 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88f63aa-d519-4393-b5bd-be80e5ed45c9 None admin] RBAC: Adding query filter params (name=image) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:41.924778 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88f63aa-d519-4393-b5bd-be80e5ed45c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:41.926169 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88f63aa-d519-4393-b5bd-be80e5ed45c9 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:41.931196 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 513/1024] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:23:41 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:41.937129 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5842625c-2292-4fee-a158-f42991e3c0fa None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:42.037847 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5842625c-2292-4fee-a158-f42991e3c0fa None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:42.069892 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d363ffd-9692-4ea6-9bbd-f1eee4d594d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:42.070564 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d363ffd-9692-4ea6-9bbd-f1eee4d594d8 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:42.070849 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d363ffd-9692-4ea6-9bbd-f1eee4d594d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:42.071126 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d363ffd-9692-4ea6-9bbd-f1eee4d594d8 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:42.071864 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d363ffd-9692-4ea6-9bbd-f1eee4d594d8 None admin] RBAC: Adding query filter params (type=image) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:42.072174 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d363ffd-9692-4ea6-9bbd-f1eee4d594d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:42.073537 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d363ffd-9692-4ea6-9bbd-f1eee4d594d8 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:42.083596 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 512/1025] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:23:41 2022] GET /identity/v3/services?type=image => generated 350 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:23:42.085163 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f63aa-d519-4393-b5bd-be80e5ed45c9 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:42.189760 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f63aa-d519-4393-b5bd-be80e5ed45c9 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:42.225454 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad8eb01-92cb-442f-a5be-5f4d25a2b07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:42.226227 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8eb01-92cb-442f-a5be-5f4d25a2b07f None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:42.226453 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8eb01-92cb-442f-a5be-5f4d25a2b07f None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:42.226772 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8eb01-92cb-442f-a5be-5f4d25a2b07f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:42.227580 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad8eb01-92cb-442f-a5be-5f4d25a2b07f None admin] RBAC: Adding query filter params (interface=public, service_id=6e19fc3ed9d74c95879c80b0c7907f51, region_id=RegionOne) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:42.227894 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad8eb01-92cb-442f-a5be-5f4d25a2b07f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:42.229241 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad8eb01-92cb-442f-a5be-5f4d25a2b07f None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:42.235305 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 514/1026] 10.222.0.43 () {56 vars in 1251 bytes} [Mon Apr 11 16:23:42 2022] GET /identity/v3/endpoints?service_id=6e19fc3ed9d74c95879c80b0c7907f51&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:42.240549 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d363ffd-9692-4ea6-9bbd-f1eee4d594d8 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:42.343209 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d363ffd-9692-4ea6-9bbd-f1eee4d594d8 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:42.376174 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d7bbaa-d488-4f7f-b76c-d09fb966be47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:42.377168 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d7bbaa-d488-4f7f-b76c-d09fb966be47 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:42.377646 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d7bbaa-d488-4f7f-b76c-d09fb966be47 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:42.378116 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d7bbaa-d488-4f7f-b76c-d09fb966be47 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:42.378985 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d7bbaa-d488-4f7f-b76c-d09fb966be47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:42.380633 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d7bbaa-d488-4f7f-b76c-d09fb966be47 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:42.387036 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 513/1027] 10.222.0.43 () {56 vars in 1087 bytes} [Mon Apr 11 16:23:42 2022] GET /identity/v3/services => generated 1957 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 16:23:42.688673 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b5a33-3fa1-4828-a91c-f7372d6065b6 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:42.688967 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b5a33-3fa1-4828-a91c-f7372d6065b6 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:42.689459 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b5a33-3fa1-4828-a91c-f7372d6065b6 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:42.690989 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 515/1028] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:23:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:23:42.696826 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca978a-4a87-4d52-afa3-09aa20223349 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:42.697124 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca978a-4a87-4d52-afa3-09aa20223349 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:42.697409 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca978a-4a87-4d52-afa3-09aa20223349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:42.713975 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-2cca978a-4a87-4d52-afa3-09aa20223349 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:23:42.715178 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-2cca978a-4a87-4d52-afa3-09aa20223349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:23:42.796280 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 514/1029] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:23:42 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:23:42.822370 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b5a33-3fa1-4828-a91c-f7372d6065b6 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:42.920390 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b5a33-3fa1-4828-a91c-f7372d6065b6 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:42.960094 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7558d6d-816e-468e-922d-6d1aa9572d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:42.961016 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7558d6d-816e-468e-922d-6d1aa9572d96 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:42.961305 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7558d6d-816e-468e-922d-6d1aa9572d96 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:42.961582 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7558d6d-816e-468e-922d-6d1aa9572d96 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:42.972915 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7558d6d-816e-468e-922d-6d1aa9572d96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:23:42.980715 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-d7558d6d-816e-468e-922d-6d1aa9572d96 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 11 16:23:42.982113 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 516/1030] 10.222.0.43 () {56 vars in 1120 bytes} [Mon Apr 11 16:23:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:23:42.988206 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cca978a-4a87-4d52-afa3-09aa20223349 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:43.097960 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cca978a-4a87-4d52-afa3-09aa20223349 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:43.132557 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3bf303-d8bd-4e08-a737-abf2775554a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:43.133246 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3bf303-d8bd-4e08-a737-abf2775554a2 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:43.133533 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3bf303-d8bd-4e08-a737-abf2775554a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:43.133811 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3bf303-d8bd-4e08-a737-abf2775554a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:43.134572 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3bf303-d8bd-4e08-a737-abf2775554a2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:43.134891 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3bf303-d8bd-4e08-a737-abf2775554a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:43.136291 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3bf303-d8bd-4e08-a737-abf2775554a2 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:43.145403 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 515/1031] 10.222.0.43 () {56 vars in 1115 bytes} [Mon Apr 11 16:23:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:23:43.151068 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7558d6d-816e-468e-922d-6d1aa9572d96 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:43.255799 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7558d6d-816e-468e-922d-6d1aa9572d96 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:43.282585 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0627d83-2be9-4ceb-92df-29d745482434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:43.283385 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0627d83-2be9-4ceb-92df-29d745482434 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:43.283695 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0627d83-2be9-4ceb-92df-29d745482434 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:43.283964 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0627d83-2be9-4ceb-92df-29d745482434 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:43.293918 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0627d83-2be9-4ceb-92df-29d745482434 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:43.295372 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0627d83-2be9-4ceb-92df-29d745482434 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:43.312449 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-e0627d83-2be9-4ceb-92df-29d745482434 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:23:43.313817 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 517/1032] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:23:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:23:43.320083 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3bf303-d8bd-4e08-a737-abf2775554a2 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:43.423805 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3bf303-d8bd-4e08-a737-abf2775554a2 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:43.457615 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d045c3-3332-4617-ba71-7b298027652c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:43.458293 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d045c3-3332-4617-ba71-7b298027652c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:43.458573 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d045c3-3332-4617-ba71-7b298027652c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:43.458849 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d045c3-3332-4617-ba71-7b298027652c None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:43.459592 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d045c3-3332-4617-ba71-7b298027652c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:43.459902 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d045c3-3332-4617-ba71-7b298027652c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:43.461254 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d045c3-3332-4617-ba71-7b298027652c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:43.474939 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 516/1033] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Apr 11 16:23:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:43.479088 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0627d83-2be9-4ceb-92df-29d745482434 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:43.585670 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0627d83-2be9-4ceb-92df-29d745482434 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:43.619314 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e40386-c6e8-4720-8022-634fb3dd9304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:43.620150 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e40386-c6e8-4720-8022-634fb3dd9304 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:43.620432 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e40386-c6e8-4720-8022-634fb3dd9304 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:43.620703 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e40386-c6e8-4720-8022-634fb3dd9304 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:43.628158 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e40386-c6e8-4720-8022-634fb3dd9304 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:43.630149 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e40386-c6e8-4720-8022-634fb3dd9304 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:43.643468 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-04e40386-c6e8-4720-8022-634fb3dd9304 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 11 16:23:43.644861 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 518/1034] 10.222.0.43 () {56 vars in 1093 bytes} [Mon Apr 11 16:23:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:23:43.650501 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d045c3-3332-4617-ba71-7b298027652c None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:43.747631 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d045c3-3332-4617-ba71-7b298027652c None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:43.782226 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1daf21-01e0-4eff-8c26-11438145af9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:43.782932 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1daf21-01e0-4eff-8c26-11438145af9e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:43.783218 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1daf21-01e0-4eff-8c26-11438145af9e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:43.783494 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1daf21-01e0-4eff-8c26-11438145af9e None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:43.784391 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1daf21-01e0-4eff-8c26-11438145af9e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:43.784705 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1daf21-01e0-4eff-8c26-11438145af9e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:43.786772 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1daf21-01e0-4eff-8c26-11438145af9e None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:43.810693 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 517/1035] 10.222.0.43 () {56 vars in 1133 bytes} [Mon Apr 11 16:23:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:43.811879 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e40386-c6e8-4720-8022-634fb3dd9304 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:43.911151 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e40386-c6e8-4720-8022-634fb3dd9304 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:43.944083 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efef51d5-3cb8-45cb-9829-62edf55f59f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:43.944739 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef51d5-3cb8-45cb-9829-62edf55f59f1 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:43.945038 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef51d5-3cb8-45cb-9829-62edf55f59f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:43.945300 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef51d5-3cb8-45cb-9829-62edf55f59f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:44.010730 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efef51d5-3cb8-45cb-9829-62edf55f59f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:44.012209 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efef51d5-3cb8-45cb-9829-62edf55f59f1 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:44.112176 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 519/1036] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Apr 11 16:23:43 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 16:23:44.114972 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1daf21-01e0-4eff-8c26-11438145af9e None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:44.162025 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de05e86-01f3-44bd-87e1-f369188e59e8 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:44.162215 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de05e86-01f3-44bd-87e1-f369188e59e8 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:44.162503 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de05e86-01f3-44bd-87e1-f369188e59e8 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:44.164051 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 520/1037] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:23:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 16:23:44.169511 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a91970-0532-4cd9-9c0d-901cd860012e None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:44.169802 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a91970-0532-4cd9-9c0d-901cd860012e None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:44.170085 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a91970-0532-4cd9-9c0d-901cd860012e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:44.188378 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-44a91970-0532-4cd9-9c0d-901cd860012e None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:23:44.189956 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-44a91970-0532-4cd9-9c0d-901cd860012e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:23:44.223406 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1daf21-01e0-4eff-8c26-11438145af9e None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:44.258580 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9757343f-1f50-4e6b-b5a6-e2d1eba34eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:44.259382 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9757343f-1f50-4e6b-b5a6-e2d1eba34eca None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:44.259696 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9757343f-1f50-4e6b-b5a6-e2d1eba34eca None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:44.259976 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9757343f-1f50-4e6b-b5a6-e2d1eba34eca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:44.263487 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 521/1038] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:23:44 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 16:23:44.270288 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9757343f-1f50-4e6b-b5a6-e2d1eba34eca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:44.271772 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9757343f-1f50-4e6b-b5a6-e2d1eba34eca None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:44.288724 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-9757343f-1f50-4e6b-b5a6-e2d1eba34eca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:23:44.289573 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a91970-0532-4cd9-9c0d-901cd860012e None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:44.294413 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 518/1039] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:23:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:23:44.295223 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9757343f-1f50-4e6b-b5a6-e2d1eba34eca None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:44.390689 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a91970-0532-4cd9-9c0d-901cd860012e None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:44.393962 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9757343f-1f50-4e6b-b5a6-e2d1eba34eca None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:44.428163 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f31326-7ebf-46be-991c-e126f65b1565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:44.428900 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f31326-7ebf-46be-991c-e126f65b1565 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:44.429186 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f31326-7ebf-46be-991c-e126f65b1565 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:44.429488 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f31326-7ebf-46be-991c-e126f65b1565 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:44.430139 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6401b5c-a19d-400e-b33e-12eca5a8ed3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:44.430698 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f31326-7ebf-46be-991c-e126f65b1565 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:44.430856 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6401b5c-a19d-400e-b33e-12eca5a8ed3b None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:44.431104 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6401b5c-a19d-400e-b33e-12eca5a8ed3b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:44.431378 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6401b5c-a19d-400e-b33e-12eca5a8ed3b None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:44.432154 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6401b5c-a19d-400e-b33e-12eca5a8ed3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:44.432251 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f31326-7ebf-46be-991c-e126f65b1565 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:44.432465 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6401b5c-a19d-400e-b33e-12eca5a8ed3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:44.434049 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6401b5c-a19d-400e-b33e-12eca5a8ed3b None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:44.434165 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 522/1040] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:23:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:23:44.439683 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f31326-7ebf-46be-991c-e126f65b1565 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:44.452745 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 519/1041] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Apr 11 16:23:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:44.453855 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6401b5c-a19d-400e-b33e-12eca5a8ed3b None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:44.549589 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f31326-7ebf-46be-991c-e126f65b1565 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:44.562206 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6401b5c-a19d-400e-b33e-12eca5a8ed3b None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:44.583594 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b690e33a-7eb7-44d6-b67c-9be6b4c7ccb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:44.584277 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b690e33a-7eb7-44d6-b67c-9be6b4c7ccb8 None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:44.584560 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b690e33a-7eb7-44d6-b67c-9be6b4c7ccb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:44.584840 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b690e33a-7eb7-44d6-b67c-9be6b4c7ccb8 None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:44.585580 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b690e33a-7eb7-44d6-b67c-9be6b4c7ccb8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:44.586998 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b690e33a-7eb7-44d6-b67c-9be6b4c7ccb8 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:44.595152 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afcb0dc-69ed-4077-9487-78fd89dec5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:44.596166 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afcb0dc-69ed-4077-9487-78fd89dec5f0 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:44.596449 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afcb0dc-69ed-4077-9487-78fd89dec5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:44.596722 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afcb0dc-69ed-4077-9487-78fd89dec5f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:44.604122 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afcb0dc-69ed-4077-9487-78fd89dec5f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:44.605629 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afcb0dc-69ed-4077-9487-78fd89dec5f0 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:44.620334 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-2afcb0dc-69ed-4077-9487-78fd89dec5f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 16:23:44.621541 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 520/1042] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Apr 11 16:23:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:23:44.627277 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afcb0dc-69ed-4077-9487-78fd89dec5f0 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:44.670735 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 523/1043] 10.222.0.43 () {60 vars in 1132 bytes} [Mon Apr 11 16:23:44 2022] POST /identity/v3/users => generated 285 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:23:44.736573 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afcb0dc-69ed-4077-9487-78fd89dec5f0 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:44.776214 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5b82e5-3778-49ae-81cc-da1c9f451c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:44.776901 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b82e5-3778-49ae-81cc-da1c9f451c44 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:44.777188 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b82e5-3778-49ae-81cc-da1c9f451c44 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:44.777466 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b82e5-3778-49ae-81cc-da1c9f451c44 None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:44.778266 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5b82e5-3778-49ae-81cc-da1c9f451c44 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:44.778579 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5b82e5-3778-49ae-81cc-da1c9f451c44 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:44.780054 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5b82e5-3778-49ae-81cc-da1c9f451c44 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:44.798097 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 521/1044] 10.222.0.43 () {56 vars in 1148 bytes} [Mon Apr 11 16:23:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:23:44.799213 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b690e33a-7eb7-44d6-b67c-9be6b4c7ccb8 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:44.802449 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af39ddd-3eb4-46b8-94a1-d3269d466995 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:44.802730 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af39ddd-3eb4-46b8-94a1-d3269d466995 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:44.803009 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af39ddd-3eb4-46b8-94a1-d3269d466995 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:44.804600 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 522/1045] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:23:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 16:23:44.810080 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4e09d-0f6a-4502-b36e-7dc8a425668d None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:44.810360 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4e09d-0f6a-4502-b36e-7dc8a425668d None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:44.810642 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4e09d-0f6a-4502-b36e-7dc8a425668d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:44.827503 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-93d4e09d-0f6a-4502-b36e-7dc8a425668d None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:23:44.828751 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-93d4e09d-0f6a-4502-b36e-7dc8a425668d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:23:44.899359 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 523/1046] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:23:44 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 16:23:44.907389 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b690e33a-7eb7-44d6-b67c-9be6b4c7ccb8 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:44.924048 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d4e09d-0f6a-4502-b36e-7dc8a425668d None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:44.949763 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ff0b9-c57a-4558-b9ef-735539ec90d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:44.950430 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ff0b9-c57a-4558-b9ef-735539ec90d5 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:44.950708 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ff0b9-c57a-4558-b9ef-735539ec90d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:44.950983 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ff0b9-c57a-4558-b9ef-735539ec90d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:44.951938 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4ff0b9-c57a-4558-b9ef-735539ec90d5 None admin] RBAC: Adding query filter params (role.id=c649101bea4344799d49fb57281b6508, scope.project.id=477b9d41390e455a82e733c4fc6acd6b, user.id=1be2652c984a4283aeee0b937f0555e4) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:44.952250 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4ff0b9-c57a-4558-b9ef-735539ec90d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:44.953666 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4ff0b9-c57a-4558-b9ef-735539ec90d5 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:44.965575 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 524/1047] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Apr 11 16:23:44 2022] GET /identity/v3/role_assignments?user.id=1be2652c984a4283aeee0b937f0555e4&scope.project.id=477b9d41390e455a82e733c4fc6acd6b&role.id=c649101bea4344799d49fb57281b6508 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:23:45.032153 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d4e09d-0f6a-4502-b36e-7dc8a425668d None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:45.069864 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7229f7cd-b45b-4626-bd8c-913ad0c8799b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:45.070693 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7229f7cd-b45b-4626-bd8c-913ad0c8799b None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:45.070977 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7229f7cd-b45b-4626-bd8c-913ad0c8799b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:45.071252 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7229f7cd-b45b-4626-bd8c-913ad0c8799b None admin] PATH_INFO: `/v3/services/image` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:45.071970 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7229f7cd-b45b-4626-bd8c-913ad0c8799b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:45.073391 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7229f7cd-b45b-4626-bd8c-913ad0c8799b None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:45.085718 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-7229f7cd-b45b-4626-bd8c-913ad0c8799b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Apr 11 16:23:45.087182 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 524/1048] 10.222.0.43 () {56 vars in 1105 bytes} [Mon Apr 11 16:23:44 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:23:45.093204 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ff0b9-c57a-4558-b9ef-735539ec90d5 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:45.196974 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ff0b9-c57a-4558-b9ef-735539ec90d5 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:45.229675 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfe8be8-339e-4fa6-81a6-48cb3beb9ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:45.230346 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe8be8-339e-4fa6-81a6-48cb3beb9ee9 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:45.230626 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe8be8-339e-4fa6-81a6-48cb3beb9ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:45.230898 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe8be8-339e-4fa6-81a6-48cb3beb9ee9 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:45.231633 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfe8be8-339e-4fa6-81a6-48cb3beb9ee9 None admin] RBAC: Adding query filter params (name=image) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:45.231941 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfe8be8-339e-4fa6-81a6-48cb3beb9ee9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:45.233305 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfe8be8-339e-4fa6-81a6-48cb3beb9ee9 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:45.239471 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 525/1049] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:23:45 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:45.244949 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7229f7cd-b45b-4626-bd8c-913ad0c8799b None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:45.342446 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7229f7cd-b45b-4626-bd8c-913ad0c8799b None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:45.374863 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca03883-7ef2-4437-ae2a-f91f0065a036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:45.375741 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca03883-7ef2-4437-ae2a-f91f0065a036 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:45.375872 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca03883-7ef2-4437-ae2a-f91f0065a036 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:45.376114 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca03883-7ef2-4437-ae2a-f91f0065a036 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:45.376824 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca03883-7ef2-4437-ae2a-f91f0065a036 None admin] RBAC: Adding query filter params (type=image) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:45.377130 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca03883-7ef2-4437-ae2a-f91f0065a036 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:45.378489 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca03883-7ef2-4437-ae2a-f91f0065a036 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:45.389554 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 525/1050] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:23:45 2022] GET /identity/v3/services?type=image => generated 350 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:45.389722 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfe8be8-339e-4fa6-81a6-48cb3beb9ee9 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:45.491489 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfe8be8-339e-4fa6-81a6-48cb3beb9ee9 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:45.529682 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386ce137-b98f-49b0-a679-dbeadbab4cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:45.530768 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ce137-b98f-49b0-a679-dbeadbab4cb4 None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:45.531245 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ce137-b98f-49b0-a679-dbeadbab4cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:45.531763 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ce137-b98f-49b0-a679-dbeadbab4cb4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:45.532698 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386ce137-b98f-49b0-a679-dbeadbab4cb4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:45.534253 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386ce137-b98f-49b0-a679-dbeadbab4cb4 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:45.655554 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 526/1051] 10.222.0.43 () {60 vars in 1144 bytes} [Mon Apr 11 16:23:45 2022] POST /identity/v3/endpoints => generated 327 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:23:47.119309 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc4888-8cb6-4a0e-8a35-bf58e85cf80e None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:47.119862 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc4888-8cb6-4a0e-8a35-bf58e85cf80e None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:47.120156 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc4888-8cb6-4a0e-8a35-bf58e85cf80e None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:47.121452 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 526/1052] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:23:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:23:47.126726 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd316a-7d66-41d7-b0b6-e971e53181aa None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:47.127122 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd316a-7d66-41d7-b0b6-e971e53181aa None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:47.127301 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd316a-7d66-41d7-b0b6-e971e53181aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:47.145808 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-78cd316a-7d66-41d7-b0b6-e971e53181aa None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:23:47.147000 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-78cd316a-7d66-41d7-b0b6-e971e53181aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:23:47.219605 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 527/1053] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:23:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:23:47.244875 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc4888-8cb6-4a0e-8a35-bf58e85cf80e None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:47.308043 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d4b0e-bb67-4cae-802b-6c70b50dc557 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:47.308333 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d4b0e-bb67-4cae-802b-6c70b50dc557 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:47.308612 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d4b0e-bb67-4cae-802b-6c70b50dc557 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:47.310137 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 528/1054] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:23:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 16:23:47.315127 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5922eb-d91b-42ff-a2cd-196e4db41265 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:47.315416 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5922eb-d91b-42ff-a2cd-196e4db41265 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:47.315723 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5922eb-d91b-42ff-a2cd-196e4db41265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:47.333293 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-1f5922eb-d91b-42ff-a2cd-196e4db41265 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:23:47.334499 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-1f5922eb-d91b-42ff-a2cd-196e4db41265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:23:47.347181 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc4888-8cb6-4a0e-8a35-bf58e85cf80e None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:47.383155 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc535ab1-78ca-4bb1-9fe9-f61083236f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:47.384513 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc535ab1-78ca-4bb1-9fe9-f61083236f3e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:47.385136 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc535ab1-78ca-4bb1-9fe9-f61083236f3e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:47.385917 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc535ab1-78ca-4bb1-9fe9-f61083236f3e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:47.400947 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc535ab1-78ca-4bb1-9fe9-f61083236f3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:23:47.402815 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 529/1055] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:23:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 16:23:47.408672 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-dc535ab1-78ca-4bb1-9fe9-f61083236f3e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 16:23:47.410400 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 527/1056] 10.222.0.43 () {56 vars in 1096 bytes} [Mon Apr 11 16:23:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:23:47.415979 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5922eb-d91b-42ff-a2cd-196e4db41265 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:47.426960 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc535ab1-78ca-4bb1-9fe9-f61083236f3e None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:47.519336 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5922eb-d91b-42ff-a2cd-196e4db41265 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:47.530038 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc535ab1-78ca-4bb1-9fe9-f61083236f3e None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:47.554036 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82debeff-75bc-4153-a40a-16000dc75cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:47.554948 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82debeff-75bc-4153-a40a-16000dc75cf6 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:47.555060 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82debeff-75bc-4153-a40a-16000dc75cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:47.555268 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82debeff-75bc-4153-a40a-16000dc75cf6 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:47.556101 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82debeff-75bc-4153-a40a-16000dc75cf6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:47.556365 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82debeff-75bc-4153-a40a-16000dc75cf6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:47.557751 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82debeff-75bc-4153-a40a-16000dc75cf6 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:47.568001 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 530/1057] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Apr 11 16:23:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:47.568547 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315a0c92-8b1b-4d1e-9602-accfa2c15f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:47.569446 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a0c92-8b1b-4d1e-9602-accfa2c15f71 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:47.569737 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a0c92-8b1b-4d1e-9602-accfa2c15f71 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:47.570010 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a0c92-8b1b-4d1e-9602-accfa2c15f71 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:47.573654 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82debeff-75bc-4153-a40a-16000dc75cf6 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:47.581764 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315a0c92-8b1b-4d1e-9602-accfa2c15f71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:23:47.589353 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-315a0c92-8b1b-4d1e-9602-accfa2c15f71 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 11 16:23:47.590728 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 528/1058] 10.222.0.43 () {56 vars in 1120 bytes} [Mon Apr 11 16:23:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:23:47.597912 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315a0c92-8b1b-4d1e-9602-accfa2c15f71 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:47.672308 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82debeff-75bc-4153-a40a-16000dc75cf6 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:47.707599 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315a0c92-8b1b-4d1e-9602-accfa2c15f71 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:47.709489 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f732d92-9a17-45a6-936a-1363bca6ba49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:47.710404 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f732d92-9a17-45a6-936a-1363bca6ba49 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:47.710687 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f732d92-9a17-45a6-936a-1363bca6ba49 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:47.710965 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f732d92-9a17-45a6-936a-1363bca6ba49 None admin] PATH_INFO: `/v3/users/176e157a28c745d5b9035df3b02aa79b` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:47.727138 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f732d92-9a17-45a6-936a-1363bca6ba49 None admin] RBAC: Authorizing `identity:get_user(user_id=176e157a28c745d5b9035df3b02aa79b)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:47.728628 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f732d92-9a17-45a6-936a-1363bca6ba49 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:47.731861 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 531/1059] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Apr 11 16:23:47 2022] GET /identity/v3/users/176e157a28c745d5b9035df3b02aa79b => generated 285 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:23:47.736011 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f732d92-9a17-45a6-936a-1363bca6ba49 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:47.745065 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c7904f-71dd-4148-8746-2ca5dc93c5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:47.745743 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c7904f-71dd-4148-8746-2ca5dc93c5a6 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:47.746028 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c7904f-71dd-4148-8746-2ca5dc93c5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:47.746302 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c7904f-71dd-4148-8746-2ca5dc93c5a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:47.747069 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c7904f-71dd-4148-8746-2ca5dc93c5a6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:47.747377 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c7904f-71dd-4148-8746-2ca5dc93c5a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:47.748775 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c7904f-71dd-4148-8746-2ca5dc93c5a6 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:47.757625 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 529/1060] 10.222.0.43 () {56 vars in 1115 bytes} [Mon Apr 11 16:23:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:23:47.763220 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c7904f-71dd-4148-8746-2ca5dc93c5a6 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:47.852366 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f732d92-9a17-45a6-936a-1363bca6ba49 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:47.866307 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c7904f-71dd-4148-8746-2ca5dc93c5a6 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:47.888074 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e9205-ebad-4606-af64-1008359cf4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:47.888744 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e9205-ebad-4606-af64-1008359cf4c1 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:47.889034 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e9205-ebad-4606-af64-1008359cf4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:47.889312 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e9205-ebad-4606-af64-1008359cf4c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:47.899930 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc45e52-e980-4b62-b829-69c34b9c37c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:47.900732 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc45e52-e980-4b62-b829-69c34b9c37c2 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:47.901011 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc45e52-e980-4b62-b829-69c34b9c37c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:47.901281 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc45e52-e980-4b62-b829-69c34b9c37c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:47.912182 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc45e52-e980-4b62-b829-69c34b9c37c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:47.913620 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc45e52-e980-4b62-b829-69c34b9c37c2 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:47.930427 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-dfc45e52-e980-4b62-b829-69c34b9c37c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:23:47.931912 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 530/1061] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:23:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:23:47.937570 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc45e52-e980-4b62-b829-69c34b9c37c2 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:47.957416 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1e9205-ebad-4606-af64-1008359cf4c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:47.958975 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1e9205-ebad-4606-af64-1008359cf4c1 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:48.036364 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc45e52-e980-4b62-b829-69c34b9c37c2 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:48.066789 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 532/1062] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Apr 11 16:23:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 11 16:23:48.068356 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e9205-ebad-4606-af64-1008359cf4c1 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:48.071371 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69060ea8-fde0-41fb-bb5c-82c46a266b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:48.072083 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69060ea8-fde0-41fb-bb5c-82c46a266b13 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:48.072372 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69060ea8-fde0-41fb-bb5c-82c46a266b13 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:48.072649 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69060ea8-fde0-41fb-bb5c-82c46a266b13 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:48.073380 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69060ea8-fde0-41fb-bb5c-82c46a266b13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:48.073695 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69060ea8-fde0-41fb-bb5c-82c46a266b13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:48.075052 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69060ea8-fde0-41fb-bb5c-82c46a266b13 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:48.088367 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 531/1063] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Apr 11 16:23:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:48.094147 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69060ea8-fde0-41fb-bb5c-82c46a266b13 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:48.167397 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e9205-ebad-4606-af64-1008359cf4c1 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:48.188323 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69060ea8-fde0-41fb-bb5c-82c46a266b13 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:48.202416 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e6921-9144-4f71-a1e0-78213d44d529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:48.203321 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e6921-9144-4f71-a1e0-78213d44d529 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:48.203632 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e6921-9144-4f71-a1e0-78213d44d529 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:48.203921 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e6921-9144-4f71-a1e0-78213d44d529 None admin] PATH_INFO: `/v3/projects/5a172495036a4140b4d0db1237fd798c` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:48.205108 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765e6921-9144-4f71-a1e0-78213d44d529 None admin] RBAC: Authorizing `identity:get_project(project_id=5a172495036a4140b4d0db1237fd798c)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:48.207242 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765e6921-9144-4f71-a1e0-78213d44d529 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:48.209134 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 533/1064] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Apr 11 16:23:48 2022] GET /identity/v3/projects/5a172495036a4140b4d0db1237fd798c => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:23:48.210430 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6150dd69-8f8f-4f05-975f-b8c11db3e083 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:48.210716 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6150dd69-8f8f-4f05-975f-b8c11db3e083 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:48.210995 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6150dd69-8f8f-4f05-975f-b8c11db3e083 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:48.215550 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 534/1065] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:23:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:23:48.215550 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6150dd69-8f8f-4f05-975f-b8c11db3e083 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:48.223846 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9014ba9f-0ba0-4139-bb92-b5c6e5823f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:48.224642 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9014ba9f-0ba0-4139-bb92-b5c6e5823f38 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:48.224923 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9014ba9f-0ba0-4139-bb92-b5c6e5823f38 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:48.225197 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9014ba9f-0ba0-4139-bb92-b5c6e5823f38 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:48.232326 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9014ba9f-0ba0-4139-bb92-b5c6e5823f38 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:48.233757 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9014ba9f-0ba0-4139-bb92-b5c6e5823f38 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:48.247971 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-9014ba9f-0ba0-4139-bb92-b5c6e5823f38 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 11 16:23:48.249157 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 532/1066] 10.222.0.43 () {56 vars in 1093 bytes} [Mon Apr 11 16:23:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:23:48.250332 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66544d-41a4-49a1-8493-612d00f24271 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:48.250616 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66544d-41a4-49a1-8493-612d00f24271 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:48.250890 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66544d-41a4-49a1-8493-612d00f24271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:48.267829 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-bf66544d-41a4-49a1-8493-612d00f24271 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:23:48.269037 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-bf66544d-41a4-49a1-8493-612d00f24271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:23:48.320509 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6150dd69-8f8f-4f05-975f-b8c11db3e083 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:48.332040 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 533/1067] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:23:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:23:48.333098 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66544d-41a4-49a1-8493-612d00f24271 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:48.354282 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495c52fc-6b7d-4b1b-b60d-3ae66769db1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:48.354945 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495c52fc-6b7d-4b1b-b60d-3ae66769db1b None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:48.355226 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495c52fc-6b7d-4b1b-b60d-3ae66769db1b None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:48.355505 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495c52fc-6b7d-4b1b-b60d-3ae66769db1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:48.356375 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495c52fc-6b7d-4b1b-b60d-3ae66769db1b None admin] RBAC: Adding query filter params (role.id=702e5e78b5d744529384b96a390ae92f, scope.project.id=5a172495036a4140b4d0db1237fd798c, user.id=176e157a28c745d5b9035df3b02aa79b) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:48.356687 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495c52fc-6b7d-4b1b-b60d-3ae66769db1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:48.358101 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495c52fc-6b7d-4b1b-b60d-3ae66769db1b None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:48.364572 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 535/1068] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Apr 11 16:23:48 2022] GET /identity/v3/role_assignments?user.id=176e157a28c745d5b9035df3b02aa79b&scope.project.id=5a172495036a4140b4d0db1237fd798c&role.id=702e5e78b5d744529384b96a390ae92f => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:23:48.365219 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495c52fc-6b7d-4b1b-b60d-3ae66769db1b None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:48.444819 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66544d-41a4-49a1-8493-612d00f24271 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:48.480938 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e36001-4df8-4db2-8177-6fc1223ed596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:48.481632 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e36001-4df8-4db2-8177-6fc1223ed596 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:48.481916 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e36001-4df8-4db2-8177-6fc1223ed596 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:48.482190 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e36001-4df8-4db2-8177-6fc1223ed596 None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:48.483049 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e36001-4df8-4db2-8177-6fc1223ed596 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:48.483359 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e36001-4df8-4db2-8177-6fc1223ed596 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:48.484471 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495c52fc-6b7d-4b1b-b60d-3ae66769db1b None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:48.484866 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e36001-4df8-4db2-8177-6fc1223ed596 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:48.507087 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 534/1069] 10.222.0.43 () {56 vars in 1133 bytes} [Mon Apr 11 16:23:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:48.512943 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e36001-4df8-4db2-8177-6fc1223ed596 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:48.522996 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a062f86f-6931-4105-a186-af098c1f9add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:48.523704 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062f86f-6931-4105-a186-af098c1f9add None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:48.523988 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062f86f-6931-4105-a186-af098c1f9add None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:48.524261 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062f86f-6931-4105-a186-af098c1f9add None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:48.596770 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a062f86f-6931-4105-a186-af098c1f9add None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:48.598822 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a062f86f-6931-4105-a186-af098c1f9add None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:48.622151 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e36001-4df8-4db2-8177-6fc1223ed596 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:48.656095 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63675e64-d28c-463c-92b8-36f681524d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:48.656758 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63675e64-d28c-463c-92b8-36f681524d1b None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:48.657044 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63675e64-d28c-463c-92b8-36f681524d1b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:48.657342 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63675e64-d28c-463c-92b8-36f681524d1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:48.667435 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63675e64-d28c-463c-92b8-36f681524d1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:48.669513 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63675e64-d28c-463c-92b8-36f681524d1b None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:48.686723 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-63675e64-d28c-463c-92b8-36f681524d1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:23:48.687984 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 535/1070] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:23:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:23:48.694740 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63675e64-d28c-463c-92b8-36f681524d1b None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:48.707752 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 536/1071] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Apr 11 16:23:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 16:23:48.709421 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a062f86f-6931-4105-a186-af098c1f9add None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:48.797974 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63675e64-d28c-463c-92b8-36f681524d1b None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:48.810492 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a062f86f-6931-4105-a186-af098c1f9add None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:48.832875 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7127dbc9-ba36-4bd2-97b9-9c79c7273361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:48.833545 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7127dbc9-ba36-4bd2-97b9-9c79c7273361 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:48.833839 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7127dbc9-ba36-4bd2-97b9-9c79c7273361 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:48.834116 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7127dbc9-ba36-4bd2-97b9-9c79c7273361 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:48.834844 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7127dbc9-ba36-4bd2-97b9-9c79c7273361 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:48.835152 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7127dbc9-ba36-4bd2-97b9-9c79c7273361 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:48.836551 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7127dbc9-ba36-4bd2-97b9-9c79c7273361 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:48.848302 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 536/1072] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Apr 11 16:23:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:23:48.848504 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb07a6e4-fe23-444f-8b90-d9c30865dc60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:48.853617 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07a6e4-fe23-444f-8b90-d9c30865dc60 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:48.853755 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7127dbc9-ba36-4bd2-97b9-9c79c7273361 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:48.853920 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07a6e4-fe23-444f-8b90-d9c30865dc60 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:48.854190 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07a6e4-fe23-444f-8b90-d9c30865dc60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:48.866465 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb07a6e4-fe23-444f-8b90-d9c30865dc60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:48.868653 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb07a6e4-fe23-444f-8b90-d9c30865dc60 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:48.891183 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-fb07a6e4-fe23-444f-8b90-d9c30865dc60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:23:48.897700 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 537/1073] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:23:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:23:48.899345 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb07a6e4-fe23-444f-8b90-d9c30865dc60 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:48.954149 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7127dbc9-ba36-4bd2-97b9-9c79c7273361 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:48.987143 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71abb6c4-fb68-45f8-ab4c-7e0b9674c5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:48.988391 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71abb6c4-fb68-45f8-ab4c-7e0b9674c5d5 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:48.988708 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71abb6c4-fb68-45f8-ab4c-7e0b9674c5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:48.988944 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71abb6c4-fb68-45f8-ab4c-7e0b9674c5d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:48.995582 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71abb6c4-fb68-45f8-ab4c-7e0b9674c5d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:48.997008 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71abb6c4-fb68-45f8-ab4c-7e0b9674c5d5 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:48.997590 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb07a6e4-fe23-444f-8b90-d9c30865dc60 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:49.011070 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-71abb6c4-fb68-45f8-ab4c-7e0b9674c5d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 16:23:49.012470 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 537/1074] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Apr 11 16:23:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:23:49.017931 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71abb6c4-fb68-45f8-ab4c-7e0b9674c5d5 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:49.040578 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e395cae-fa79-4503-954e-96fd2ddd37eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:49.041311 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e395cae-fa79-4503-954e-96fd2ddd37eb None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:49.041590 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e395cae-fa79-4503-954e-96fd2ddd37eb None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:49.041887 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e395cae-fa79-4503-954e-96fd2ddd37eb None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:49.042613 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e395cae-fa79-4503-954e-96fd2ddd37eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:49.042919 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e395cae-fa79-4503-954e-96fd2ddd37eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:49.044312 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e395cae-fa79-4503-954e-96fd2ddd37eb None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:49.056366 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 538/1075] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Apr 11 16:23:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:23:49.135530 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71abb6c4-fb68-45f8-ab4c-7e0b9674c5d5 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:49.174021 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f19460-4bcb-4fdb-bebb-beb190870ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:49.174715 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f19460-4bcb-4fdb-bebb-beb190870ed1 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:49.175849 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f19460-4bcb-4fdb-bebb-beb190870ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:49.176135 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f19460-4bcb-4fdb-bebb-beb190870ed1 None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:49.176949 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f19460-4bcb-4fdb-bebb-beb190870ed1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:49.177258 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f19460-4bcb-4fdb-bebb-beb190870ed1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:49.178708 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f19460-4bcb-4fdb-bebb-beb190870ed1 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:49.196808 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 538/1076] 10.222.0.43 () {56 vars in 1148 bytes} [Mon Apr 11 16:23:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:23:49.198076 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e395cae-fa79-4503-954e-96fd2ddd37eb None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:49.298799 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e395cae-fa79-4503-954e-96fd2ddd37eb None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:49.335116 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4782ec26-7cb6-4fc7-b518-5c177e1bddf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:49.336074 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782ec26-7cb6-4fc7-b518-5c177e1bddf5 None admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:49.336354 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782ec26-7cb6-4fc7-b518-5c177e1bddf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:49.336623 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782ec26-7cb6-4fc7-b518-5c177e1bddf5 None admin] PATH_INFO: `/v3/projects/477b9d41390e455a82e733c4fc6acd6b/users/1be2652c984a4283aeee0b937f0555e4/roles/c649101bea4344799d49fb57281b6508` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:49.339173 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4782ec26-7cb6-4fc7-b518-5c177e1bddf5 None admin] RBAC: Authorizing `identity:create_grant(project_id=477b9d41390e455a82e733c4fc6acd6b, user_id=1be2652c984a4283aeee0b937f0555e4, role_id=c649101bea4344799d49fb57281b6508)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:49.340704 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4782ec26-7cb6-4fc7-b518-5c177e1bddf5 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:49.427372 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 539/1077] 10.222.0.43 () {58 vars in 1439 bytes} [Mon Apr 11 16:23:49 2022] PUT /identity/v3/projects/477b9d41390e455a82e733c4fc6acd6b/users/1be2652c984a4283aeee0b937f0555e4/roles/c649101bea4344799d49fb57281b6508 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:23:50.711922 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298396bb-e62e-40fa-8755-14c0fb9b5804 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:50.712474 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298396bb-e62e-40fa-8755-14c0fb9b5804 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:50.712474 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298396bb-e62e-40fa-8755-14c0fb9b5804 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:50.713853 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 539/1078] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:23:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:23:50.719183 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f5da3-169b-4442-b667-519fddb2eddf None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:50.719598 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f5da3-169b-4442-b667-519fddb2eddf None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:50.719841 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f5da3-169b-4442-b667-519fddb2eddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:50.736253 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-125f5da3-169b-4442-b667-519fddb2eddf None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:23:50.738424 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-125f5da3-169b-4442-b667-519fddb2eddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:23:50.802325 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 540/1079] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:23:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:23:50.825165 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298396bb-e62e-40fa-8755-14c0fb9b5804 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:50.923072 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298396bb-e62e-40fa-8755-14c0fb9b5804 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:50.961123 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67910995-2c70-478a-bac7-da0b10a8b4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:50.961938 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67910995-2c70-478a-bac7-da0b10a8b4b9 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:50.962222 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67910995-2c70-478a-bac7-da0b10a8b4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:50.962498 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67910995-2c70-478a-bac7-da0b10a8b4b9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:50.973123 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67910995-2c70-478a-bac7-da0b10a8b4b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:23:50.980139 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-67910995-2c70-478a-bac7-da0b10a8b4b9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 16:23:50.981368 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 540/1080] 10.222.0.43 () {56 vars in 1096 bytes} [Mon Apr 11 16:23:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:23:50.989073 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125f5da3-169b-4442-b667-519fddb2eddf None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:51.091942 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125f5da3-169b-4442-b667-519fddb2eddf None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:51.128450 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e3abbe-4a51-4de2-a646-768608892e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:51.129255 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e3abbe-4a51-4de2-a646-768608892e11 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:51.129537 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e3abbe-4a51-4de2-a646-768608892e11 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:51.129805 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e3abbe-4a51-4de2-a646-768608892e11 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:51.130548 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e3abbe-4a51-4de2-a646-768608892e11 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:51.130850 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e3abbe-4a51-4de2-a646-768608892e11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:51.132237 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e3abbe-4a51-4de2-a646-768608892e11 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:51.140436 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 541/1081] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Apr 11 16:23:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:23:51.146903 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67910995-2c70-478a-bac7-da0b10a8b4b9 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:51.243599 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67910995-2c70-478a-bac7-da0b10a8b4b9 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:51.276596 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8f4506-6cb8-4636-a618-679e8e613cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:51.277468 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f4506-6cb8-4636-a618-679e8e613cac None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:51.277746 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f4506-6cb8-4636-a618-679e8e613cac None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:51.278016 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f4506-6cb8-4636-a618-679e8e613cac None admin] PATH_INFO: `/v3/users/176e157a28c745d5b9035df3b02aa79b` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:51.279200 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8f4506-6cb8-4636-a618-679e8e613cac None admin] RBAC: Authorizing `identity:get_user(user_id=176e157a28c745d5b9035df3b02aa79b)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:51.280715 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8f4506-6cb8-4636-a618-679e8e613cac None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:51.282338 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 541/1082] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Apr 11 16:23:51 2022] GET /identity/v3/users/176e157a28c745d5b9035df3b02aa79b => generated 285 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:51.288066 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e3abbe-4a51-4de2-a646-768608892e11 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:51.384994 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e3abbe-4a51-4de2-a646-768608892e11 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:51.418871 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bccc41-72d4-4148-a25e-0c3327bf081e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:51.419763 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bccc41-72d4-4148-a25e-0c3327bf081e None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:51.420044 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bccc41-72d4-4148-a25e-0c3327bf081e None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:51.420315 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bccc41-72d4-4148-a25e-0c3327bf081e None admin] PATH_INFO: `/v3/projects/5a172495036a4140b4d0db1237fd798c` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:51.421472 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bccc41-72d4-4148-a25e-0c3327bf081e None admin] RBAC: Authorizing `identity:get_project(project_id=5a172495036a4140b4d0db1237fd798c)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:51.422895 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bccc41-72d4-4148-a25e-0c3327bf081e None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:51.425147 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 542/1083] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Apr 11 16:23:51 2022] GET /identity/v3/projects/5a172495036a4140b4d0db1237fd798c => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:23:51.431544 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8f4506-6cb8-4636-a618-679e8e613cac None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:51.528762 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8f4506-6cb8-4636-a618-679e8e613cac None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:51.562018 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be36c593-6c19-4dae-a610-53a1a624833b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:51.562983 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be36c593-6c19-4dae-a610-53a1a624833b None admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:51.563270 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be36c593-6c19-4dae-a610-53a1a624833b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:51.563579 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be36c593-6c19-4dae-a610-53a1a624833b None admin] PATH_INFO: `/v3/projects/5a172495036a4140b4d0db1237fd798c/users/176e157a28c745d5b9035df3b02aa79b/roles/702e5e78b5d744529384b96a390ae92f` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:51.566289 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be36c593-6c19-4dae-a610-53a1a624833b None admin] RBAC: Authorizing `identity:create_grant(project_id=5a172495036a4140b4d0db1237fd798c, user_id=176e157a28c745d5b9035df3b02aa79b, role_id=702e5e78b5d744529384b96a390ae92f)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:51.567766 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be36c593-6c19-4dae-a610-53a1a624833b None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:51.648607 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 542/1084] 10.222.0.43 () {58 vars in 1439 bytes} [Mon Apr 11 16:23:51 2022] PUT /identity/v3/projects/5a172495036a4140b4d0db1237fd798c/users/176e157a28c745d5b9035df3b02aa79b/roles/702e5e78b5d744529384b96a390ae92f => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:23:51.764849 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba9632-0112-4f98-bbfe-b3659e0fc851 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:51.765382 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba9632-0112-4f98-bbfe-b3659e0fc851 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:51.765465 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba9632-0112-4f98-bbfe-b3659e0fc851 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:51.766793 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 543/1085] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:23:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:23:51.773108 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274d78f-4ffc-4aa8-9e25-32a3d4bd55eb None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:51.773667 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274d78f-4ffc-4aa8-9e25-32a3d4bd55eb None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:51.773667 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274d78f-4ffc-4aa8-9e25-32a3d4bd55eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:51.791338 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-c274d78f-4ffc-4aa8-9e25-32a3d4bd55eb None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:23:51.792540 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-c274d78f-4ffc-4aa8-9e25-32a3d4bd55eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:23:51.860598 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 543/1086] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:23:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:23:51.885245 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fba9632-0112-4f98-bbfe-b3659e0fc851 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:51.985321 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fba9632-0112-4f98-bbfe-b3659e0fc851 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:52.018225 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888222f8-5a04-442a-98d6-53b614d67579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:52.019770 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888222f8-5a04-442a-98d6-53b614d67579 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:52.020048 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888222f8-5a04-442a-98d6-53b614d67579 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:52.020315 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888222f8-5a04-442a-98d6-53b614d67579 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:52.030469 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888222f8-5a04-442a-98d6-53b614d67579 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:23:52.038380 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-888222f8-5a04-442a-98d6-53b614d67579 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 11 16:23:52.039627 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 544/1087] 10.222.0.43 () {56 vars in 1120 bytes} [Mon Apr 11 16:23:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:23:52.045722 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c274d78f-4ffc-4aa8-9e25-32a3d4bd55eb None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:52.139018 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c274d78f-4ffc-4aa8-9e25-32a3d4bd55eb None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:52.171301 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49c22b2-cff6-46fa-a96c-30701c3d1a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:52.171995 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c22b2-cff6-46fa-a96c-30701c3d1a6b None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:52.172275 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c22b2-cff6-46fa-a96c-30701c3d1a6b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:52.172543 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c22b2-cff6-46fa-a96c-30701c3d1a6b None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:52.173280 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49c22b2-cff6-46fa-a96c-30701c3d1a6b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:52.173585 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49c22b2-cff6-46fa-a96c-30701c3d1a6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:52.174970 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49c22b2-cff6-46fa-a96c-30701c3d1a6b None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:52.182706 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 544/1088] 10.222.0.43 () {56 vars in 1115 bytes} [Mon Apr 11 16:23:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:52.188270 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888222f8-5a04-442a-98d6-53b614d67579 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:52.287258 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888222f8-5a04-442a-98d6-53b614d67579 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:52.319569 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e320d5a8-9d09-4cd0-b1d4-2e9f6cb46acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:52.320298 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e320d5a8-9d09-4cd0-b1d4-2e9f6cb46acb None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:52.320573 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e320d5a8-9d09-4cd0-b1d4-2e9f6cb46acb None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:52.320840 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e320d5a8-9d09-4cd0-b1d4-2e9f6cb46acb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:52.331386 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e320d5a8-9d09-4cd0-b1d4-2e9f6cb46acb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:52.333016 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e320d5a8-9d09-4cd0-b1d4-2e9f6cb46acb None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:52.349959 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-e320d5a8-9d09-4cd0-b1d4-2e9f6cb46acb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:23:52.351152 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 545/1089] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:23:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:23:52.356801 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49c22b2-cff6-46fa-a96c-30701c3d1a6b None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:52.451253 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49c22b2-cff6-46fa-a96c-30701c3d1a6b None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:52.484336 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43416024-e8d9-4ccc-9522-ddd0bb111e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:52.485010 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43416024-e8d9-4ccc-9522-ddd0bb111e40 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:52.485297 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43416024-e8d9-4ccc-9522-ddd0bb111e40 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:52.485575 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43416024-e8d9-4ccc-9522-ddd0bb111e40 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:52.486564 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43416024-e8d9-4ccc-9522-ddd0bb111e40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:52.486894 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43416024-e8d9-4ccc-9522-ddd0bb111e40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:52.489129 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43416024-e8d9-4ccc-9522-ddd0bb111e40 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:52.506189 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 545/1090] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Apr 11 16:23:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:52.511792 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e320d5a8-9d09-4cd0-b1d4-2e9f6cb46acb None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:52.619116 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e320d5a8-9d09-4cd0-b1d4-2e9f6cb46acb None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:52.655232 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877e94c8-440d-4238-813c-6e9a7b8b8016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:52.656069 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e94c8-440d-4238-813c-6e9a7b8b8016 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:52.656358 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e94c8-440d-4238-813c-6e9a7b8b8016 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:52.656644 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e94c8-440d-4238-813c-6e9a7b8b8016 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:52.664831 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877e94c8-440d-4238-813c-6e9a7b8b8016 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:52.666267 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877e94c8-440d-4238-813c-6e9a7b8b8016 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:52.679995 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-877e94c8-440d-4238-813c-6e9a7b8b8016 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 11 16:23:52.681189 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 546/1091] 10.222.0.43 () {56 vars in 1093 bytes} [Mon Apr 11 16:23:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:23:52.686880 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43416024-e8d9-4ccc-9522-ddd0bb111e40 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:52.781156 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43416024-e8d9-4ccc-9522-ddd0bb111e40 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:52.814637 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0decefe-14d9-420a-b283-a1adf6778bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:52.815973 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0decefe-14d9-420a-b283-a1adf6778bc2 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:52.816249 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0decefe-14d9-420a-b283-a1adf6778bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:52.816695 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0decefe-14d9-420a-b283-a1adf6778bc2 None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:52.817538 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0decefe-14d9-420a-b283-a1adf6778bc2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:52.817851 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0decefe-14d9-420a-b283-a1adf6778bc2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:52.819257 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0decefe-14d9-420a-b283-a1adf6778bc2 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:52.836308 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 546/1092] 10.222.0.43 () {56 vars in 1133 bytes} [Mon Apr 11 16:23:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:23:52.842078 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877e94c8-440d-4238-813c-6e9a7b8b8016 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:52.948045 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877e94c8-440d-4238-813c-6e9a7b8b8016 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:52.979303 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2940f888-71d5-481b-9bb7-510927001b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:52.979979 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940f888-71d5-481b-9bb7-510927001b4d None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:52.980262 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940f888-71d5-481b-9bb7-510927001b4d None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:52.980536 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940f888-71d5-481b-9bb7-510927001b4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:53.043977 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2940f888-71d5-481b-9bb7-510927001b4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:53.045432 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2940f888-71d5-481b-9bb7-510927001b4d None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:53.277917 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 547/1093] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Apr 11 16:23:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 11 16:23:53.278984 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0decefe-14d9-420a-b283-a1adf6778bc2 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:53.373093 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0decefe-14d9-420a-b283-a1adf6778bc2 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:53.405967 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c8745d-243d-400a-933c-57a6156256ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:53.406759 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c8745d-243d-400a-933c-57a6156256ab None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:53.407044 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c8745d-243d-400a-933c-57a6156256ab None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:53.407329 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c8745d-243d-400a-933c-57a6156256ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:53.417249 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c8745d-243d-400a-933c-57a6156256ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:53.418673 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c8745d-243d-400a-933c-57a6156256ab None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:53.435171 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-91c8745d-243d-400a-933c-57a6156256ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:23:53.436553 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 547/1094] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:23:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:23:53.442564 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2940f888-71d5-481b-9bb7-510927001b4d None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:53.545502 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2940f888-71d5-481b-9bb7-510927001b4d None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:53.579505 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd20f7b-cbd3-486a-8117-d11b8db5ea39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:53.580195 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd20f7b-cbd3-486a-8117-d11b8db5ea39 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:53.581012 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd20f7b-cbd3-486a-8117-d11b8db5ea39 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:53.581289 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd20f7b-cbd3-486a-8117-d11b8db5ea39 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:53.582007 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd20f7b-cbd3-486a-8117-d11b8db5ea39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:53.582313 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd20f7b-cbd3-486a-8117-d11b8db5ea39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:53.583724 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd20f7b-cbd3-486a-8117-d11b8db5ea39 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:53.595110 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 548/1095] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Apr 11 16:23:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:53.601353 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c8745d-243d-400a-933c-57a6156256ab None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:53.704923 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c8745d-243d-400a-933c-57a6156256ab None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:53.738111 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce673585-33f4-41eb-a9c0-c372011e9e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:53.738907 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce673585-33f4-41eb-a9c0-c372011e9e72 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:53.739187 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce673585-33f4-41eb-a9c0-c372011e9e72 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:53.739460 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce673585-33f4-41eb-a9c0-c372011e9e72 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:53.745942 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce673585-33f4-41eb-a9c0-c372011e9e72 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:53.747358 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce673585-33f4-41eb-a9c0-c372011e9e72 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:53.760019 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-ce673585-33f4-41eb-a9c0-c372011e9e72 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 16:23:53.761189 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 548/1096] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Apr 11 16:23:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:23:53.767200 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd20f7b-cbd3-486a-8117-d11b8db5ea39 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:53.865124 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd20f7b-cbd3-486a-8117-d11b8db5ea39 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:53.897191 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a570df-8100-4c86-9067-43a52de86139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:53.897850 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a570df-8100-4c86-9067-43a52de86139 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:53.898130 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a570df-8100-4c86-9067-43a52de86139 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:53.898400 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a570df-8100-4c86-9067-43a52de86139 None admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:53.899176 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a570df-8100-4c86-9067-43a52de86139 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:53.899480 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a570df-8100-4c86-9067-43a52de86139 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:53.900920 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a570df-8100-4c86-9067-43a52de86139 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:53.912696 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 549/1097] 10.222.0.43 () {56 vars in 1148 bytes} [Mon Apr 11 16:23:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:53.918843 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce673585-33f4-41eb-a9c0-c372011e9e72 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:54.012498 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce673585-33f4-41eb-a9c0-c372011e9e72 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:54.044379 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d335435-5cf4-433a-804f-b858bb56e84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:54.045036 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d335435-5cf4-433a-804f-b858bb56e84f None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:54.045318 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d335435-5cf4-433a-804f-b858bb56e84f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:54.045593 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d335435-5cf4-433a-804f-b858bb56e84f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:54.046570 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d335435-5cf4-433a-804f-b858bb56e84f None admin] RBAC: Adding query filter params (role.id=c649101bea4344799d49fb57281b6508, scope.project.id=477b9d41390e455a82e733c4fc6acd6b, user.id=1be2652c984a4283aeee0b937f0555e4) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:54.046882 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d335435-5cf4-433a-804f-b858bb56e84f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:54.048328 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d335435-5cf4-433a-804f-b858bb56e84f None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:54.054888 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 549/1098] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Apr 11 16:23:53 2022] GET /identity/v3/role_assignments?user.id=1be2652c984a4283aeee0b937f0555e4&scope.project.id=477b9d41390e455a82e733c4fc6acd6b&role.id=c649101bea4344799d49fb57281b6508 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:54.056378 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820bf1cb-4a6a-42e6-836c-0e5f09837219 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:54.056680 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820bf1cb-4a6a-42e6-836c-0e5f09837219 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:54.056966 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820bf1cb-4a6a-42e6-836c-0e5f09837219 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:54.058332 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 550/1099] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:23:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 16:23:54.063912 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602b916-6f48-4017-b60f-0875b042586d None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:54.064200 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602b916-6f48-4017-b60f-0875b042586d None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:54.064481 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602b916-6f48-4017-b60f-0875b042586d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:54.082217 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-a602b916-6f48-4017-b60f-0875b042586d None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:23:54.083452 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a602b916-6f48-4017-b60f-0875b042586d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:23:54.155664 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 550/1100] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:23:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:23:54.180317 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820bf1cb-4a6a-42e6-836c-0e5f09837219 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:54.285231 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820bf1cb-4a6a-42e6-836c-0e5f09837219 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:54.318861 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe2a49-a656-4e6d-ab3b-e793122ad7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:54.319716 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe2a49-a656-4e6d-ab3b-e793122ad7c3 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:54.319996 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe2a49-a656-4e6d-ab3b-e793122ad7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:54.320269 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe2a49-a656-4e6d-ab3b-e793122ad7c3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:54.330266 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebe2a49-a656-4e6d-ab3b-e793122ad7c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:23:54.337262 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-3ebe2a49-a656-4e6d-ab3b-e793122ad7c3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 16:23:54.338455 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 551/1101] 10.222.0.43 () {56 vars in 1096 bytes} [Mon Apr 11 16:23:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:23:54.344459 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a602b916-6f48-4017-b60f-0875b042586d None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:54.444383 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a602b916-6f48-4017-b60f-0875b042586d None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:54.478255 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ee7cef-2dff-45d8-b60a-21892753e6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:54.478816 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee7cef-2dff-45d8-b60a-21892753e6fc None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:54.479100 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee7cef-2dff-45d8-b60a-21892753e6fc None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:54.479381 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee7cef-2dff-45d8-b60a-21892753e6fc None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:54.480223 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ee7cef-2dff-45d8-b60a-21892753e6fc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:54.480536 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ee7cef-2dff-45d8-b60a-21892753e6fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:54.481923 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ee7cef-2dff-45d8-b60a-21892753e6fc None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:54.490962 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 551/1102] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Apr 11 16:23:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:54.496848 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe2a49-a656-4e6d-ab3b-e793122ad7c3 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:54.599652 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe2a49-a656-4e6d-ab3b-e793122ad7c3 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:54.632875 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee1249-87a1-4dc8-a944-920b0c093604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:54.634003 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee1249-87a1-4dc8-a944-920b0c093604 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:54.634286 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee1249-87a1-4dc8-a944-920b0c093604 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:54.634569 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee1249-87a1-4dc8-a944-920b0c093604 None admin] PATH_INFO: `/v3/users/176e157a28c745d5b9035df3b02aa79b` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:54.635800 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ee1249-87a1-4dc8-a944-920b0c093604 None admin] RBAC: Authorizing `identity:get_user(user_id=176e157a28c745d5b9035df3b02aa79b)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:54.637231 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ee1249-87a1-4dc8-a944-920b0c093604 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:54.638875 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 552/1103] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Apr 11 16:23:54 2022] GET /identity/v3/users/176e157a28c745d5b9035df3b02aa79b => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:54.645050 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ee7cef-2dff-45d8-b60a-21892753e6fc None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:54.748315 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ee7cef-2dff-45d8-b60a-21892753e6fc None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:54.782546 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3045685f-7564-440b-9eab-ddf0c72c5bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:54.783261 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3045685f-7564-440b-9eab-ddf0c72c5bbe None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:54.784232 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3045685f-7564-440b-9eab-ddf0c72c5bbe None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:54.784970 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3045685f-7564-440b-9eab-ddf0c72c5bbe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:54.853600 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3045685f-7564-440b-9eab-ddf0c72c5bbe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:54.855044 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3045685f-7564-440b-9eab-ddf0c72c5bbe None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:54.951335 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 552/1104] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Apr 11 16:23:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 16:23:54.958138 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee1249-87a1-4dc8-a944-920b0c093604 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:55.053344 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee1249-87a1-4dc8-a944-920b0c093604 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:55.084417 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540aaa0e-c492-410f-8c40-ce74fea61512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:55.085269 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540aaa0e-c492-410f-8c40-ce74fea61512 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:55.085546 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540aaa0e-c492-410f-8c40-ce74fea61512 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:55.085814 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540aaa0e-c492-410f-8c40-ce74fea61512 None admin] PATH_INFO: `/v3/projects/5a172495036a4140b4d0db1237fd798c` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:55.086960 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540aaa0e-c492-410f-8c40-ce74fea61512 None admin] RBAC: Authorizing `identity:get_project(project_id=5a172495036a4140b4d0db1237fd798c)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:55.088396 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540aaa0e-c492-410f-8c40-ce74fea61512 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:55.090058 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 553/1105] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Apr 11 16:23:54 2022] GET /identity/v3/projects/5a172495036a4140b4d0db1237fd798c => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:55.096204 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3045685f-7564-440b-9eab-ddf0c72c5bbe None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:55.190374 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3045685f-7564-440b-9eab-ddf0c72c5bbe None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:55.221746 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81430c3-d28c-41e2-a067-c550d8d95b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:55.222394 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81430c3-d28c-41e2-a067-c550d8d95b7c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:55.222683 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81430c3-d28c-41e2-a067-c550d8d95b7c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:55.222957 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81430c3-d28c-41e2-a067-c550d8d95b7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:55.223800 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81430c3-d28c-41e2-a067-c550d8d95b7c None admin] RBAC: Adding query filter params (role.id=702e5e78b5d744529384b96a390ae92f, scope.project.id=5a172495036a4140b4d0db1237fd798c, user.id=176e157a28c745d5b9035df3b02aa79b) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:23:55.224112 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81430c3-d28c-41e2-a067-c550d8d95b7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:55.225504 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81430c3-d28c-41e2-a067-c550d8d95b7c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:55.230972 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 553/1106] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Apr 11 16:23:55 2022] GET /identity/v3/role_assignments?user.id=176e157a28c745d5b9035df3b02aa79b&scope.project.id=5a172495036a4140b4d0db1237fd798c&role.id=702e5e78b5d744529384b96a390ae92f => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:23:57.562654 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d22a645-c629-4638-99fb-bfcd0c510e92 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:57.563226 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d22a645-c629-4638-99fb-bfcd0c510e92 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:57.563226 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d22a645-c629-4638-99fb-bfcd0c510e92 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:57.564729 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 554/1107] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:23:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 16:23:57.569859 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba026de-c910-45ac-a449-c00c7fe873c1 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:57.570255 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba026de-c910-45ac-a449-c00c7fe873c1 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:57.570418 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba026de-c910-45ac-a449-c00c7fe873c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:57.586899 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-bba026de-c910-45ac-a449-c00c7fe873c1 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:23:57.588101 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-bba026de-c910-45ac-a449-c00c7fe873c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:23:57.651740 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 554/1108] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:23:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:23:57.679677 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d22a645-c629-4638-99fb-bfcd0c510e92 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:57.790402 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d22a645-c629-4638-99fb-bfcd0c510e92 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:57.832190 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02dffde-c118-493f-b240-f2d4ff7f5c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:57.832989 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02dffde-c118-493f-b240-f2d4ff7f5c57 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:57.833272 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02dffde-c118-493f-b240-f2d4ff7f5c57 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:57.833550 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02dffde-c118-493f-b240-f2d4ff7f5c57 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:57.834711 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02dffde-c118-493f-b240-f2d4ff7f5c57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:57.836178 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02dffde-c118-493f-b240-f2d4ff7f5c57 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:57.837790 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 555/1109] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:23:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:23:57.843712 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba026de-c910-45ac-a449-c00c7fe873c1 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:23:57.944049 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba026de-c910-45ac-a449-c00c7fe873c1 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:23:57.977022 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fd7776-d846-4f62-a272-c50626a4e5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:23:57.977689 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd7776-d846-4f62-a272-c50626a4e5ff None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:23:57.977973 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd7776-d846-4f62-a272-c50626a4e5ff None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:23:57.978249 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd7776-d846-4f62-a272-c50626a4e5ff None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:23:57.978952 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fd7776-d846-4f62-a272-c50626a4e5ff None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:23:57.980408 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fd7776-d846-4f62-a272-c50626a4e5ff None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:23:58.076536 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 555/1110] 10.222.0.43 () {60 vars in 1132 bytes} [Mon Apr 11 16:23:57 2022] POST /identity/v3/users => generated 286 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:24:00.459883 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a026c8db-b2c9-4549-a744-be0ad6aa93c3 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:00.460477 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a026c8db-b2c9-4549-a744-be0ad6aa93c3 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:00.460477 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a026c8db-b2c9-4549-a744-be0ad6aa93c3 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:00.461792 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 556/1111] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:24:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:24:00.467131 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d7849-33a8-4a2c-81c4-513a7dc7f2b1 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:00.467608 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d7849-33a8-4a2c-81c4-513a7dc7f2b1 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:00.467702 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d7849-33a8-4a2c-81c4-513a7dc7f2b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:00.484948 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-939d7849-33a8-4a2c-81c4-513a7dc7f2b1 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:24:00.487151 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-939d7849-33a8-4a2c-81c4-513a7dc7f2b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:24:00.553146 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 556/1112] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:24:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:24:00.577873 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a026c8db-b2c9-4549-a744-be0ad6aa93c3 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:24:00.674070 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a026c8db-b2c9-4549-a744-be0ad6aa93c3 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:24:00.705837 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b3d22-ab93-45a2-a00c-f33ac85fefc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:24:00.706691 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b3d22-ab93-45a2-a00c-f33ac85fefc0 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:00.706969 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b3d22-ab93-45a2-a00c-f33ac85fefc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:00.707237 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b3d22-ab93-45a2-a00c-f33ac85fefc0 None admin] PATH_INFO: `/v3/roles/7d3d5d04ca634b3a9b63e7b05bb5d333` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:00.708720 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769b3d22-ab93-45a2-a00c-f33ac85fefc0 None admin] RBAC: Authorizing `identity:get_role(role_id=7d3d5d04ca634b3a9b63e7b05bb5d333)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:24:00.710116 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769b3d22-ab93-45a2-a00c-f33ac85fefc0 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:24:00.711428 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 557/1113] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Apr 11 16:24:00 2022] GET /identity/v3/roles/7d3d5d04ca634b3a9b63e7b05bb5d333 => generated 223 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:24:00.717274 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939d7849-33a8-4a2c-81c4-513a7dc7f2b1 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:24:00.810431 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939d7849-33a8-4a2c-81c4-513a7dc7f2b1 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:24:00.842583 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce9f36-5780-4350-8d40-0efd5c2e0cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:24:00.843464 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce9f36-5780-4350-8d40-0efd5c2e0cab None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:00.843773 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce9f36-5780-4350-8d40-0efd5c2e0cab None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:00.844047 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce9f36-5780-4350-8d40-0efd5c2e0cab None admin] PATH_INFO: `/v3/users/164f5ee8263746ca96cd8f24eaf9088f` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:00.857579 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ce9f36-5780-4350-8d40-0efd5c2e0cab None admin] RBAC: Authorizing `identity:get_user(user_id=164f5ee8263746ca96cd8f24eaf9088f)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:24:00.859009 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ce9f36-5780-4350-8d40-0efd5c2e0cab None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:24:00.861382 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 557/1114] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Apr 11 16:24:00 2022] GET /identity/v3/users/164f5ee8263746ca96cd8f24eaf9088f => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:24:00.867081 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b3d22-ab93-45a2-a00c-f33ac85fefc0 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:24:00.961836 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b3d22-ab93-45a2-a00c-f33ac85fefc0 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:24:00.994549 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daf98a0-c0c2-49ef-9806-e7692cf65db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:24:00.995199 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf98a0-c0c2-49ef-9806-e7692cf65db7 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:00.995477 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf98a0-c0c2-49ef-9806-e7692cf65db7 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:00.995778 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf98a0-c0c2-49ef-9806-e7692cf65db7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:01.060156 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daf98a0-c0c2-49ef-9806-e7692cf65db7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:24:01.061608 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daf98a0-c0c2-49ef-9806-e7692cf65db7 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:24:01.155968 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 558/1115] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Apr 11 16:24:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 16:24:01.161897 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce9f36-5780-4350-8d40-0efd5c2e0cab None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:24:01.269708 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce9f36-5780-4350-8d40-0efd5c2e0cab None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:24:01.308112 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ec1734-e3ec-4e2a-a326-f69d86cfbc09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:24:01.308974 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec1734-e3ec-4e2a-a326-f69d86cfbc09 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:01.309257 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec1734-e3ec-4e2a-a326-f69d86cfbc09 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:01.309534 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec1734-e3ec-4e2a-a326-f69d86cfbc09 None admin] PATH_INFO: `/v3/projects/5a172495036a4140b4d0db1237fd798c` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:01.310706 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ec1734-e3ec-4e2a-a326-f69d86cfbc09 None admin] RBAC: Authorizing `identity:get_project(project_id=5a172495036a4140b4d0db1237fd798c)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:24:01.312154 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ec1734-e3ec-4e2a-a326-f69d86cfbc09 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:24:01.314552 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 558/1116] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Apr 11 16:24:01 2022] GET /identity/v3/projects/5a172495036a4140b4d0db1237fd798c => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:24:01.320757 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daf98a0-c0c2-49ef-9806-e7692cf65db7 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:24:01.413337 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daf98a0-c0c2-49ef-9806-e7692cf65db7 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:24:01.446024 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88ac106-5023-42bb-b3d3-cc7f2e91c4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:24:01.446682 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88ac106-5023-42bb-b3d3-cc7f2e91c4c6 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:01.446966 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88ac106-5023-42bb-b3d3-cc7f2e91c4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:01.447242 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88ac106-5023-42bb-b3d3-cc7f2e91c4c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:01.448094 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88ac106-5023-42bb-b3d3-cc7f2e91c4c6 None admin] RBAC: Adding query filter params (role.id=7d3d5d04ca634b3a9b63e7b05bb5d333, scope.project.id=5a172495036a4140b4d0db1237fd798c, user.id=164f5ee8263746ca96cd8f24eaf9088f) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:24:01.448409 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88ac106-5023-42bb-b3d3-cc7f2e91c4c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:24:01.449819 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88ac106-5023-42bb-b3d3-cc7f2e91c4c6 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:24:01.455027 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 559/1117] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Apr 11 16:24:01 2022] GET /identity/v3/role_assignments?user.id=164f5ee8263746ca96cd8f24eaf9088f&scope.project.id=5a172495036a4140b4d0db1237fd798c&role.id=7d3d5d04ca634b3a9b63e7b05bb5d333 => generated 259 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:24:03.745079 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8736769-efa2-41fc-b64c-766ebdd70b60 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:03.745580 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8736769-efa2-41fc-b64c-766ebdd70b60 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:03.745580 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8736769-efa2-41fc-b64c-766ebdd70b60 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:03.746904 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 559/1118] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:24:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:24:03.753096 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f821c97-d1d8-4c65-8e79-ad226abe4e6f None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:03.753554 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f821c97-d1d8-4c65-8e79-ad226abe4e6f None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:03.753649 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f821c97-d1d8-4c65-8e79-ad226abe4e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:03.771000 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-0f821c97-d1d8-4c65-8e79-ad226abe4e6f None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:24:03.772253 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-0f821c97-d1d8-4c65-8e79-ad226abe4e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:24:03.842630 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 560/1119] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:24:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:24:03.866695 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8736769-efa2-41fc-b64c-766ebdd70b60 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:24:03.967109 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8736769-efa2-41fc-b64c-766ebdd70b60 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:24:04.004154 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbc4e13-9df7-4a75-9a94-0021c7a711cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:24:04.004937 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc4e13-9df7-4a75-9a94-0021c7a711cf None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:04.005223 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc4e13-9df7-4a75-9a94-0021c7a711cf None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:04.005496 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc4e13-9df7-4a75-9a94-0021c7a711cf None admin] PATH_INFO: `/v3/roles/7d3d5d04ca634b3a9b63e7b05bb5d333` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:04.006992 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbc4e13-9df7-4a75-9a94-0021c7a711cf None admin] RBAC: Authorizing `identity:get_role(role_id=7d3d5d04ca634b3a9b63e7b05bb5d333)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:24:04.008384 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbc4e13-9df7-4a75-9a94-0021c7a711cf None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:24:04.009764 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 560/1120] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Apr 11 16:24:03 2022] GET /identity/v3/roles/7d3d5d04ca634b3a9b63e7b05bb5d333 => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:24:04.015630 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f821c97-d1d8-4c65-8e79-ad226abe4e6f None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:24:04.110817 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f821c97-d1d8-4c65-8e79-ad226abe4e6f None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:24:04.143382 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a91dcda-42c5-43e6-a5a2-c858b8292e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:24:04.144276 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91dcda-42c5-43e6-a5a2-c858b8292e6b None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:04.144552 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91dcda-42c5-43e6-a5a2-c858b8292e6b None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:04.144821 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91dcda-42c5-43e6-a5a2-c858b8292e6b None admin] PATH_INFO: `/v3/users/164f5ee8263746ca96cd8f24eaf9088f` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:04.146000 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a91dcda-42c5-43e6-a5a2-c858b8292e6b None admin] RBAC: Authorizing `identity:get_user(user_id=164f5ee8263746ca96cd8f24eaf9088f)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:24:04.147417 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a91dcda-42c5-43e6-a5a2-c858b8292e6b None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:24:04.149066 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 561/1121] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Apr 11 16:24:04 2022] GET /identity/v3/users/164f5ee8263746ca96cd8f24eaf9088f => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:24:04.154847 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbc4e13-9df7-4a75-9a94-0021c7a711cf None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:24:04.247622 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbc4e13-9df7-4a75-9a94-0021c7a711cf None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:24:04.281858 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a5001c-b0a7-4ab7-8677-995cc492c6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:24:04.282692 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a5001c-b0a7-4ab7-8677-995cc492c6c0 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:04.282978 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a5001c-b0a7-4ab7-8677-995cc492c6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:04.283255 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a5001c-b0a7-4ab7-8677-995cc492c6c0 None admin] PATH_INFO: `/v3/projects/5a172495036a4140b4d0db1237fd798c` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:04.284520 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a5001c-b0a7-4ab7-8677-995cc492c6c0 None admin] RBAC: Authorizing `identity:get_project(project_id=5a172495036a4140b4d0db1237fd798c)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:24:04.285955 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a5001c-b0a7-4ab7-8677-995cc492c6c0 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:24:04.287705 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 561/1122] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Apr 11 16:24:04 2022] GET /identity/v3/projects/5a172495036a4140b4d0db1237fd798c => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:24:04.295109 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a91dcda-42c5-43e6-a5a2-c858b8292e6b None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:24:04.390814 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a91dcda-42c5-43e6-a5a2-c858b8292e6b None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:24:04.422497 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1e3d9b-58f1-49bf-b8be-e072632c069a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:24:04.424067 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e3d9b-58f1-49bf-b8be-e072632c069a None admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:04.424341 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e3d9b-58f1-49bf-b8be-e072632c069a None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:04.424610 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e3d9b-58f1-49bf-b8be-e072632c069a None admin] PATH_INFO: `/v3/projects/5a172495036a4140b4d0db1237fd798c/users/164f5ee8263746ca96cd8f24eaf9088f/roles/7d3d5d04ca634b3a9b63e7b05bb5d333` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:04.426768 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1e3d9b-58f1-49bf-b8be-e072632c069a None admin] RBAC: Authorizing `identity:create_grant(project_id=5a172495036a4140b4d0db1237fd798c, user_id=164f5ee8263746ca96cd8f24eaf9088f, role_id=7d3d5d04ca634b3a9b63e7b05bb5d333)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:24:04.428199 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1e3d9b-58f1-49bf-b8be-e072632c069a None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:24:04.544668 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 562/1123] 10.222.0.43 () {58 vars in 1439 bytes} [Mon Apr 11 16:24:04 2022] PUT /identity/v3/projects/5a172495036a4140b4d0db1237fd798c/users/164f5ee8263746ca96cd8f24eaf9088f/roles/7d3d5d04ca634b3a9b63e7b05bb5d333 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:24:06.844341 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3bb0d5-2508-4f0f-8dbd-fd78f3256091 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:06.844894 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3bb0d5-2508-4f0f-8dbd-fd78f3256091 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:06.844894 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3bb0d5-2508-4f0f-8dbd-fd78f3256091 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:06.846175 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 562/1124] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:24:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:24:06.852041 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913aa94-5dda-4c4e-973b-25a9d3e8064b None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:06.852538 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913aa94-5dda-4c4e-973b-25a9d3e8064b None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:06.852646 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913aa94-5dda-4c4e-973b-25a9d3e8064b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:06.869760 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-a913aa94-5dda-4c4e-973b-25a9d3e8064b None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:24:06.870972 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-a913aa94-5dda-4c4e-973b-25a9d3e8064b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:24:06.935731 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 563/1125] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:24:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:24:06.960338 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3bb0d5-2508-4f0f-8dbd-fd78f3256091 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:24:07.055303 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3bb0d5-2508-4f0f-8dbd-fd78f3256091 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:24:07.087775 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8184a460-7b9b-4120-a1fd-b1b3b9c04eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:24:07.088618 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184a460-7b9b-4120-a1fd-b1b3b9c04eb0 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:07.088904 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184a460-7b9b-4120-a1fd-b1b3b9c04eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:07.089183 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184a460-7b9b-4120-a1fd-b1b3b9c04eb0 None admin] PATH_INFO: `/v3/roles/7d3d5d04ca634b3a9b63e7b05bb5d333` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:07.090639 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8184a460-7b9b-4120-a1fd-b1b3b9c04eb0 None admin] RBAC: Authorizing `identity:get_role(role_id=7d3d5d04ca634b3a9b63e7b05bb5d333)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:24:07.092069 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8184a460-7b9b-4120-a1fd-b1b3b9c04eb0 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:24:07.093427 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 563/1126] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Apr 11 16:24:06 2022] GET /identity/v3/roles/7d3d5d04ca634b3a9b63e7b05bb5d333 => generated 223 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:24:07.099381 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a913aa94-5dda-4c4e-973b-25a9d3e8064b None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:24:07.191878 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a913aa94-5dda-4c4e-973b-25a9d3e8064b None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:24:07.226734 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8613d30d-34b0-4c28-b978-a1499553b34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:24:07.227637 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8613d30d-34b0-4c28-b978-a1499553b34d None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:07.227921 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8613d30d-34b0-4c28-b978-a1499553b34d None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:07.228196 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8613d30d-34b0-4c28-b978-a1499553b34d None admin] PATH_INFO: `/v3/users/164f5ee8263746ca96cd8f24eaf9088f` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:07.229374 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8613d30d-34b0-4c28-b978-a1499553b34d None admin] RBAC: Authorizing `identity:get_user(user_id=164f5ee8263746ca96cd8f24eaf9088f)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:24:07.230808 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8613d30d-34b0-4c28-b978-a1499553b34d None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:24:07.232447 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 564/1127] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Apr 11 16:24:07 2022] GET /identity/v3/users/164f5ee8263746ca96cd8f24eaf9088f => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:24:07.238581 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8184a460-7b9b-4120-a1fd-b1b3b9c04eb0 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:24:07.332586 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8184a460-7b9b-4120-a1fd-b1b3b9c04eb0 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:24:07.365069 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23154ce-e17f-483c-8aac-7a3390e1b3da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:24:07.365718 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23154ce-e17f-483c-8aac-7a3390e1b3da None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:07.366002 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23154ce-e17f-483c-8aac-7a3390e1b3da None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:07.366278 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23154ce-e17f-483c-8aac-7a3390e1b3da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:07.428926 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23154ce-e17f-483c-8aac-7a3390e1b3da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:24:07.430381 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23154ce-e17f-483c-8aac-7a3390e1b3da None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:24:07.521773 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 564/1128] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Apr 11 16:24:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 11 16:24:07.527646 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8613d30d-34b0-4c28-b978-a1499553b34d None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:24:07.621945 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8613d30d-34b0-4c28-b978-a1499553b34d None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:24:07.653834 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbef2fe7-83e9-42d8-bb5c-f09764ced4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:24:07.654689 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef2fe7-83e9-42d8-bb5c-f09764ced4bd None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:07.654973 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef2fe7-83e9-42d8-bb5c-f09764ced4bd None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:07.655248 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef2fe7-83e9-42d8-bb5c-f09764ced4bd None admin] PATH_INFO: `/v3/projects/5a172495036a4140b4d0db1237fd798c` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:07.656666 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbef2fe7-83e9-42d8-bb5c-f09764ced4bd None admin] RBAC: Authorizing `identity:get_project(project_id=5a172495036a4140b4d0db1237fd798c)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:24:07.658092 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbef2fe7-83e9-42d8-bb5c-f09764ced4bd None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:24:07.659798 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 565/1129] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Apr 11 16:24:07 2022] GET /identity/v3/projects/5a172495036a4140b4d0db1237fd798c => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:24:07.665982 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23154ce-e17f-483c-8aac-7a3390e1b3da None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:24:07.766941 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23154ce-e17f-483c-8aac-7a3390e1b3da None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:24:07.799716 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa24dedf-88a3-493c-a3a3-61b36b8a328b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:24:07.800365 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa24dedf-88a3-493c-a3a3-61b36b8a328b None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:07.800653 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa24dedf-88a3-493c-a3a3-61b36b8a328b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:07.800932 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa24dedf-88a3-493c-a3a3-61b36b8a328b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:07.801761 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa24dedf-88a3-493c-a3a3-61b36b8a328b None admin] RBAC: Adding query filter params (role.id=7d3d5d04ca634b3a9b63e7b05bb5d333, scope.project.id=5a172495036a4140b4d0db1237fd798c, user.id=164f5ee8263746ca96cd8f24eaf9088f) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:24:07.802077 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa24dedf-88a3-493c-a3a3-61b36b8a328b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:24:07.803495 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa24dedf-88a3-493c-a3a3-61b36b8a328b None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:24:07.809108 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 565/1130] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Apr 11 16:24:07 2022] GET /identity/v3/role_assignments?user.id=164f5ee8263746ca96cd8f24eaf9088f&scope.project.id=5a172495036a4140b4d0db1237fd798c&role.id=7d3d5d04ca634b3a9b63e7b05bb5d333 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:24:10.142215 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b3ead-e0d7-474b-bae2-193474dee40d None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:10.142812 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b3ead-e0d7-474b-bae2-193474dee40d None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:10.142812 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b3ead-e0d7-474b-bae2-193474dee40d None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:10.144187 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 566/1131] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:24:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 16:24:10.149241 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc5198-def5-4ddc-8f02-87ffed43ac95 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:10.149678 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc5198-def5-4ddc-8f02-87ffed43ac95 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:10.149806 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc5198-def5-4ddc-8f02-87ffed43ac95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:10.166130 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-a1cc5198-def5-4ddc-8f02-87ffed43ac95 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:24:10.167339 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a1cc5198-def5-4ddc-8f02-87ffed43ac95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:24:10.230666 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 566/1132] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:24:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:24:10.256344 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b3ead-e0d7-474b-bae2-193474dee40d None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:24:10.360572 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b3ead-e0d7-474b-bae2-193474dee40d None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:24:10.392843 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ca6e3b-7d4d-43b6-8073-808de207796b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:24:10.393559 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca6e3b-7d4d-43b6-8073-808de207796b None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:10.393837 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca6e3b-7d4d-43b6-8073-808de207796b None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:10.394109 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca6e3b-7d4d-43b6-8073-808de207796b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:10.395272 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ca6e3b-7d4d-43b6-8073-808de207796b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:24:10.396726 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ca6e3b-7d4d-43b6-8073-808de207796b None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:24:10.398329 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 567/1133] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:24:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:24:10.404288 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cc5198-def5-4ddc-8f02-87ffed43ac95 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:24:10.498336 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cc5198-def5-4ddc-8f02-87ffed43ac95 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:24:10.654638 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe63c2a-a146-4dd5-b683-2b835372d015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:24:10.655218 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe63c2a-a146-4dd5-b683-2b835372d015 None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:10.655500 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe63c2a-a146-4dd5-b683-2b835372d015 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:10.655809 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe63c2a-a146-4dd5-b683-2b835372d015 None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:10.657225 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe63c2a-a146-4dd5-b683-2b835372d015 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:24:10.658646 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe63c2a-a146-4dd5-b683-2b835372d015 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:24:10.789757 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 567/1134] 10.222.0.43 () {60 vars in 1141 bytes} [Mon Apr 11 16:24:10 2022] POST /identity/v3/projects => generated 311 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:24:13.151077 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a61193-8438-4dc9-b3c7-0c539098ccc0 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:13.151660 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a61193-8438-4dc9-b3c7-0c539098ccc0 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:13.151660 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a61193-8438-4dc9-b3c7-0c539098ccc0 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:13.153035 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 568/1135] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:24:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:24:13.158400 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d55b3-0c0a-4f8e-b439-fb3a17f4262c None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:13.158817 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d55b3-0c0a-4f8e-b439-fb3a17f4262c None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:13.158948 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d55b3-0c0a-4f8e-b439-fb3a17f4262c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:13.175234 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-f96d55b3-0c0a-4f8e-b439-fb3a17f4262c None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:24:13.176439 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-f96d55b3-0c0a-4f8e-b439-fb3a17f4262c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:24:13.237373 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 568/1136] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:24:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 16:24:13.263619 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a61193-8438-4dc9-b3c7-0c539098ccc0 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:24:13.381534 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a61193-8438-4dc9-b3c7-0c539098ccc0 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:24:13.415102 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8445e219-4df1-4182-aae7-a747606e7dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:24:13.415842 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8445e219-4df1-4182-aae7-a747606e7dc5 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:13.416124 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8445e219-4df1-4182-aae7-a747606e7dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:13.416394 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8445e219-4df1-4182-aae7-a747606e7dc5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:13.417558 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8445e219-4df1-4182-aae7-a747606e7dc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:24:13.418978 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8445e219-4df1-4182-aae7-a747606e7dc5 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:24:13.420616 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 569/1137] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:24:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:24:13.428224 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96d55b3-0c0a-4f8e-b439-fb3a17f4262c None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:24:13.522751 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96d55b3-0c0a-4f8e-b439-fb3a17f4262c None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:24:13.555817 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5756ff1b-4e3d-4457-a97e-a23ba43cc2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:24:13.556490 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756ff1b-4e3d-4457-a97e-a23ba43cc2e6 None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:13.556775 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756ff1b-4e3d-4457-a97e-a23ba43cc2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:13.557050 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756ff1b-4e3d-4457-a97e-a23ba43cc2e6 None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:13.557765 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5756ff1b-4e3d-4457-a97e-a23ba43cc2e6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:24:13.559178 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5756ff1b-4e3d-4457-a97e-a23ba43cc2e6 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:24:13.664452 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 569/1138] 10.222.0.43 () {60 vars in 1132 bytes} [Mon Apr 11 16:24:13 2022] POST /identity/v3/users => generated 286 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:24:16.050217 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470fd9b-57b6-456f-a523-c3e8216008aa None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:16.050784 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470fd9b-57b6-456f-a523-c3e8216008aa None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:16.050784 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470fd9b-57b6-456f-a523-c3e8216008aa None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:16.052139 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 570/1139] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:24:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:24:16.057173 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f4fda-728b-42de-bc5a-56814779554b None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:16.057579 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f4fda-728b-42de-bc5a-56814779554b None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:16.057725 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f4fda-728b-42de-bc5a-56814779554b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:16.074383 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-602f4fda-728b-42de-bc5a-56814779554b None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:24:16.075571 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-602f4fda-728b-42de-bc5a-56814779554b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:24:16.138870 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 570/1140] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:24:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 16:24:16.163219 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8470fd9b-57b6-456f-a523-c3e8216008aa None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:24:16.264375 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8470fd9b-57b6-456f-a523-c3e8216008aa None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:24:16.296807 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f182ed49-fe17-4842-9c71-a5409f18ce02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:24:16.297599 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182ed49-fe17-4842-9c71-a5409f18ce02 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:16.297881 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182ed49-fe17-4842-9c71-a5409f18ce02 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:16.298155 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182ed49-fe17-4842-9c71-a5409f18ce02 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:16.307921 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f182ed49-fe17-4842-9c71-a5409f18ce02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:24:16.315415 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-f182ed49-fe17-4842-9c71-a5409f18ce02 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 16:24:16.316615 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 571/1141] 10.222.0.43 () {56 vars in 1096 bytes} [Mon Apr 11 16:24:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:24:16.322639 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f4fda-728b-42de-bc5a-56814779554b None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:24:16.416161 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f4fda-728b-42de-bc5a-56814779554b None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:24:16.449736 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1c532d-a116-411f-b9df-f6e184bcaec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:24:16.450413 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c532d-a116-411f-b9df-f6e184bcaec3 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:16.450694 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c532d-a116-411f-b9df-f6e184bcaec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:16.450969 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c532d-a116-411f-b9df-f6e184bcaec3 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:16.451741 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1c532d-a116-411f-b9df-f6e184bcaec3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:24:16.452290 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1c532d-a116-411f-b9df-f6e184bcaec3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:24:16.453842 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1c532d-a116-411f-b9df-f6e184bcaec3 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:24:16.461641 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 571/1142] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Apr 11 16:24:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:24:16.467450 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f182ed49-fe17-4842-9c71-a5409f18ce02 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:24:16.565264 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f182ed49-fe17-4842-9c71-a5409f18ce02 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:24:16.597358 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d7e9bb-eee8-49b1-ba24-d5b0fbdff2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:24:16.598214 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7e9bb-eee8-49b1-ba24-d5b0fbdff2d1 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:16.598497 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7e9bb-eee8-49b1-ba24-d5b0fbdff2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:16.598772 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7e9bb-eee8-49b1-ba24-d5b0fbdff2d1 None admin] PATH_INFO: `/v3/users/380533f8a64a4064a1b14d3a1f514438` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:16.612046 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d7e9bb-eee8-49b1-ba24-d5b0fbdff2d1 None admin] RBAC: Authorizing `identity:get_user(user_id=380533f8a64a4064a1b14d3a1f514438)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:24:16.613477 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d7e9bb-eee8-49b1-ba24-d5b0fbdff2d1 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:24:16.615163 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 572/1143] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Apr 11 16:24:16 2022] GET /identity/v3/users/380533f8a64a4064a1b14d3a1f514438 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:24:16.621135 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1c532d-a116-411f-b9df-f6e184bcaec3 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:24:16.741324 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1c532d-a116-411f-b9df-f6e184bcaec3 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:24:16.771677 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde756bf-7575-471d-9b65-52cb14b56210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:24:16.772316 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde756bf-7575-471d-9b65-52cb14b56210 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:16.772594 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde756bf-7575-471d-9b65-52cb14b56210 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:16.772865 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde756bf-7575-471d-9b65-52cb14b56210 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:16.836300 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde756bf-7575-471d-9b65-52cb14b56210 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:24:16.837629 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde756bf-7575-471d-9b65-52cb14b56210 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:24:16.927820 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 572/1144] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Apr 11 16:24:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 16:24:16.933798 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d7e9bb-eee8-49b1-ba24-d5b0fbdff2d1 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:24:17.031270 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d7e9bb-eee8-49b1-ba24-d5b0fbdff2d1 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:24:17.062850 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6b5133-88fa-45b1-aacf-f54f5dbe20c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:24:17.063739 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b5133-88fa-45b1-aacf-f54f5dbe20c6 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:17.064023 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b5133-88fa-45b1-aacf-f54f5dbe20c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:17.064300 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b5133-88fa-45b1-aacf-f54f5dbe20c6 None admin] PATH_INFO: `/v3/projects/221395031ef64e26a550747c70e90eea` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:17.065469 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6b5133-88fa-45b1-aacf-f54f5dbe20c6 None admin] RBAC: Authorizing `identity:get_project(project_id=221395031ef64e26a550747c70e90eea)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:24:17.066894 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6b5133-88fa-45b1-aacf-f54f5dbe20c6 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:24:17.068636 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 573/1145] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Apr 11 16:24:16 2022] GET /identity/v3/projects/221395031ef64e26a550747c70e90eea => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:24:17.074665 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde756bf-7575-471d-9b65-52cb14b56210 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:24:17.167340 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde756bf-7575-471d-9b65-52cb14b56210 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:24:17.198860 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1284dd2e-80fc-4454-ae55-4a723e7f270d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:24:17.199494 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1284dd2e-80fc-4454-ae55-4a723e7f270d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:17.199805 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1284dd2e-80fc-4454-ae55-4a723e7f270d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:17.200072 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1284dd2e-80fc-4454-ae55-4a723e7f270d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:17.200988 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1284dd2e-80fc-4454-ae55-4a723e7f270d None admin] RBAC: Adding query filter params (role.id=702e5e78b5d744529384b96a390ae92f, scope.project.id=221395031ef64e26a550747c70e90eea, user.id=380533f8a64a4064a1b14d3a1f514438) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:24:17.201295 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1284dd2e-80fc-4454-ae55-4a723e7f270d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:24:17.203243 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1284dd2e-80fc-4454-ae55-4a723e7f270d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:24:17.208390 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 573/1146] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Apr 11 16:24:17 2022] GET /identity/v3/role_assignments?user.id=380533f8a64a4064a1b14d3a1f514438&scope.project.id=221395031ef64e26a550747c70e90eea&role.id=702e5e78b5d744529384b96a390ae92f => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:24:19.511140 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc43fd0-1307-4a2d-8d1a-1a411d364c32 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:19.511761 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc43fd0-1307-4a2d-8d1a-1a411d364c32 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:19.511761 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc43fd0-1307-4a2d-8d1a-1a411d364c32 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:19.513090 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 574/1147] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:24:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:24:19.518775 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253cd0b-968d-4a2e-ba41-d303590df716 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:19.524897 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253cd0b-968d-4a2e-ba41-d303590df716 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:19.524897 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253cd0b-968d-4a2e-ba41-d303590df716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:19.536544 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-9253cd0b-968d-4a2e-ba41-d303590df716 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:24:19.537755 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-9253cd0b-968d-4a2e-ba41-d303590df716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:24:19.600926 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 574/1148] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:24:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:24:19.623688 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc43fd0-1307-4a2d-8d1a-1a411d364c32 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:24:19.721024 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc43fd0-1307-4a2d-8d1a-1a411d364c32 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:24:19.754863 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708519f8-e08c-42f9-9f57-bd4535e58a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:24:19.755624 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708519f8-e08c-42f9-9f57-bd4535e58a71 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:19.755909 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708519f8-e08c-42f9-9f57-bd4535e58a71 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:19.756185 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708519f8-e08c-42f9-9f57-bd4535e58a71 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:19.765782 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708519f8-e08c-42f9-9f57-bd4535e58a71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:24:19.772684 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-708519f8-e08c-42f9-9f57-bd4535e58a71 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 16:24:19.773842 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 575/1149] 10.222.0.43 () {56 vars in 1096 bytes} [Mon Apr 11 16:24:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:24:19.782016 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9253cd0b-968d-4a2e-ba41-d303590df716 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:24:19.875818 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9253cd0b-968d-4a2e-ba41-d303590df716 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:24:19.907392 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d50ce0-3e9f-4d4b-a1b1-edd9ce665123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:24:19.908074 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d50ce0-3e9f-4d4b-a1b1-edd9ce665123 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:19.908355 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d50ce0-3e9f-4d4b-a1b1-edd9ce665123 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:19.908627 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d50ce0-3e9f-4d4b-a1b1-edd9ce665123 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:19.909362 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d50ce0-3e9f-4d4b-a1b1-edd9ce665123 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:24:19.909665 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d50ce0-3e9f-4d4b-a1b1-edd9ce665123 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:24:19.911016 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d50ce0-3e9f-4d4b-a1b1-edd9ce665123 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:24:19.918630 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 575/1150] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Apr 11 16:24:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:24:19.925096 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708519f8-e08c-42f9-9f57-bd4535e58a71 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:24:20.021660 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708519f8-e08c-42f9-9f57-bd4535e58a71 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:24:20.053894 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09165656-7e24-4254-b2ce-ed6d9430b66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:24:20.054762 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09165656-7e24-4254-b2ce-ed6d9430b66c None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:20.055044 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09165656-7e24-4254-b2ce-ed6d9430b66c None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:20.055318 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09165656-7e24-4254-b2ce-ed6d9430b66c None admin] PATH_INFO: `/v3/users/380533f8a64a4064a1b14d3a1f514438` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:20.056523 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09165656-7e24-4254-b2ce-ed6d9430b66c None admin] RBAC: Authorizing `identity:get_user(user_id=380533f8a64a4064a1b14d3a1f514438)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:24:20.057943 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09165656-7e24-4254-b2ce-ed6d9430b66c None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:24:20.059594 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 576/1151] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Apr 11 16:24:19 2022] GET /identity/v3/users/380533f8a64a4064a1b14d3a1f514438 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:24:20.065954 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d50ce0-3e9f-4d4b-a1b1-edd9ce665123 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:24:20.158914 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d50ce0-3e9f-4d4b-a1b1-edd9ce665123 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:24:20.190852 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93868388-fcd8-4dc9-a36c-b9fc3ac0607c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:24:20.191727 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93868388-fcd8-4dc9-a36c-b9fc3ac0607c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:20.192007 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93868388-fcd8-4dc9-a36c-b9fc3ac0607c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:20.192279 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93868388-fcd8-4dc9-a36c-b9fc3ac0607c None admin] PATH_INFO: `/v3/projects/221395031ef64e26a550747c70e90eea` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:20.193439 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93868388-fcd8-4dc9-a36c-b9fc3ac0607c None admin] RBAC: Authorizing `identity:get_project(project_id=221395031ef64e26a550747c70e90eea)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:24:20.194845 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93868388-fcd8-4dc9-a36c-b9fc3ac0607c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:24:20.196542 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 576/1152] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Apr 11 16:24:20 2022] GET /identity/v3/projects/221395031ef64e26a550747c70e90eea => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:24:20.203072 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09165656-7e24-4254-b2ce-ed6d9430b66c None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:24:20.299188 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09165656-7e24-4254-b2ce-ed6d9430b66c None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:24:20.330772 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db57b3b-a448-4f55-926b-9a685d97f61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:24:20.331697 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db57b3b-a448-4f55-926b-9a685d97f61d None admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:20.331984 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db57b3b-a448-4f55-926b-9a685d97f61d None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:20.332256 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db57b3b-a448-4f55-926b-9a685d97f61d None admin] PATH_INFO: `/v3/projects/221395031ef64e26a550747c70e90eea/users/380533f8a64a4064a1b14d3a1f514438/roles/702e5e78b5d744529384b96a390ae92f` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:20.334201 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db57b3b-a448-4f55-926b-9a685d97f61d None admin] RBAC: Authorizing `identity:create_grant(project_id=221395031ef64e26a550747c70e90eea, user_id=380533f8a64a4064a1b14d3a1f514438, role_id=702e5e78b5d744529384b96a390ae92f)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:24:20.335646 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db57b3b-a448-4f55-926b-9a685d97f61d None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:24:20.431048 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 577/1153] 10.222.0.43 () {58 vars in 1439 bytes} [Mon Apr 11 16:24:20 2022] PUT /identity/v3/projects/221395031ef64e26a550747c70e90eea/users/380533f8a64a4064a1b14d3a1f514438/roles/702e5e78b5d744529384b96a390ae92f => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:24:22.747608 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5518b9c-5381-4d0c-b137-6eb040883128 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:22.748743 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5518b9c-5381-4d0c-b137-6eb040883128 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:22.748743 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5518b9c-5381-4d0c-b137-6eb040883128 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:22.749994 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 577/1154] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:24:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:24:22.755174 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b031e-f76a-4eea-879e-d835ac043670 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:22.755638 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b031e-f76a-4eea-879e-d835ac043670 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:22.755758 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b031e-f76a-4eea-879e-d835ac043670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:22.772477 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-dc8b031e-f76a-4eea-879e-d835ac043670 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:24:22.773652 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-dc8b031e-f76a-4eea-879e-d835ac043670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:24:22.836380 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 578/1155] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:24:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:24:22.861429 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5518b9c-5381-4d0c-b137-6eb040883128 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:24:22.956973 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5518b9c-5381-4d0c-b137-6eb040883128 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:24:22.989215 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8189c9b-f89e-48d1-bfaf-4105d055512b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:24:22.990002 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8189c9b-f89e-48d1-bfaf-4105d055512b None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:22.990286 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8189c9b-f89e-48d1-bfaf-4105d055512b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:22.990562 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8189c9b-f89e-48d1-bfaf-4105d055512b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:23.001015 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8189c9b-f89e-48d1-bfaf-4105d055512b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:24:23.007836 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-e8189c9b-f89e-48d1-bfaf-4105d055512b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 16:24:23.009010 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 578/1156] 10.222.0.43 () {56 vars in 1096 bytes} [Mon Apr 11 16:24:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:24:23.015113 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8b031e-f76a-4eea-879e-d835ac043670 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:24:23.110708 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8b031e-f76a-4eea-879e-d835ac043670 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:24:23.143752 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b4868e-ac7b-44c8-933e-94fb002ebe2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:24:23.144425 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b4868e-ac7b-44c8-933e-94fb002ebe2b None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:23.144707 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b4868e-ac7b-44c8-933e-94fb002ebe2b None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:23.144979 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b4868e-ac7b-44c8-933e-94fb002ebe2b None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:23.145726 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b4868e-ac7b-44c8-933e-94fb002ebe2b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:24:23.146028 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b4868e-ac7b-44c8-933e-94fb002ebe2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:24:23.147372 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b4868e-ac7b-44c8-933e-94fb002ebe2b None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:24:23.155374 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 579/1157] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Apr 11 16:24:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:24:23.161245 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8189c9b-f89e-48d1-bfaf-4105d055512b None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:24:23.256869 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8189c9b-f89e-48d1-bfaf-4105d055512b None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:24:23.288305 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5dcc78-63a4-425e-a111-44d54181ff59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:24:23.289166 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5dcc78-63a4-425e-a111-44d54181ff59 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:23.289451 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5dcc78-63a4-425e-a111-44d54181ff59 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:23.289729 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5dcc78-63a4-425e-a111-44d54181ff59 None admin] PATH_INFO: `/v3/users/380533f8a64a4064a1b14d3a1f514438` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:23.290906 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5dcc78-63a4-425e-a111-44d54181ff59 None admin] RBAC: Authorizing `identity:get_user(user_id=380533f8a64a4064a1b14d3a1f514438)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:24:23.292370 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5dcc78-63a4-425e-a111-44d54181ff59 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:24:23.294004 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 579/1158] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Apr 11 16:24:23 2022] GET /identity/v3/users/380533f8a64a4064a1b14d3a1f514438 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:24:23.300499 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b4868e-ac7b-44c8-933e-94fb002ebe2b None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:24:23.395297 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b4868e-ac7b-44c8-933e-94fb002ebe2b None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:24:23.431366 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e765539d-9241-41aa-9d8e-41000fcbe896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:24:23.432048 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e765539d-9241-41aa-9d8e-41000fcbe896 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:23.432331 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e765539d-9241-41aa-9d8e-41000fcbe896 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:23.432607 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e765539d-9241-41aa-9d8e-41000fcbe896 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:23.498536 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e765539d-9241-41aa-9d8e-41000fcbe896 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:24:23.500116 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e765539d-9241-41aa-9d8e-41000fcbe896 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:24:23.593355 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 580/1159] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Apr 11 16:24:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 16:24:23.599250 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5dcc78-63a4-425e-a111-44d54181ff59 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:24:23.698834 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5dcc78-63a4-425e-a111-44d54181ff59 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:24:23.735932 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956a43ad-3f12-40ea-bac5-bbb6e5413651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:24:23.736794 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a43ad-3f12-40ea-bac5-bbb6e5413651 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:23.737080 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a43ad-3f12-40ea-bac5-bbb6e5413651 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:23.737355 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a43ad-3f12-40ea-bac5-bbb6e5413651 None admin] PATH_INFO: `/v3/projects/221395031ef64e26a550747c70e90eea` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:23.738524 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956a43ad-3f12-40ea-bac5-bbb6e5413651 None admin] RBAC: Authorizing `identity:get_project(project_id=221395031ef64e26a550747c70e90eea)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:24:23.740020 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956a43ad-3f12-40ea-bac5-bbb6e5413651 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:24:23.741702 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 580/1160] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Apr 11 16:24:23 2022] GET /identity/v3/projects/221395031ef64e26a550747c70e90eea => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:24:23.747871 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e765539d-9241-41aa-9d8e-41000fcbe896 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:24:23.840628 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e765539d-9241-41aa-9d8e-41000fcbe896 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:24:23.874152 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc8920b-baf0-4571-8efc-36cf8546caea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:24:23.874793 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8920b-baf0-4571-8efc-36cf8546caea None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:23.875077 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8920b-baf0-4571-8efc-36cf8546caea None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:23.875355 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8920b-baf0-4571-8efc-36cf8546caea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:23.876204 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc8920b-baf0-4571-8efc-36cf8546caea None admin] RBAC: Adding query filter params (role.id=702e5e78b5d744529384b96a390ae92f, scope.project.id=221395031ef64e26a550747c70e90eea, user.id=380533f8a64a4064a1b14d3a1f514438) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:24:23.876515 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc8920b-baf0-4571-8efc-36cf8546caea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:24:23.877929 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc8920b-baf0-4571-8efc-36cf8546caea None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:24:23.883473 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 581/1161] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Apr 11 16:24:23 2022] GET /identity/v3/role_assignments?user.id=380533f8a64a4064a1b14d3a1f514438&scope.project.id=221395031ef64e26a550747c70e90eea&role.id=702e5e78b5d744529384b96a390ae92f => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:24:26.227504 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ec4bad-c584-456d-a55a-3a0b277cdce7 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:26.228080 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ec4bad-c584-456d-a55a-3a0b277cdce7 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:26.228080 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ec4bad-c584-456d-a55a-3a0b277cdce7 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:26.229442 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 581/1162] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:24:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:24:26.235004 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3ed8b-5250-44d5-bf74-2694961f11bf None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:26.235395 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3ed8b-5250-44d5-bf74-2694961f11bf None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:26.235586 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3ed8b-5250-44d5-bf74-2694961f11bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:26.252267 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-dbb3ed8b-5250-44d5-bf74-2694961f11bf None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:24:26.253451 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-dbb3ed8b-5250-44d5-bf74-2694961f11bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:24:26.316315 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 582/1163] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:24:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:24:26.338668 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ec4bad-c584-456d-a55a-3a0b277cdce7 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:24:26.443249 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ec4bad-c584-456d-a55a-3a0b277cdce7 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:24:26.477562 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff42a38-3b48-459c-8283-086aa97f14f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:24:26.478159 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff42a38-3b48-459c-8283-086aa97f14f6 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:26.478447 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff42a38-3b48-459c-8283-086aa97f14f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:26.478722 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff42a38-3b48-459c-8283-086aa97f14f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:26.545943 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff42a38-3b48-459c-8283-086aa97f14f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:24:26.547380 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff42a38-3b48-459c-8283-086aa97f14f6 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:24:26.641330 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 582/1164] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Apr 11 16:24:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 16:24:26.648613 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb3ed8b-5250-44d5-bf74-2694961f11bf None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:24:26.743477 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb3ed8b-5250-44d5-bf74-2694961f11bf None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:24:26.775639 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d6d75d-36a6-4e52-997a-2acf836a0335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:24:26.776431 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d6d75d-36a6-4e52-997a-2acf836a0335 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:26.776710 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d6d75d-36a6-4e52-997a-2acf836a0335 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:26.776981 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d6d75d-36a6-4e52-997a-2acf836a0335 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:26.784104 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d6d75d-36a6-4e52-997a-2acf836a0335 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:24:26.785525 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d6d75d-36a6-4e52-997a-2acf836a0335 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:24:26.798497 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-e6d6d75d-36a6-4e52-997a-2acf836a0335 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Apr 11 16:24:26.799669 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 583/1165] 10.222.0.43 () {56 vars in 1117 bytes} [Mon Apr 11 16:24:26 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:24:26.805814 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff42a38-3b48-459c-8283-086aa97f14f6 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:24:26.898094 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff42a38-3b48-459c-8283-086aa97f14f6 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:24:26.929770 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bad2a8-56d6-41c1-9ab5-1375b9645f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:24:26.930427 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bad2a8-56d6-41c1-9ab5-1375b9645f68 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:26.930711 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bad2a8-56d6-41c1-9ab5-1375b9645f68 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:26.930986 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bad2a8-56d6-41c1-9ab5-1375b9645f68 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:26.931741 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bad2a8-56d6-41c1-9ab5-1375b9645f68 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:24:26.932051 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bad2a8-56d6-41c1-9ab5-1375b9645f68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:24:26.933443 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bad2a8-56d6-41c1-9ab5-1375b9645f68 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:24:26.940781 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 583/1166] 10.222.0.43 () {56 vars in 1115 bytes} [Mon Apr 11 16:24:26 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:24:29.250896 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858efbc5-a86f-42ce-87ce-1c132355c74a None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:29.251455 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858efbc5-a86f-42ce-87ce-1c132355c74a None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:29.251455 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858efbc5-a86f-42ce-87ce-1c132355c74a None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:29.252856 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 584/1167] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:24:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:24:29.258077 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57f9f0-0b40-4614-aac4-906d876e3fc6 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:29.258494 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57f9f0-0b40-4614-aac4-906d876e3fc6 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:29.258631 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57f9f0-0b40-4614-aac4-906d876e3fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:29.275386 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-fe57f9f0-0b40-4614-aac4-906d876e3fc6 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:24:29.276593 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-fe57f9f0-0b40-4614-aac4-906d876e3fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:24:29.337891 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 584/1168] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:24:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:24:29.362261 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858efbc5-a86f-42ce-87ce-1c132355c74a None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:24:29.466129 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858efbc5-a86f-42ce-87ce-1c132355c74a None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:24:29.500534 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4a688c-91d2-4779-bc8d-4214a0f4f401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:24:29.501285 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4a688c-91d2-4779-bc8d-4214a0f4f401 None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:29.501513 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4a688c-91d2-4779-bc8d-4214a0f4f401 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:29.501790 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4a688c-91d2-4779-bc8d-4214a0f4f401 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:29.502548 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4a688c-91d2-4779-bc8d-4214a0f4f401 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:24:29.510627 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4a688c-91d2-4779-bc8d-4214a0f4f401 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:24:29.587210 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 585/1169] 10.222.0.43 () {60 vars in 1138 bytes} [Mon Apr 11 16:24:29 2022] POST /identity/v3/domains => generated 267 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:24:31.955533 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe572d-8ce0-49ac-a29c-123a32185368 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:31.956093 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe572d-8ce0-49ac-a29c-123a32185368 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:31.956093 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe572d-8ce0-49ac-a29c-123a32185368 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:31.957465 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 585/1170] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:24:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:24:31.962642 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23dca5-da7a-411b-a7ab-7b25195965aa None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:31.963063 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23dca5-da7a-411b-a7ab-7b25195965aa None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:31.963195 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23dca5-da7a-411b-a7ab-7b25195965aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:31.979967 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-2d23dca5-da7a-411b-a7ab-7b25195965aa None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:24:31.981427 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-2d23dca5-da7a-411b-a7ab-7b25195965aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:24:32.044422 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 586/1171] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:24:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:24:32.069607 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fe572d-8ce0-49ac-a29c-123a32185368 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:24:32.170647 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fe572d-8ce0-49ac-a29c-123a32185368 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:24:32.203200 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d240a5a-3b56-434b-a7eb-9fba766ce86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:24:32.204090 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d240a5a-3b56-434b-a7eb-9fba766ce86e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:32.204376 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d240a5a-3b56-434b-a7eb-9fba766ce86e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:32.204652 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d240a5a-3b56-434b-a7eb-9fba766ce86e None admin] PATH_INFO: `/v3/domains/905b42704e4d402b91be7fa155bbc1bf` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:32.214953 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d240a5a-3b56-434b-a7eb-9fba766ce86e None admin] RBAC: Authorizing `identity:get_domain(domain_id=905b42704e4d402b91be7fa155bbc1bf)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:24:32.216979 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d240a5a-3b56-434b-a7eb-9fba766ce86e None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:24:32.218650 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 586/1172] 10.222.0.43 () {56 vars in 1183 bytes} [Mon Apr 11 16:24:32 2022] GET /identity/v3/domains/905b42704e4d402b91be7fa155bbc1bf => generated 267 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:24:32.224524 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d23dca5-da7a-411b-a7ab-7b25195965aa None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:24:32.319037 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d23dca5-da7a-411b-a7ab-7b25195965aa None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:24:32.351225 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82766e86-c576-4732-a979-742a02878302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:24:32.351918 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82766e86-c576-4732-a979-742a02878302 None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:32.352203 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82766e86-c576-4732-a979-742a02878302 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:32.352477 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82766e86-c576-4732-a979-742a02878302 None admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:32.353180 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82766e86-c576-4732-a979-742a02878302 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:24:32.354586 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82766e86-c576-4732-a979-742a02878302 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:24:32.473207 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 587/1173] 10.222.0.43 () {60 vars in 1141 bytes} [Mon Apr 11 16:24:32 2022] POST /identity/v3/projects => generated 361 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:24:34.860419 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f526f-09f0-46f1-b17c-a858f20fe4f0 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:34.860958 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f526f-09f0-46f1-b17c-a858f20fe4f0 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:34.860958 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f526f-09f0-46f1-b17c-a858f20fe4f0 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:34.862319 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 587/1174] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:24:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:24:34.867483 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f9d66-b8b0-424a-8fa8-13c7c585e01f None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:34.867933 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f9d66-b8b0-424a-8fa8-13c7c585e01f None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:34.868083 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f9d66-b8b0-424a-8fa8-13c7c585e01f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:34.885109 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-388f9d66-b8b0-424a-8fa8-13c7c585e01f None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:24:34.886305 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-388f9d66-b8b0-424a-8fa8-13c7c585e01f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:24:34.950669 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 588/1175] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:24:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:24:34.976450 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f526f-09f0-46f1-b17c-a858f20fe4f0 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:24:35.074009 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f526f-09f0-46f1-b17c-a858f20fe4f0 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:24:35.107383 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bcf719-8a55-411d-b2b9-16a0ded1c71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:24:35.108288 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bcf719-8a55-411d-b2b9-16a0ded1c71a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:35.108568 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bcf719-8a55-411d-b2b9-16a0ded1c71a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:35.108911 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bcf719-8a55-411d-b2b9-16a0ded1c71a None admin] PATH_INFO: `/v3/domains/905b42704e4d402b91be7fa155bbc1bf` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:35.110327 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bcf719-8a55-411d-b2b9-16a0ded1c71a None admin] RBAC: Authorizing `identity:get_domain(domain_id=905b42704e4d402b91be7fa155bbc1bf)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:24:35.111843 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bcf719-8a55-411d-b2b9-16a0ded1c71a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:24:35.113472 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 588/1176] 10.222.0.43 () {56 vars in 1183 bytes} [Mon Apr 11 16:24:34 2022] GET /identity/v3/domains/905b42704e4d402b91be7fa155bbc1bf => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:24:35.119540 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f9d66-b8b0-424a-8fa8-13c7c585e01f None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:24:35.215429 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f9d66-b8b0-424a-8fa8-13c7c585e01f None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:24:35.249407 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b065185-4b7c-434e-b31a-6aea08d9929b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:24:35.250081 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b065185-4b7c-434e-b31a-6aea08d9929b None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:35.250367 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b065185-4b7c-434e-b31a-6aea08d9929b None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:35.250641 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b065185-4b7c-434e-b31a-6aea08d9929b None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:35.251347 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b065185-4b7c-434e-b31a-6aea08d9929b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:24:35.252987 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b065185-4b7c-434e-b31a-6aea08d9929b None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:24:35.377766 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 589/1177] 10.222.0.43 () {60 vars in 1132 bytes} [Mon Apr 11 16:24:35 2022] POST /identity/v3/users => generated 311 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:24:37.761562 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5805de-6f39-457e-b5e3-48095e45dda0 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:37.762185 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5805de-6f39-457e-b5e3-48095e45dda0 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:37.762185 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5805de-6f39-457e-b5e3-48095e45dda0 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:37.764027 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 589/1178] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:24:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:24:37.769111 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbfaf2d-bdbf-4ea1-97b2-c2aa30e0f68b None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:37.769500 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbfaf2d-bdbf-4ea1-97b2-c2aa30e0f68b None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:37.769667 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbfaf2d-bdbf-4ea1-97b2-c2aa30e0f68b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:37.785888 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-4cbfaf2d-bdbf-4ea1-97b2-c2aa30e0f68b None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:24:37.787065 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-4cbfaf2d-bdbf-4ea1-97b2-c2aa30e0f68b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:24:37.851374 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 590/1179] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:24:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:24:37.876933 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5805de-6f39-457e-b5e3-48095e45dda0 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:24:37.970889 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5805de-6f39-457e-b5e3-48095e45dda0 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:24:38.003193 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be93ea97-93fc-4548-bea3-1363d31af9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:24:38.004005 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be93ea97-93fc-4548-bea3-1363d31af9f7 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:38.004294 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be93ea97-93fc-4548-bea3-1363d31af9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:38.004571 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be93ea97-93fc-4548-bea3-1363d31af9f7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:38.014992 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be93ea97-93fc-4548-bea3-1363d31af9f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:24:38.021856 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-be93ea97-93fc-4548-bea3-1363d31af9f7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 16:24:38.023045 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 590/1180] 10.222.0.43 () {56 vars in 1096 bytes} [Mon Apr 11 16:24:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:24:38.029699 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbfaf2d-bdbf-4ea1-97b2-c2aa30e0f68b None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:24:38.121162 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbfaf2d-bdbf-4ea1-97b2-c2aa30e0f68b None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:24:38.153180 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a061481-735d-4fda-b88b-9e8a0646c87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:24:38.153833 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a061481-735d-4fda-b88b-9e8a0646c87e None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:38.154111 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a061481-735d-4fda-b88b-9e8a0646c87e None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:38.154381 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a061481-735d-4fda-b88b-9e8a0646c87e None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:38.155112 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a061481-735d-4fda-b88b-9e8a0646c87e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:24:38.155413 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a061481-735d-4fda-b88b-9e8a0646c87e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:24:38.156781 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a061481-735d-4fda-b88b-9e8a0646c87e None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:24:38.164376 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 591/1181] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Apr 11 16:24:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:24:38.170408 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be93ea97-93fc-4548-bea3-1363d31af9f7 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:24:38.265854 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be93ea97-93fc-4548-bea3-1363d31af9f7 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:24:38.296344 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6713be3f-d6b6-49b6-98d3-cf9687ebfef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:24:38.297199 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6713be3f-d6b6-49b6-98d3-cf9687ebfef6 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:38.297479 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6713be3f-d6b6-49b6-98d3-cf9687ebfef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:38.297753 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6713be3f-d6b6-49b6-98d3-cf9687ebfef6 None admin] PATH_INFO: `/v3/users/2f44d5908861460985d67d1a61bf2506` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:38.310498 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6713be3f-d6b6-49b6-98d3-cf9687ebfef6 None admin] RBAC: Authorizing `identity:get_user(user_id=2f44d5908861460985d67d1a61bf2506)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:24:38.311948 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6713be3f-d6b6-49b6-98d3-cf9687ebfef6 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:24:38.313564 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 591/1182] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Apr 11 16:24:38 2022] GET /identity/v3/users/2f44d5908861460985d67d1a61bf2506 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:24:38.319413 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a061481-735d-4fda-b88b-9e8a0646c87e None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:24:38.413190 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a061481-735d-4fda-b88b-9e8a0646c87e None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:24:38.445323 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6a0e5-b8a6-40e2-b1c9-1ebf9f2b9d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:24:38.445968 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6a0e5-b8a6-40e2-b1c9-1ebf9f2b9d59 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:38.446248 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6a0e5-b8a6-40e2-b1c9-1ebf9f2b9d59 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:38.446522 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6a0e5-b8a6-40e2-b1c9-1ebf9f2b9d59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:38.510713 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f6a0e5-b8a6-40e2-b1c9-1ebf9f2b9d59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:24:38.512913 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f6a0e5-b8a6-40e2-b1c9-1ebf9f2b9d59 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:24:38.617168 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 592/1183] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Apr 11 16:24:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 16:24:38.624016 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6713be3f-d6b6-49b6-98d3-cf9687ebfef6 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:24:38.716756 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6713be3f-d6b6-49b6-98d3-cf9687ebfef6 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:24:38.749435 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37778fd-b6ee-41c3-8dd8-09682c89db3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:24:38.750285 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37778fd-b6ee-41c3-8dd8-09682c89db3f None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:38.750572 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37778fd-b6ee-41c3-8dd8-09682c89db3f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:38.750851 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37778fd-b6ee-41c3-8dd8-09682c89db3f None admin] PATH_INFO: `/v3/projects/e0f10ce7339c4b828911cf908f47b462` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:38.752055 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37778fd-b6ee-41c3-8dd8-09682c89db3f None admin] RBAC: Authorizing `identity:get_project(project_id=e0f10ce7339c4b828911cf908f47b462)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:24:38.753471 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37778fd-b6ee-41c3-8dd8-09682c89db3f None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:24:38.755155 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 592/1184] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Apr 11 16:24:38 2022] GET /identity/v3/projects/e0f10ce7339c4b828911cf908f47b462 => generated 361 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:24:38.761811 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6a0e5-b8a6-40e2-b1c9-1ebf9f2b9d59 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:24:38.859182 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6a0e5-b8a6-40e2-b1c9-1ebf9f2b9d59 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:24:38.899784 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e828b2-62ab-44a8-828f-4f4f6079de1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:24:38.900960 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e828b2-62ab-44a8-828f-4f4f6079de1a None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:38.901239 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e828b2-62ab-44a8-828f-4f4f6079de1a None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:38.901570 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e828b2-62ab-44a8-828f-4f4f6079de1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:38.903228 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e828b2-62ab-44a8-828f-4f4f6079de1a None admin] RBAC: Adding query filter params (role.id=702e5e78b5d744529384b96a390ae92f, scope.project.id=e0f10ce7339c4b828911cf908f47b462, user.id=2f44d5908861460985d67d1a61bf2506) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:24:38.903569 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e828b2-62ab-44a8-828f-4f4f6079de1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:24:38.904996 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e828b2-62ab-44a8-828f-4f4f6079de1a None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:24:38.910293 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 593/1185] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Apr 11 16:24:38 2022] GET /identity/v3/role_assignments?user.id=2f44d5908861460985d67d1a61bf2506&scope.project.id=e0f10ce7339c4b828911cf908f47b462&role.id=702e5e78b5d744529384b96a390ae92f => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:24:41.192061 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e6049-119d-4125-ae84-5c287045ced8 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:41.192712 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e6049-119d-4125-ae84-5c287045ced8 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:41.192712 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e6049-119d-4125-ae84-5c287045ced8 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:41.193957 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 593/1186] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:24:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:24:41.199163 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0335a22-bc2c-42e9-b899-608330c83a5d None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:41.199840 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0335a22-bc2c-42e9-b899-608330c83a5d None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:41.199840 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0335a22-bc2c-42e9-b899-608330c83a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:41.216957 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-d0335a22-bc2c-42e9-b899-608330c83a5d None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:24:41.218158 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-d0335a22-bc2c-42e9-b899-608330c83a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:24:41.281782 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 594/1187] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:24:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:24:41.304458 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461e6049-119d-4125-ae84-5c287045ced8 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:24:41.399827 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461e6049-119d-4125-ae84-5c287045ced8 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:24:41.431333 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e3c44-fdac-4996-8c05-6a664cae4766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:24:41.432149 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e3c44-fdac-4996-8c05-6a664cae4766 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:41.432434 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e3c44-fdac-4996-8c05-6a664cae4766 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:41.432711 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e3c44-fdac-4996-8c05-6a664cae4766 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:41.443151 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37e3c44-fdac-4996-8c05-6a664cae4766 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:24:41.450773 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-f37e3c44-fdac-4996-8c05-6a664cae4766 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 16:24:41.451984 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 594/1188] 10.222.0.43 () {56 vars in 1096 bytes} [Mon Apr 11 16:24:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:24:41.459362 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0335a22-bc2c-42e9-b899-608330c83a5d None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:24:41.555817 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0335a22-bc2c-42e9-b899-608330c83a5d None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:24:41.589771 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e7efcc-be08-4d3d-ba74-2ec904c962a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:24:41.591163 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7efcc-be08-4d3d-ba74-2ec904c962a0 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:41.591655 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7efcc-be08-4d3d-ba74-2ec904c962a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:41.591940 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7efcc-be08-4d3d-ba74-2ec904c962a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:41.592870 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e7efcc-be08-4d3d-ba74-2ec904c962a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:24:41.595079 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e7efcc-be08-4d3d-ba74-2ec904c962a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:24:41.598101 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e7efcc-be08-4d3d-ba74-2ec904c962a0 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:24:41.607279 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 595/1189] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Apr 11 16:24:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:24:41.613256 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e3c44-fdac-4996-8c05-6a664cae4766 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:24:41.709372 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e3c44-fdac-4996-8c05-6a664cae4766 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:24:41.742158 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bc7d1b-d250-46a2-8367-742f3d1c1f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:24:41.743174 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc7d1b-d250-46a2-8367-742f3d1c1f58 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:41.743460 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc7d1b-d250-46a2-8367-742f3d1c1f58 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:41.743760 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc7d1b-d250-46a2-8367-742f3d1c1f58 None admin] PATH_INFO: `/v3/users/2f44d5908861460985d67d1a61bf2506` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:41.744940 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bc7d1b-d250-46a2-8367-742f3d1c1f58 None admin] RBAC: Authorizing `identity:get_user(user_id=2f44d5908861460985d67d1a61bf2506)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:24:41.746356 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bc7d1b-d250-46a2-8367-742f3d1c1f58 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:24:41.748108 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 595/1190] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Apr 11 16:24:41 2022] GET /identity/v3/users/2f44d5908861460985d67d1a61bf2506 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:24:41.753955 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e7efcc-be08-4d3d-ba74-2ec904c962a0 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:24:41.850722 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e7efcc-be08-4d3d-ba74-2ec904c962a0 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:24:41.884386 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f583bc-bd7f-4f64-beb2-d3337ea77eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:24:41.885253 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f583bc-bd7f-4f64-beb2-d3337ea77eb7 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:41.885538 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f583bc-bd7f-4f64-beb2-d3337ea77eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:41.885812 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f583bc-bd7f-4f64-beb2-d3337ea77eb7 None admin] PATH_INFO: `/v3/projects/e0f10ce7339c4b828911cf908f47b462` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:41.887021 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f583bc-bd7f-4f64-beb2-d3337ea77eb7 None admin] RBAC: Authorizing `identity:get_project(project_id=e0f10ce7339c4b828911cf908f47b462)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:24:41.889375 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f583bc-bd7f-4f64-beb2-d3337ea77eb7 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:24:41.891083 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 596/1191] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Apr 11 16:24:41 2022] GET /identity/v3/projects/e0f10ce7339c4b828911cf908f47b462 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:24:41.897044 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bc7d1b-d250-46a2-8367-742f3d1c1f58 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:24:41.992626 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bc7d1b-d250-46a2-8367-742f3d1c1f58 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:24:42.024680 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c74b9d-65f3-471e-b89b-b16f77ad5f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:24:42.025572 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c74b9d-65f3-471e-b89b-b16f77ad5f73 None admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:42.025856 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c74b9d-65f3-471e-b89b-b16f77ad5f73 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:42.026133 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c74b9d-65f3-471e-b89b-b16f77ad5f73 None admin] PATH_INFO: `/v3/projects/e0f10ce7339c4b828911cf908f47b462/users/2f44d5908861460985d67d1a61bf2506/roles/702e5e78b5d744529384b96a390ae92f` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:42.028192 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c74b9d-65f3-471e-b89b-b16f77ad5f73 None admin] RBAC: Authorizing `identity:create_grant(project_id=e0f10ce7339c4b828911cf908f47b462, user_id=2f44d5908861460985d67d1a61bf2506, role_id=702e5e78b5d744529384b96a390ae92f)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:24:42.029615 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c74b9d-65f3-471e-b89b-b16f77ad5f73 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:24:42.104009 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 596/1192] 10.222.0.43 () {58 vars in 1439 bytes} [Mon Apr 11 16:24:41 2022] PUT /identity/v3/projects/e0f10ce7339c4b828911cf908f47b462/users/2f44d5908861460985d67d1a61bf2506/roles/702e5e78b5d744529384b96a390ae92f => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:24:44.443060 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75dca9-718c-413c-8a47-e70c8ad46956 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:44.443714 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75dca9-718c-413c-8a47-e70c8ad46956 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:44.443714 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75dca9-718c-413c-8a47-e70c8ad46956 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:44.445037 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 597/1193] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:24:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:24:44.450608 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4bec53-d1c3-42e4-9a17-a0aac9cf03c7 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:44.451097 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4bec53-d1c3-42e4-9a17-a0aac9cf03c7 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:44.451203 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4bec53-d1c3-42e4-9a17-a0aac9cf03c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:44.469293 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-ba4bec53-d1c3-42e4-9a17-a0aac9cf03c7 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:24:44.470521 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ba4bec53-d1c3-42e4-9a17-a0aac9cf03c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:24:44.544342 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 597/1194] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:24:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:24:44.570101 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75dca9-718c-413c-8a47-e70c8ad46956 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:24:44.669809 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75dca9-718c-413c-8a47-e70c8ad46956 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:24:44.701360 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ffacd-83bd-4bd1-a541-da1e09254927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:24:44.702641 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ffacd-83bd-4bd1-a541-da1e09254927 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:44.702919 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ffacd-83bd-4bd1-a541-da1e09254927 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:44.703194 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ffacd-83bd-4bd1-a541-da1e09254927 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:44.713740 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4ffacd-83bd-4bd1-a541-da1e09254927 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:24:44.721364 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-be4ffacd-83bd-4bd1-a541-da1e09254927 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 16:24:44.722551 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 598/1195] 10.222.0.43 () {56 vars in 1096 bytes} [Mon Apr 11 16:24:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:24:44.728634 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4bec53-d1c3-42e4-9a17-a0aac9cf03c7 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:24:44.824850 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4bec53-d1c3-42e4-9a17-a0aac9cf03c7 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:24:44.859854 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5f6387-7308-4117-9b8b-52e04017143e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:24:44.860536 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f6387-7308-4117-9b8b-52e04017143e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:44.860834 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f6387-7308-4117-9b8b-52e04017143e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:44.861098 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f6387-7308-4117-9b8b-52e04017143e None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:44.861866 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5f6387-7308-4117-9b8b-52e04017143e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:24:44.862173 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5f6387-7308-4117-9b8b-52e04017143e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:24:44.863599 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5f6387-7308-4117-9b8b-52e04017143e None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:24:44.873617 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 598/1196] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Apr 11 16:24:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:24:44.879757 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ffacd-83bd-4bd1-a541-da1e09254927 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:24:44.979797 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ffacd-83bd-4bd1-a541-da1e09254927 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:24:45.013292 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01458e3a-567a-4d10-bd94-31c60177c314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:24:45.014157 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01458e3a-567a-4d10-bd94-31c60177c314 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:45.014440 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01458e3a-567a-4d10-bd94-31c60177c314 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:45.015819 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01458e3a-567a-4d10-bd94-31c60177c314 None admin] PATH_INFO: `/v3/users/2f44d5908861460985d67d1a61bf2506` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:45.017025 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01458e3a-567a-4d10-bd94-31c60177c314 None admin] RBAC: Authorizing `identity:get_user(user_id=2f44d5908861460985d67d1a61bf2506)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:24:45.018445 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01458e3a-567a-4d10-bd94-31c60177c314 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:24:45.020089 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 599/1197] 10.222.0.43 () {56 vars in 1177 bytes} [Mon Apr 11 16:24:44 2022] GET /identity/v3/users/2f44d5908861460985d67d1a61bf2506 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:24:45.025906 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5f6387-7308-4117-9b8b-52e04017143e None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:24:45.119876 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5f6387-7308-4117-9b8b-52e04017143e None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:24:45.152319 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec9468e-bc61-4ec8-b37a-78cbe5d080ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:24:45.152969 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec9468e-bc61-4ec8-b37a-78cbe5d080ab None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:45.153255 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec9468e-bc61-4ec8-b37a-78cbe5d080ab None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:45.153536 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec9468e-bc61-4ec8-b37a-78cbe5d080ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:45.216919 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec9468e-bc61-4ec8-b37a-78cbe5d080ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:24:45.218403 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec9468e-bc61-4ec8-b37a-78cbe5d080ab None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:24:45.310442 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 599/1198] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Apr 11 16:24:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 16:24:45.316896 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01458e3a-567a-4d10-bd94-31c60177c314 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:24:45.412712 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01458e3a-567a-4d10-bd94-31c60177c314 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:24:45.445206 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f75652c-f8c2-4fdb-abc3-da95bf0ebeba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:24:45.446061 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f75652c-f8c2-4fdb-abc3-da95bf0ebeba None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:45.446344 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f75652c-f8c2-4fdb-abc3-da95bf0ebeba None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:45.446620 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f75652c-f8c2-4fdb-abc3-da95bf0ebeba None admin] PATH_INFO: `/v3/projects/e0f10ce7339c4b828911cf908f47b462` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:45.447816 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f75652c-f8c2-4fdb-abc3-da95bf0ebeba None admin] RBAC: Authorizing `identity:get_project(project_id=e0f10ce7339c4b828911cf908f47b462)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:24:45.449243 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f75652c-f8c2-4fdb-abc3-da95bf0ebeba None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:24:45.450922 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 600/1199] 10.222.0.43 () {56 vars in 1186 bytes} [Mon Apr 11 16:24:45 2022] GET /identity/v3/projects/e0f10ce7339c4b828911cf908f47b462 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:24:45.457032 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec9468e-bc61-4ec8-b37a-78cbe5d080ab None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:24:45.551139 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec9468e-bc61-4ec8-b37a-78cbe5d080ab None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:24:45.583845 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a9fa68-11a5-437c-ba95-806b8af7a366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:24:45.584427 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a9fa68-11a5-437c-ba95-806b8af7a366 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:24:45.584709 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a9fa68-11a5-437c-ba95-806b8af7a366 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:24:45.584986 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a9fa68-11a5-437c-ba95-806b8af7a366 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:24:45.585810 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a9fa68-11a5-437c-ba95-806b8af7a366 None admin] RBAC: Adding query filter params (role.id=702e5e78b5d744529384b96a390ae92f, scope.project.id=e0f10ce7339c4b828911cf908f47b462, user.id=2f44d5908861460985d67d1a61bf2506) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:24:45.586123 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a9fa68-11a5-437c-ba95-806b8af7a366 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:24:45.587558 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a9fa68-11a5-437c-ba95-806b8af7a366 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:24:45.593075 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 600/1200] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Apr 11 16:24:45 2022] GET /identity/v3/role_assignments?user.id=2f44d5908861460985d67d1a61bf2506&scope.project.id=e0f10ce7339c4b828911cf908f47b462&role.id=702e5e78b5d744529384b96a390ae92f => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:26:12.218871 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c9e82b-e427-4cd4-b40a-f8d802e11ca3 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:12.219484 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c9e82b-e427-4cd4-b40a-f8d802e11ca3 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:12.219484 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c9e82b-e427-4cd4-b40a-f8d802e11ca3 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:12.220809 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 601/1201] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:26:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:26:12.226150 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e6dd8-9efd-4c23-87f4-45e50bd49396 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:12.226587 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e6dd8-9efd-4c23-87f4-45e50bd49396 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:12.226715 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e6dd8-9efd-4c23-87f4-45e50bd49396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:12.243107 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-9b1e6dd8-9efd-4c23-87f4-45e50bd49396 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:26:12.244318 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-9b1e6dd8-9efd-4c23-87f4-45e50bd49396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:26:12.308773 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 601/1202] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:26:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 16:26:12.336383 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c9e82b-e427-4cd4-b40a-f8d802e11ca3 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:12.434091 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c9e82b-e427-4cd4-b40a-f8d802e11ca3 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:12.466788 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a33830f-4356-4872-89a8-3928e3b66975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:12.467618 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a33830f-4356-4872-89a8-3928e3b66975 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:12.467900 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a33830f-4356-4872-89a8-3928e3b66975 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:12.468207 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a33830f-4356-4872-89a8-3928e3b66975 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:12.478339 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a33830f-4356-4872-89a8-3928e3b66975 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:26:12.479802 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a33830f-4356-4872-89a8-3928e3b66975 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:26:12.496687 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-2a33830f-4356-4872-89a8-3928e3b66975 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:26:12.497854 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 602/1203] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:26:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:26:12.504660 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1e6dd8-9efd-4c23-87f4-45e50bd49396 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:12.623083 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1e6dd8-9efd-4c23-87f4-45e50bd49396 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:12.656089 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0907d779-ffa4-4ce0-bcf3-3a53de506082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:12.656756 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0907d779-ffa4-4ce0-bcf3-3a53de506082 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:12.657032 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0907d779-ffa4-4ce0-bcf3-3a53de506082 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:12.657305 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0907d779-ffa4-4ce0-bcf3-3a53de506082 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:12.658016 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0907d779-ffa4-4ce0-bcf3-3a53de506082 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:26:12.658321 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0907d779-ffa4-4ce0-bcf3-3a53de506082 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:26:12.660241 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0907d779-ffa4-4ce0-bcf3-3a53de506082 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:26:12.671142 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 602/1204] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Apr 11 16:26:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:26:12.677191 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a33830f-4356-4872-89a8-3928e3b66975 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:12.771999 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a33830f-4356-4872-89a8-3928e3b66975 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:12.803880 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bb651c-7f75-455b-a004-b624f42547a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:12.804559 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb651c-7f75-455b-a004-b624f42547a5 None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:12.804844 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb651c-7f75-455b-a004-b624f42547a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:12.805117 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb651c-7f75-455b-a004-b624f42547a5 None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:12.805815 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bb651c-7f75-455b-a004-b624f42547a5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:26:12.807224 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bb651c-7f75-455b-a004-b624f42547a5 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:26:12.925990 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 603/1205] 10.222.0.43 () {60 vars in 1132 bytes} [Mon Apr 11 16:26:12 2022] POST /identity/v3/users => generated 251 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:26:15.267229 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4639065e-84e1-4600-beb3-49ec48fb3113 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:15.267863 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4639065e-84e1-4600-beb3-49ec48fb3113 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:15.267863 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4639065e-84e1-4600-beb3-49ec48fb3113 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:15.269201 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 603/1206] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:26:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:26:15.274459 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a75dc-a842-440a-9cac-aa1d47f6e416 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:15.274895 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a75dc-a842-440a-9cac-aa1d47f6e416 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:15.275023 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a75dc-a842-440a-9cac-aa1d47f6e416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:15.292321 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-169a75dc-a842-440a-9cac-aa1d47f6e416 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:26:15.293495 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-169a75dc-a842-440a-9cac-aa1d47f6e416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:26:15.358167 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 604/1207] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:26:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:26:15.382963 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4639065e-84e1-4600-beb3-49ec48fb3113 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:15.480559 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4639065e-84e1-4600-beb3-49ec48fb3113 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:15.513036 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c4171-1ac7-4ac7-8d59-dc10d90d925c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:15.513831 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c4171-1ac7-4ac7-8d59-dc10d90d925c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:15.514113 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c4171-1ac7-4ac7-8d59-dc10d90d925c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:15.514390 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c4171-1ac7-4ac7-8d59-dc10d90d925c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:15.524915 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4c4171-1ac7-4ac7-8d59-dc10d90d925c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:26:15.532148 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-ed4c4171-1ac7-4ac7-8d59-dc10d90d925c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 16:26:15.533320 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 604/1208] 10.222.0.43 () {56 vars in 1102 bytes} [Mon Apr 11 16:26:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:26:15.540034 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169a75dc-a842-440a-9cac-aa1d47f6e416 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:15.631667 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169a75dc-a842-440a-9cac-aa1d47f6e416 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:15.664062 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7fd41c-6e11-45c4-8d86-f6eb96ce14ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:15.664721 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7fd41c-6e11-45c4-8d86-f6eb96ce14ee None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:15.664999 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7fd41c-6e11-45c4-8d86-f6eb96ce14ee None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:15.665278 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7fd41c-6e11-45c4-8d86-f6eb96ce14ee None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:15.666089 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7fd41c-6e11-45c4-8d86-f6eb96ce14ee None admin] RBAC: Adding query filter params (name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:26:15.666392 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7fd41c-6e11-45c4-8d86-f6eb96ce14ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:26:15.667749 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7fd41c-6e11-45c4-8d86-f6eb96ce14ee None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:26:15.675351 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 605/1209] 10.222.0.43 () {56 vars in 1103 bytes} [Mon Apr 11 16:26:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:26:15.681439 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c4171-1ac7-4ac7-8d59-dc10d90d925c None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:15.775966 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c4171-1ac7-4ac7-8d59-dc10d90d925c None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:15.807641 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1a8262-fefa-4083-8ade-27bcd7f77b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:15.808427 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a8262-fefa-4083-8ade-27bcd7f77b29 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:15.808713 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a8262-fefa-4083-8ade-27bcd7f77b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:15.808992 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a8262-fefa-4083-8ade-27bcd7f77b29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:15.819354 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1a8262-fefa-4083-8ade-27bcd7f77b29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:26:15.820926 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1a8262-fefa-4083-8ade-27bcd7f77b29 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:26:15.837218 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-3a1a8262-fefa-4083-8ade-27bcd7f77b29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:26:15.838379 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 605/1210] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:26:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:26:15.844222 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7fd41c-6e11-45c4-8d86-f6eb96ce14ee None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:15.939659 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7fd41c-6e11-45c4-8d86-f6eb96ce14ee None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:15.973914 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c645b90e-a079-4441-9f24-83a8fd970299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:15.974586 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645b90e-a079-4441-9f24-83a8fd970299 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:15.974876 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645b90e-a079-4441-9f24-83a8fd970299 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:15.975157 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645b90e-a079-4441-9f24-83a8fd970299 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:15.975912 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c645b90e-a079-4441-9f24-83a8fd970299 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:26:15.976224 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c645b90e-a079-4441-9f24-83a8fd970299 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:26:15.977575 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c645b90e-a079-4441-9f24-83a8fd970299 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:26:15.989085 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 606/1211] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Apr 11 16:26:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:26:15.994925 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1a8262-fefa-4083-8ade-27bcd7f77b29 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:16.092599 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1a8262-fefa-4083-8ade-27bcd7f77b29 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:16.124298 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f6edd0-fed8-4ef7-ab51-efac6e80f90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:16.125086 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6edd0-fed8-4ef7-ab51-efac6e80f90f None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:16.125370 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6edd0-fed8-4ef7-ab51-efac6e80f90f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:16.125644 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6edd0-fed8-4ef7-ab51-efac6e80f90f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:16.133868 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f6edd0-fed8-4ef7-ab51-efac6e80f90f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:26:16.136084 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f6edd0-fed8-4ef7-ab51-efac6e80f90f None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:26:16.149318 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-43f6edd0-fed8-4ef7-ab51-efac6e80f90f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 11 16:26:16.150482 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 606/1212] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:26:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:26:16.156561 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c645b90e-a079-4441-9f24-83a8fd970299 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:16.251915 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c645b90e-a079-4441-9f24-83a8fd970299 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:16.284501 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd0310-c0b0-4e75-8c2f-3623cdb86c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:16.285195 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd0310-c0b0-4e75-8c2f-3623cdb86c8b None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:16.285550 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd0310-c0b0-4e75-8c2f-3623cdb86c8b None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:16.285823 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd0310-c0b0-4e75-8c2f-3623cdb86c8b None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:16.286654 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fd0310-c0b0-4e75-8c2f-3623cdb86c8b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:26:16.286966 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fd0310-c0b0-4e75-8c2f-3623cdb86c8b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:26:16.288417 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fd0310-c0b0-4e75-8c2f-3623cdb86c8b None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:26:16.306077 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 607/1213] 10.222.0.43 () {56 vars in 1143 bytes} [Mon Apr 11 16:26:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:26:16.312067 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f6edd0-fed8-4ef7-ab51-efac6e80f90f None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:16.408939 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f6edd0-fed8-4ef7-ab51-efac6e80f90f None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:16.441582 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b4eca4-f3b2-45c4-b0f7-746a3028391e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:16.442846 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4eca4-f3b2-45c4-b0f7-746a3028391e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:16.443125 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4eca4-f3b2-45c4-b0f7-746a3028391e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:16.443400 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4eca4-f3b2-45c4-b0f7-746a3028391e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:16.511135 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b4eca4-f3b2-45c4-b0f7-746a3028391e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:26:16.512609 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b4eca4-f3b2-45c4-b0f7-746a3028391e None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:26:16.605831 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 607/1214] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Apr 11 16:26:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 11 16:26:16.611647 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd0310-c0b0-4e75-8c2f-3623cdb86c8b None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:16.716651 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd0310-c0b0-4e75-8c2f-3623cdb86c8b None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:16.749280 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941c4e66-42ae-4a04-980a-f1aa8aa90727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:16.751781 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c4e66-42ae-4a04-980a-f1aa8aa90727 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:16.751781 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c4e66-42ae-4a04-980a-f1aa8aa90727 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:16.751781 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c4e66-42ae-4a04-980a-f1aa8aa90727 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:16.760924 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941c4e66-42ae-4a04-980a-f1aa8aa90727 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:26:16.762351 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941c4e66-42ae-4a04-980a-f1aa8aa90727 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:26:16.779328 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-941c4e66-42ae-4a04-980a-f1aa8aa90727 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:26:16.780513 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 608/1215] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:26:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:26:16.786679 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b4eca4-f3b2-45c4-b0f7-746a3028391e None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:16.880259 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b4eca4-f3b2-45c4-b0f7-746a3028391e None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:16.917533 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc5dc0e-e5b6-4e4d-98b4-8d227c11a478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:16.919772 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc5dc0e-e5b6-4e4d-98b4-8d227c11a478 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:16.920068 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc5dc0e-e5b6-4e4d-98b4-8d227c11a478 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:16.920346 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc5dc0e-e5b6-4e4d-98b4-8d227c11a478 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:16.921087 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc5dc0e-e5b6-4e4d-98b4-8d227c11a478 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:26:16.921399 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc5dc0e-e5b6-4e4d-98b4-8d227c11a478 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:26:16.922766 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc5dc0e-e5b6-4e4d-98b4-8d227c11a478 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:26:16.937287 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 608/1216] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Apr 11 16:26:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:26:16.943751 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941c4e66-42ae-4a04-980a-f1aa8aa90727 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:17.042466 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941c4e66-42ae-4a04-980a-f1aa8aa90727 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:17.075113 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf83305f-baf3-4a73-82be-ad3a751b39d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:17.075923 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf83305f-baf3-4a73-82be-ad3a751b39d3 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:17.076199 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf83305f-baf3-4a73-82be-ad3a751b39d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:17.076470 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf83305f-baf3-4a73-82be-ad3a751b39d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:17.082908 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf83305f-baf3-4a73-82be-ad3a751b39d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:26:17.084405 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf83305f-baf3-4a73-82be-ad3a751b39d3 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:26:17.097516 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-cf83305f-baf3-4a73-82be-ad3a751b39d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 16:26:17.098783 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 609/1217] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Apr 11 16:26:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:26:17.104894 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc5dc0e-e5b6-4e4d-98b4-8d227c11a478 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:17.200012 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc5dc0e-e5b6-4e4d-98b4-8d227c11a478 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:17.231526 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8111c9-b7fd-49b9-80eb-06d6eb957a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:17.232220 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8111c9-b7fd-49b9-80eb-06d6eb957a67 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:17.232541 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8111c9-b7fd-49b9-80eb-06d6eb957a67 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:17.232825 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8111c9-b7fd-49b9-80eb-06d6eb957a67 None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:17.233618 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8111c9-b7fd-49b9-80eb-06d6eb957a67 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:26:17.233933 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8111c9-b7fd-49b9-80eb-06d6eb957a67 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:26:17.235362 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8111c9-b7fd-49b9-80eb-06d6eb957a67 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:26:17.248976 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 609/1218] 10.222.0.43 () {56 vars in 1148 bytes} [Mon Apr 11 16:26:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:26:17.255144 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf83305f-baf3-4a73-82be-ad3a751b39d3 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:17.359384 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf83305f-baf3-4a73-82be-ad3a751b39d3 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:17.391850 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3165e393-aa10-4013-a501-89a12b74a8de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:17.392497 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165e393-aa10-4013-a501-89a12b74a8de None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:17.392777 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165e393-aa10-4013-a501-89a12b74a8de None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:17.393051 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165e393-aa10-4013-a501-89a12b74a8de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:17.393878 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3165e393-aa10-4013-a501-89a12b74a8de None admin] RBAC: Adding query filter params (role.id=de92d251e74f470e95b6df12ece586b8, scope.project.id=477b9d41390e455a82e733c4fc6acd6b, user.id=6589debd41bf496085c7339ab5409666) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:26:17.394189 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3165e393-aa10-4013-a501-89a12b74a8de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:26:17.395692 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3165e393-aa10-4013-a501-89a12b74a8de None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:26:17.400842 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 610/1219] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Apr 11 16:26:17 2022] GET /identity/v3/role_assignments?user.id=6589debd41bf496085c7339ab5409666&scope.project.id=477b9d41390e455a82e733c4fc6acd6b&role.id=de92d251e74f470e95b6df12ece586b8 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:26:19.736656 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da0f7a-6ac3-4f3b-8400-fbe027e89b59 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:19.737175 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da0f7a-6ac3-4f3b-8400-fbe027e89b59 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:19.737175 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da0f7a-6ac3-4f3b-8400-fbe027e89b59 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:19.738532 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 610/1220] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:26:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:26:19.745044 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23fa0b9-5b3b-4f09-85f2-392837a19de1 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:19.754974 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23fa0b9-5b3b-4f09-85f2-392837a19de1 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:19.754974 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23fa0b9-5b3b-4f09-85f2-392837a19de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:19.762123 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-e23fa0b9-5b3b-4f09-85f2-392837a19de1 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:26:19.763303 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-e23fa0b9-5b3b-4f09-85f2-392837a19de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:26:19.827108 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 611/1221] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:26:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:26:19.849748 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49da0f7a-6ac3-4f3b-8400-fbe027e89b59 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:19.947180 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49da0f7a-6ac3-4f3b-8400-fbe027e89b59 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:19.979832 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c1464a-3861-4b04-929f-9b12b7ea2ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:19.980618 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c1464a-3861-4b04-929f-9b12b7ea2ff9 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:19.980903 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c1464a-3861-4b04-929f-9b12b7ea2ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:19.981205 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c1464a-3861-4b04-929f-9b12b7ea2ff9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:19.990792 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c1464a-3861-4b04-929f-9b12b7ea2ff9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:26:19.997874 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-80c1464a-3861-4b04-929f-9b12b7ea2ff9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 16:26:20.001316 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 611/1222] 10.222.0.43 () {56 vars in 1102 bytes} [Mon Apr 11 16:26:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:26:20.006980 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23fa0b9-5b3b-4f09-85f2-392837a19de1 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:20.106426 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23fa0b9-5b3b-4f09-85f2-392837a19de1 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:20.137950 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168b4fce-faba-4258-98e6-33a6245b72d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:20.138615 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b4fce-faba-4258-98e6-33a6245b72d0 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:20.138899 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b4fce-faba-4258-98e6-33a6245b72d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:20.139173 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b4fce-faba-4258-98e6-33a6245b72d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:20.139942 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168b4fce-faba-4258-98e6-33a6245b72d0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:26:20.140250 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168b4fce-faba-4258-98e6-33a6245b72d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:26:20.141607 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168b4fce-faba-4258-98e6-33a6245b72d0 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:26:20.150225 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 612/1223] 10.222.0.43 () {56 vars in 1103 bytes} [Mon Apr 11 16:26:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:26:20.156009 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c1464a-3861-4b04-929f-9b12b7ea2ff9 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:20.249882 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c1464a-3861-4b04-929f-9b12b7ea2ff9 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:20.282060 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d00ab5e-0a50-402b-9e68-52b35d3fffcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:20.282870 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d00ab5e-0a50-402b-9e68-52b35d3fffcf None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:20.283160 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d00ab5e-0a50-402b-9e68-52b35d3fffcf None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:20.283439 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d00ab5e-0a50-402b-9e68-52b35d3fffcf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:20.294569 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d00ab5e-0a50-402b-9e68-52b35d3fffcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:26:20.296032 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d00ab5e-0a50-402b-9e68-52b35d3fffcf None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:26:20.312616 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-6d00ab5e-0a50-402b-9e68-52b35d3fffcf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:26:20.319215 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 612/1224] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:26:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:26:20.320098 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168b4fce-faba-4258-98e6-33a6245b72d0 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:20.415591 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168b4fce-faba-4258-98e6-33a6245b72d0 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:20.448167 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d09963-54e5-449a-ad4c-c257cec7ee05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:20.448828 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d09963-54e5-449a-ad4c-c257cec7ee05 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:20.449110 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d09963-54e5-449a-ad4c-c257cec7ee05 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:20.449384 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d09963-54e5-449a-ad4c-c257cec7ee05 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:20.450098 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d09963-54e5-449a-ad4c-c257cec7ee05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:26:20.450402 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d09963-54e5-449a-ad4c-c257cec7ee05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:26:20.451771 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d09963-54e5-449a-ad4c-c257cec7ee05 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:26:20.463478 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 613/1225] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Apr 11 16:26:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:26:20.469136 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d00ab5e-0a50-402b-9e68-52b35d3fffcf None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:20.563506 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d00ab5e-0a50-402b-9e68-52b35d3fffcf None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:20.596752 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c428668e-2109-4b6d-beaf-0e8e5f7f6c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:20.610737 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428668e-2109-4b6d-beaf-0e8e5f7f6c36 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:20.610737 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428668e-2109-4b6d-beaf-0e8e5f7f6c36 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:20.610737 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428668e-2109-4b6d-beaf-0e8e5f7f6c36 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:20.610737 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c428668e-2109-4b6d-beaf-0e8e5f7f6c36 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:26:20.610737 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c428668e-2109-4b6d-beaf-0e8e5f7f6c36 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:26:20.620277 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-c428668e-2109-4b6d-beaf-0e8e5f7f6c36 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 11 16:26:20.621508 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 613/1226] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:26:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:26:20.627375 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d09963-54e5-449a-ad4c-c257cec7ee05 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:20.733674 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d09963-54e5-449a-ad4c-c257cec7ee05 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:20.767628 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f969b51a-d34f-4ccf-8b12-78f7169d1b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:20.768289 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969b51a-d34f-4ccf-8b12-78f7169d1b85 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:20.768563 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969b51a-d34f-4ccf-8b12-78f7169d1b85 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:20.768844 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969b51a-d34f-4ccf-8b12-78f7169d1b85 None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:20.769678 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f969b51a-d34f-4ccf-8b12-78f7169d1b85 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:26:20.769989 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f969b51a-d34f-4ccf-8b12-78f7169d1b85 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:26:20.771407 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f969b51a-d34f-4ccf-8b12-78f7169d1b85 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:26:20.788120 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 614/1227] 10.222.0.43 () {56 vars in 1143 bytes} [Mon Apr 11 16:26:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:26:20.793742 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c428668e-2109-4b6d-beaf-0e8e5f7f6c36 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:20.888384 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c428668e-2109-4b6d-beaf-0e8e5f7f6c36 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:20.919866 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4907d3b-a03e-482b-81f8-db75674ebd32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:20.920656 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4907d3b-a03e-482b-81f8-db75674ebd32 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:20.920943 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4907d3b-a03e-482b-81f8-db75674ebd32 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:20.921223 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4907d3b-a03e-482b-81f8-db75674ebd32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:20.932216 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4907d3b-a03e-482b-81f8-db75674ebd32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:26:20.933697 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4907d3b-a03e-482b-81f8-db75674ebd32 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:26:20.950712 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-d4907d3b-a03e-482b-81f8-db75674ebd32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:26:20.951911 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 614/1228] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:26:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:26:20.957597 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f969b51a-d34f-4ccf-8b12-78f7169d1b85 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:21.055343 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f969b51a-d34f-4ccf-8b12-78f7169d1b85 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:21.087673 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58d15de-4a8b-41f1-8534-c45447836e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:21.088395 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d15de-4a8b-41f1-8534-c45447836e58 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:21.088675 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d15de-4a8b-41f1-8534-c45447836e58 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:21.088951 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d15de-4a8b-41f1-8534-c45447836e58 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:21.089731 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58d15de-4a8b-41f1-8534-c45447836e58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:26:21.090037 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58d15de-4a8b-41f1-8534-c45447836e58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:26:21.091396 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58d15de-4a8b-41f1-8534-c45447836e58 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:26:21.102742 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 615/1229] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Apr 11 16:26:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:26:21.108405 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4907d3b-a03e-482b-81f8-db75674ebd32 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:21.204261 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4907d3b-a03e-482b-81f8-db75674ebd32 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:21.236856 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e5b296-d7f3-44ff-b19f-cc6ebc92d526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:21.237646 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e5b296-d7f3-44ff-b19f-cc6ebc92d526 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:21.237926 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e5b296-d7f3-44ff-b19f-cc6ebc92d526 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:21.238197 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e5b296-d7f3-44ff-b19f-cc6ebc92d526 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:21.245212 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e5b296-d7f3-44ff-b19f-cc6ebc92d526 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:26:21.246624 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e5b296-d7f3-44ff-b19f-cc6ebc92d526 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:26:21.259719 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-79e5b296-d7f3-44ff-b19f-cc6ebc92d526 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 16:26:21.260867 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 615/1230] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Apr 11 16:26:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:26:21.266737 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58d15de-4a8b-41f1-8534-c45447836e58 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:21.362631 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58d15de-4a8b-41f1-8534-c45447836e58 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:21.394879 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c396fd18-dc7f-4648-833b-7575b333cb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:21.395725 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396fd18-dc7f-4648-833b-7575b333cb13 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:21.396010 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396fd18-dc7f-4648-833b-7575b333cb13 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:21.396285 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396fd18-dc7f-4648-833b-7575b333cb13 None admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:21.397677 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c396fd18-dc7f-4648-833b-7575b333cb13 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:26:21.397995 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c396fd18-dc7f-4648-833b-7575b333cb13 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:26:21.399452 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c396fd18-dc7f-4648-833b-7575b333cb13 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:26:21.412459 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 616/1231] 10.222.0.43 () {56 vars in 1148 bytes} [Mon Apr 11 16:26:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:26:21.419042 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e5b296-d7f3-44ff-b19f-cc6ebc92d526 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:21.513550 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e5b296-d7f3-44ff-b19f-cc6ebc92d526 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:21.547086 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0800f2-52a8-44e7-b685-d227c1cc2db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:21.548031 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0800f2-52a8-44e7-b685-d227c1cc2db0 None admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:21.548319 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0800f2-52a8-44e7-b685-d227c1cc2db0 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:21.548619 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0800f2-52a8-44e7-b685-d227c1cc2db0 None admin] PATH_INFO: `/v3/projects/477b9d41390e455a82e733c4fc6acd6b/users/6589debd41bf496085c7339ab5409666/roles/de92d251e74f470e95b6df12ece586b8` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:21.562093 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0800f2-52a8-44e7-b685-d227c1cc2db0 None admin] RBAC: Authorizing `identity:create_grant(project_id=477b9d41390e455a82e733c4fc6acd6b, user_id=6589debd41bf496085c7339ab5409666, role_id=de92d251e74f470e95b6df12ece586b8)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:26:21.563542 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0800f2-52a8-44e7-b685-d227c1cc2db0 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:26:21.740338 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 616/1232] 10.222.0.43 () {58 vars in 1439 bytes} [Mon Apr 11 16:26:21 2022] PUT /identity/v3/projects/477b9d41390e455a82e733c4fc6acd6b/users/6589debd41bf496085c7339ab5409666/roles/de92d251e74f470e95b6df12ece586b8 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:26:24.021286 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928d4b0-cd57-4c72-aafb-63605bec878c None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:24.021878 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928d4b0-cd57-4c72-aafb-63605bec878c None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:24.021878 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928d4b0-cd57-4c72-aafb-63605bec878c None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:24.023270 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 617/1233] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:26:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 16:26:24.028364 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ecb532-281a-4965-8542-bbd192d44350 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:24.028772 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ecb532-281a-4965-8542-bbd192d44350 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:24.028917 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ecb532-281a-4965-8542-bbd192d44350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:24.046040 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-b3ecb532-281a-4965-8542-bbd192d44350 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:26:24.047280 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b3ecb532-281a-4965-8542-bbd192d44350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:26:24.109910 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 617/1234] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:26:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:26:24.134966 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6928d4b0-cd57-4c72-aafb-63605bec878c None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:24.232477 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6928d4b0-cd57-4c72-aafb-63605bec878c None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:24.266437 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104f180c-2889-42fe-bfc8-eb3e095ec27b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:24.267242 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f180c-2889-42fe-bfc8-eb3e095ec27b None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:24.267609 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f180c-2889-42fe-bfc8-eb3e095ec27b None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:24.267930 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f180c-2889-42fe-bfc8-eb3e095ec27b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:24.277986 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104f180c-2889-42fe-bfc8-eb3e095ec27b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:26:24.285299 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-104f180c-2889-42fe-bfc8-eb3e095ec27b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 16:26:24.286451 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 618/1235] 10.222.0.43 () {56 vars in 1102 bytes} [Mon Apr 11 16:26:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:26:24.293127 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ecb532-281a-4965-8542-bbd192d44350 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:24.388361 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ecb532-281a-4965-8542-bbd192d44350 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:24.421645 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa1210c-70c0-4b61-9cf2-516931306556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:24.422315 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1210c-70c0-4b61-9cf2-516931306556 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:24.422602 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1210c-70c0-4b61-9cf2-516931306556 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:24.422878 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1210c-70c0-4b61-9cf2-516931306556 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:24.423649 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa1210c-70c0-4b61-9cf2-516931306556 None admin] RBAC: Adding query filter params (name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:26:24.423958 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa1210c-70c0-4b61-9cf2-516931306556 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:26:24.425321 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa1210c-70c0-4b61-9cf2-516931306556 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:26:24.433075 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 618/1236] 10.222.0.43 () {56 vars in 1103 bytes} [Mon Apr 11 16:26:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:26:24.439332 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104f180c-2889-42fe-bfc8-eb3e095ec27b None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:24.553769 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104f180c-2889-42fe-bfc8-eb3e095ec27b None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:24.588105 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a156db03-0494-4a84-a80b-ba579cc920c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:24.588969 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156db03-0494-4a84-a80b-ba579cc920c8 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:24.589249 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156db03-0494-4a84-a80b-ba579cc920c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:24.589564 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156db03-0494-4a84-a80b-ba579cc920c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:24.600279 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a156db03-0494-4a84-a80b-ba579cc920c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:26:24.602405 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a156db03-0494-4a84-a80b-ba579cc920c8 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:26:24.618079 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-a156db03-0494-4a84-a80b-ba579cc920c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:26:24.619246 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 619/1237] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:26:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:26:24.625038 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa1210c-70c0-4b61-9cf2-516931306556 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:24.721801 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa1210c-70c0-4b61-9cf2-516931306556 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:24.754194 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32620eb2-94c2-424d-8141-40719ec0978f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:24.754851 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32620eb2-94c2-424d-8141-40719ec0978f None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:24.755130 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32620eb2-94c2-424d-8141-40719ec0978f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:24.755401 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32620eb2-94c2-424d-8141-40719ec0978f None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:24.756144 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32620eb2-94c2-424d-8141-40719ec0978f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:26:24.756455 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32620eb2-94c2-424d-8141-40719ec0978f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:26:24.757842 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32620eb2-94c2-424d-8141-40719ec0978f None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:26:24.769622 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 619/1238] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Apr 11 16:26:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:26:24.776195 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a156db03-0494-4a84-a80b-ba579cc920c8 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:24.875646 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a156db03-0494-4a84-a80b-ba579cc920c8 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:24.909761 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bb1590-fd4a-49cf-9ddc-90e3697d0a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:24.910850 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb1590-fd4a-49cf-9ddc-90e3697d0a64 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:24.911132 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb1590-fd4a-49cf-9ddc-90e3697d0a64 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:24.911408 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb1590-fd4a-49cf-9ddc-90e3697d0a64 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:24.918903 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bb1590-fd4a-49cf-9ddc-90e3697d0a64 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:26:24.920359 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bb1590-fd4a-49cf-9ddc-90e3697d0a64 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:26:24.933792 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-80bb1590-fd4a-49cf-9ddc-90e3697d0a64 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 11 16:26:24.935007 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 620/1239] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:26:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:26:24.940977 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32620eb2-94c2-424d-8141-40719ec0978f None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:25.046217 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32620eb2-94c2-424d-8141-40719ec0978f None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:25.078958 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180fe2e9-27c5-4902-9724-b09c63bd1de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:25.079653 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180fe2e9-27c5-4902-9724-b09c63bd1de5 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:25.079941 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180fe2e9-27c5-4902-9724-b09c63bd1de5 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:25.080216 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180fe2e9-27c5-4902-9724-b09c63bd1de5 None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:25.081051 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180fe2e9-27c5-4902-9724-b09c63bd1de5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:26:25.081355 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180fe2e9-27c5-4902-9724-b09c63bd1de5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:26:25.082763 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180fe2e9-27c5-4902-9724-b09c63bd1de5 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:26:25.099977 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 620/1240] 10.222.0.43 () {56 vars in 1143 bytes} [Mon Apr 11 16:26:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:26:25.106515 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bb1590-fd4a-49cf-9ddc-90e3697d0a64 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:25.202997 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bb1590-fd4a-49cf-9ddc-90e3697d0a64 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:25.234371 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc16ba26-6bf7-4172-a2f1-7c1ad86e0801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:25.235010 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc16ba26-6bf7-4172-a2f1-7c1ad86e0801 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:25.235291 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc16ba26-6bf7-4172-a2f1-7c1ad86e0801 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:25.235588 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc16ba26-6bf7-4172-a2f1-7c1ad86e0801 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:25.301890 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc16ba26-6bf7-4172-a2f1-7c1ad86e0801 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:26:25.303335 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc16ba26-6bf7-4172-a2f1-7c1ad86e0801 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:26:25.407634 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 621/1241] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Apr 11 16:26:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 16:26:25.413804 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180fe2e9-27c5-4902-9724-b09c63bd1de5 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:25.510640 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180fe2e9-27c5-4902-9724-b09c63bd1de5 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:25.544264 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228b52f8-f416-4143-9193-60b92b32d52e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:25.545051 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b52f8-f416-4143-9193-60b92b32d52e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:25.545336 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b52f8-f416-4143-9193-60b92b32d52e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:25.545632 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b52f8-f416-4143-9193-60b92b32d52e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:25.555694 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228b52f8-f416-4143-9193-60b92b32d52e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:26:25.557105 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228b52f8-f416-4143-9193-60b92b32d52e None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:26:25.573662 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-228b52f8-f416-4143-9193-60b92b32d52e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:26:25.574849 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 621/1242] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:26:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:26:25.580717 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc16ba26-6bf7-4172-a2f1-7c1ad86e0801 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:25.690762 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc16ba26-6bf7-4172-a2f1-7c1ad86e0801 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:25.722878 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906a8bb6-c1df-4696-b9fc-55e74a329708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:25.723616 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a8bb6-c1df-4696-b9fc-55e74a329708 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:25.723855 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a8bb6-c1df-4696-b9fc-55e74a329708 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:25.724129 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a8bb6-c1df-4696-b9fc-55e74a329708 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:25.724877 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906a8bb6-c1df-4696-b9fc-55e74a329708 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:26:25.725181 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906a8bb6-c1df-4696-b9fc-55e74a329708 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:26:25.727082 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906a8bb6-c1df-4696-b9fc-55e74a329708 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:26:25.738183 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 622/1243] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Apr 11 16:26:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:26:25.744355 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228b52f8-f416-4143-9193-60b92b32d52e None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:25.838211 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228b52f8-f416-4143-9193-60b92b32d52e None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:25.874197 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b869ec-423b-4a5e-8003-24006766a124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:25.874990 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b869ec-423b-4a5e-8003-24006766a124 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:25.875276 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b869ec-423b-4a5e-8003-24006766a124 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:25.875580 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b869ec-423b-4a5e-8003-24006766a124 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:25.881991 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b869ec-423b-4a5e-8003-24006766a124 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:26:25.883452 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b869ec-423b-4a5e-8003-24006766a124 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:26:25.896194 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-91b869ec-423b-4a5e-8003-24006766a124 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 16:26:25.897353 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 622/1244] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Apr 11 16:26:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:26:25.903901 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906a8bb6-c1df-4696-b9fc-55e74a329708 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:26.000600 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906a8bb6-c1df-4696-b9fc-55e74a329708 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:26.047484 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3192e064-f778-4150-9f40-352aefdbb6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:26.048182 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192e064-f778-4150-9f40-352aefdbb6b6 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:26.049406 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192e064-f778-4150-9f40-352aefdbb6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:26.049406 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192e064-f778-4150-9f40-352aefdbb6b6 None admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:26.049590 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3192e064-f778-4150-9f40-352aefdbb6b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:26:26.049891 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3192e064-f778-4150-9f40-352aefdbb6b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:26:26.051310 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3192e064-f778-4150-9f40-352aefdbb6b6 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:26:26.063817 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 623/1245] 10.222.0.43 () {56 vars in 1148 bytes} [Mon Apr 11 16:26:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:26:26.069978 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b869ec-423b-4a5e-8003-24006766a124 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:26.166495 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b869ec-423b-4a5e-8003-24006766a124 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:26.198144 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d301f2-d821-42d3-9170-d56e7a595bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:26.203598 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d301f2-d821-42d3-9170-d56e7a595bb2 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:26.203598 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d301f2-d821-42d3-9170-d56e7a595bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:26.203598 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d301f2-d821-42d3-9170-d56e7a595bb2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:26.203598 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d301f2-d821-42d3-9170-d56e7a595bb2 None admin] RBAC: Adding query filter params (role.id=de92d251e74f470e95b6df12ece586b8, scope.project.id=477b9d41390e455a82e733c4fc6acd6b, user.id=6589debd41bf496085c7339ab5409666) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:26:26.203598 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d301f2-d821-42d3-9170-d56e7a595bb2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:26:26.203598 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d301f2-d821-42d3-9170-d56e7a595bb2 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:26:26.207492 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 623/1246] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Apr 11 16:26:26 2022] GET /identity/v3/role_assignments?user.id=6589debd41bf496085c7339ab5409666&scope.project.id=477b9d41390e455a82e733c4fc6acd6b&role.id=de92d251e74f470e95b6df12ece586b8 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:26:28.625818 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d32d5ef-8b33-49e1-8464-9adbf2398059 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:28.626369 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d32d5ef-8b33-49e1-8464-9adbf2398059 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:28.626369 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d32d5ef-8b33-49e1-8464-9adbf2398059 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:28.627777 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 624/1247] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:26:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:26:28.632884 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef86a80-b522-4047-9137-d2130340639b None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:28.633280 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef86a80-b522-4047-9137-d2130340639b None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:28.633450 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef86a80-b522-4047-9137-d2130340639b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:28.649897 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-6ef86a80-b522-4047-9137-d2130340639b None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:26:28.651090 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-6ef86a80-b522-4047-9137-d2130340639b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:26:28.720939 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 624/1248] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:26:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:26:28.746657 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d32d5ef-8b33-49e1-8464-9adbf2398059 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:28.866461 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d32d5ef-8b33-49e1-8464-9adbf2398059 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:28.899002 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af1e7ca-4378-4999-bc16-6f73cc4012a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:28.900332 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af1e7ca-4378-4999-bc16-6f73cc4012a6 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:28.900651 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af1e7ca-4378-4999-bc16-6f73cc4012a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:28.901035 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af1e7ca-4378-4999-bc16-6f73cc4012a6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:28.910922 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af1e7ca-4378-4999-bc16-6f73cc4012a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:26:28.918732 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-3af1e7ca-4378-4999-bc16-6f73cc4012a6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 16:26:28.919937 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 625/1249] 10.222.0.43 () {56 vars in 1096 bytes} [Mon Apr 11 16:26:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:26:28.925976 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef86a80-b522-4047-9137-d2130340639b None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:29.030027 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef86a80-b522-4047-9137-d2130340639b None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:29.064592 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343b5fc6-adb1-4e02-b6ca-021beef4020f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:29.065253 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b5fc6-adb1-4e02-b6ca-021beef4020f None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:29.065534 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b5fc6-adb1-4e02-b6ca-021beef4020f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:29.065808 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b5fc6-adb1-4e02-b6ca-021beef4020f None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:29.066546 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343b5fc6-adb1-4e02-b6ca-021beef4020f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:26:29.066851 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343b5fc6-adb1-4e02-b6ca-021beef4020f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:26:29.068228 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343b5fc6-adb1-4e02-b6ca-021beef4020f None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:26:29.076079 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 625/1250] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Apr 11 16:26:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:26:29.081881 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af1e7ca-4378-4999-bc16-6f73cc4012a6 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:29.179170 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af1e7ca-4378-4999-bc16-6f73cc4012a6 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:29.212048 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d1e2c9-b1b3-4556-9314-c3ee86707044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:29.212884 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d1e2c9-b1b3-4556-9314-c3ee86707044 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:29.213169 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d1e2c9-b1b3-4556-9314-c3ee86707044 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:29.213447 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d1e2c9-b1b3-4556-9314-c3ee86707044 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:29.223645 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d1e2c9-b1b3-4556-9314-c3ee86707044 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:26:29.225074 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d1e2c9-b1b3-4556-9314-c3ee86707044 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:26:29.241151 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-24d1e2c9-b1b3-4556-9314-c3ee86707044 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:26:29.242354 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 626/1251] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:26:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:26:29.248979 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343b5fc6-adb1-4e02-b6ca-021beef4020f None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:29.349115 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343b5fc6-adb1-4e02-b6ca-021beef4020f None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:29.381349 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfc58c1-044a-481c-9d8d-80c945c71f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:29.382036 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc58c1-044a-481c-9d8d-80c945c71f83 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:29.382318 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc58c1-044a-481c-9d8d-80c945c71f83 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:29.382592 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc58c1-044a-481c-9d8d-80c945c71f83 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:29.383303 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfc58c1-044a-481c-9d8d-80c945c71f83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:26:29.383638 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfc58c1-044a-481c-9d8d-80c945c71f83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:26:29.385151 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfc58c1-044a-481c-9d8d-80c945c71f83 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:26:29.397740 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 626/1252] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Apr 11 16:26:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:26:29.402309 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d1e2c9-b1b3-4556-9314-c3ee86707044 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:29.500338 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d1e2c9-b1b3-4556-9314-c3ee86707044 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:29.533872 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb83a72-7eec-47b0-ab88-cadf5ca37afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:29.534682 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb83a72-7eec-47b0-ab88-cadf5ca37afa None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:29.534966 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb83a72-7eec-47b0-ab88-cadf5ca37afa None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:29.535342 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb83a72-7eec-47b0-ab88-cadf5ca37afa None admin] PATH_INFO: `/v3/users/placement` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:29.542953 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb83a72-7eec-47b0-ab88-cadf5ca37afa None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:26:29.544409 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb83a72-7eec-47b0-ab88-cadf5ca37afa None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:26:29.557588 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-feb83a72-7eec-47b0-ab88-cadf5ca37afa None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 11 16:26:29.558820 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 627/1253] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:26:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:26:29.564978 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfc58c1-044a-481c-9d8d-80c945c71f83 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:29.659881 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfc58c1-044a-481c-9d8d-80c945c71f83 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:29.692182 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ef60e-67af-4bd5-9d35-9401ab3ad8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:29.692882 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ef60e-67af-4bd5-9d35-9401ab3ad8cc None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:29.693172 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ef60e-67af-4bd5-9d35-9401ab3ad8cc None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:29.693450 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ef60e-67af-4bd5-9d35-9401ab3ad8cc None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:29.694290 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2ef60e-67af-4bd5-9d35-9401ab3ad8cc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:26:29.694604 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2ef60e-67af-4bd5-9d35-9401ab3ad8cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:26:29.696058 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2ef60e-67af-4bd5-9d35-9401ab3ad8cc None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:26:29.713452 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 627/1254] 10.222.0.43 () {56 vars in 1143 bytes} [Mon Apr 11 16:26:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:26:29.719299 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb83a72-7eec-47b0-ab88-cadf5ca37afa None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:29.816238 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb83a72-7eec-47b0-ab88-cadf5ca37afa None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:29.848482 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d2708-d378-4a65-9a60-d65c2c666db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:29.849468 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d2708-d378-4a65-9a60-d65c2c666db4 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:29.849757 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d2708-d378-4a65-9a60-d65c2c666db4 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:29.850035 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d2708-d378-4a65-9a60-d65c2c666db4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:29.914865 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2d2708-d378-4a65-9a60-d65c2c666db4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:26:29.916454 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2d2708-d378-4a65-9a60-d65c2c666db4 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:26:30.013430 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 628/1255] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Apr 11 16:26:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 11 16:26:30.019373 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ef60e-67af-4bd5-9d35-9401ab3ad8cc None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:30.114496 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ef60e-67af-4bd5-9d35-9401ab3ad8cc None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:30.146073 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ee3bf-4e2a-4490-8d87-f23a6d3bfda5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:30.146855 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ee3bf-4e2a-4490-8d87-f23a6d3bfda5 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:30.147138 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ee3bf-4e2a-4490-8d87-f23a6d3bfda5 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:30.147412 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ee3bf-4e2a-4490-8d87-f23a6d3bfda5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:30.157783 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0ee3bf-4e2a-4490-8d87-f23a6d3bfda5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:26:30.159231 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0ee3bf-4e2a-4490-8d87-f23a6d3bfda5 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:26:30.177843 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-fc0ee3bf-4e2a-4490-8d87-f23a6d3bfda5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:26:30.179564 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 628/1256] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:26:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:26:30.185435 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d2708-d378-4a65-9a60-d65c2c666db4 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:30.286010 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d2708-d378-4a65-9a60-d65c2c666db4 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:30.321823 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdf6b98-9182-4818-87cc-9bbf67135123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:30.322568 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf6b98-9182-4818-87cc-9bbf67135123 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:30.322949 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf6b98-9182-4818-87cc-9bbf67135123 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:30.323222 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf6b98-9182-4818-87cc-9bbf67135123 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:30.323969 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdf6b98-9182-4818-87cc-9bbf67135123 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:26:30.324273 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdf6b98-9182-4818-87cc-9bbf67135123 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:26:30.325641 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdf6b98-9182-4818-87cc-9bbf67135123 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:26:30.336457 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 629/1257] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Apr 11 16:26:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:26:30.342308 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ee3bf-4e2a-4490-8d87-f23a6d3bfda5 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:30.435997 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ee3bf-4e2a-4490-8d87-f23a6d3bfda5 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:30.468498 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e81871-669f-482e-8fff-966295ec15cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:30.469273 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e81871-669f-482e-8fff-966295ec15cd None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:30.469551 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e81871-669f-482e-8fff-966295ec15cd None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:30.469822 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e81871-669f-482e-8fff-966295ec15cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:30.476311 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e81871-669f-482e-8fff-966295ec15cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:26:30.477718 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e81871-669f-482e-8fff-966295ec15cd None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:26:30.491590 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-b3e81871-669f-482e-8fff-966295ec15cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 16:26:30.492751 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 629/1258] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Apr 11 16:26:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:26:30.498598 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdf6b98-9182-4818-87cc-9bbf67135123 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:30.595542 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdf6b98-9182-4818-87cc-9bbf67135123 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:30.628207 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ef37af-02b1-4f6f-b999-86e8e17bc4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:30.628864 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef37af-02b1-4f6f-b999-86e8e17bc4ca None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:30.629148 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef37af-02b1-4f6f-b999-86e8e17bc4ca None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:30.629423 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef37af-02b1-4f6f-b999-86e8e17bc4ca None admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:30.630199 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ef37af-02b1-4f6f-b999-86e8e17bc4ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:26:30.630509 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ef37af-02b1-4f6f-b999-86e8e17bc4ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:26:30.632099 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ef37af-02b1-4f6f-b999-86e8e17bc4ca None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:26:30.644347 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 630/1259] 10.222.0.43 () {56 vars in 1148 bytes} [Mon Apr 11 16:26:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:26:30.650770 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e81871-669f-482e-8fff-966295ec15cd None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:30.745647 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e81871-669f-482e-8fff-966295ec15cd None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:30.779464 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46505fcd-bcfc-4b50-80ef-1e167eb34b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:30.779865 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46505fcd-bcfc-4b50-80ef-1e167eb34b81 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:30.779865 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46505fcd-bcfc-4b50-80ef-1e167eb34b81 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:30.780099 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46505fcd-bcfc-4b50-80ef-1e167eb34b81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:30.780927 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46505fcd-bcfc-4b50-80ef-1e167eb34b81 None admin] RBAC: Adding query filter params (role.id=702e5e78b5d744529384b96a390ae92f, scope.project.id=477b9d41390e455a82e733c4fc6acd6b, user.id=6589debd41bf496085c7339ab5409666) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:26:30.781228 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46505fcd-bcfc-4b50-80ef-1e167eb34b81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:26:30.782681 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46505fcd-bcfc-4b50-80ef-1e167eb34b81 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:26:30.788302 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 630/1260] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Apr 11 16:26:30 2022] GET /identity/v3/role_assignments?user.id=6589debd41bf496085c7339ab5409666&scope.project.id=477b9d41390e455a82e733c4fc6acd6b&role.id=702e5e78b5d744529384b96a390ae92f => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:26:33.224405 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c682a-6b3e-4a9e-b66f-6090ef7a9ae1 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:33.224965 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c682a-6b3e-4a9e-b66f-6090ef7a9ae1 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:33.225073 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c682a-6b3e-4a9e-b66f-6090ef7a9ae1 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:33.226439 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 631/1261] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:26:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:26:33.232019 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d125e8-85e2-4efb-b9b3-06b660dd99ec None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:33.232503 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d125e8-85e2-4efb-b9b3-06b660dd99ec None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:33.232609 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d125e8-85e2-4efb-b9b3-06b660dd99ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:33.249064 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-c8d125e8-85e2-4efb-b9b3-06b660dd99ec None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:26:33.256659 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-c8d125e8-85e2-4efb-b9b3-06b660dd99ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:26:33.317231 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 631/1262] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:26:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:26:33.340668 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62c682a-6b3e-4a9e-b66f-6090ef7a9ae1 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:33.437991 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62c682a-6b3e-4a9e-b66f-6090ef7a9ae1 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:33.470831 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a7f380-d9e4-4a4b-876f-23e24bc0a341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:33.471671 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a7f380-d9e4-4a4b-876f-23e24bc0a341 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:33.471960 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a7f380-d9e4-4a4b-876f-23e24bc0a341 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:33.472236 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a7f380-d9e4-4a4b-876f-23e24bc0a341 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:33.482502 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a7f380-d9e4-4a4b-876f-23e24bc0a341 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:26:33.489471 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-58a7f380-d9e4-4a4b-876f-23e24bc0a341 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 16:26:33.490660 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 632/1263] 10.222.0.43 () {56 vars in 1096 bytes} [Mon Apr 11 16:26:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:26:33.498606 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d125e8-85e2-4efb-b9b3-06b660dd99ec None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:33.591850 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d125e8-85e2-4efb-b9b3-06b660dd99ec None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:33.624056 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1ed5a4-05bc-4a7a-8dfc-c83096ab2a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:33.624723 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ed5a4-05bc-4a7a-8dfc-c83096ab2a7e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:33.625013 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ed5a4-05bc-4a7a-8dfc-c83096ab2a7e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:33.625293 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ed5a4-05bc-4a7a-8dfc-c83096ab2a7e None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:33.626039 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1ed5a4-05bc-4a7a-8dfc-c83096ab2a7e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:26:33.626352 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1ed5a4-05bc-4a7a-8dfc-c83096ab2a7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:26:33.627728 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1ed5a4-05bc-4a7a-8dfc-c83096ab2a7e None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:26:33.635371 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 632/1264] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Apr 11 16:26:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:26:33.641985 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a7f380-d9e4-4a4b-876f-23e24bc0a341 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:33.740351 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a7f380-d9e4-4a4b-876f-23e24bc0a341 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:33.772740 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c7f8bc-38f2-4cb1-aca2-0b47cbd448b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:33.773535 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c7f8bc-38f2-4cb1-aca2-0b47cbd448b1 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:33.773848 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c7f8bc-38f2-4cb1-aca2-0b47cbd448b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:33.774131 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c7f8bc-38f2-4cb1-aca2-0b47cbd448b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:33.785177 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c7f8bc-38f2-4cb1-aca2-0b47cbd448b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:26:33.786654 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c7f8bc-38f2-4cb1-aca2-0b47cbd448b1 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:26:33.803147 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-64c7f8bc-38f2-4cb1-aca2-0b47cbd448b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:26:33.807847 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 633/1265] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:26:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:26:33.810415 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1ed5a4-05bc-4a7a-8dfc-c83096ab2a7e None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:33.905848 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1ed5a4-05bc-4a7a-8dfc-c83096ab2a7e None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:33.937244 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0cfac1-2bdc-4260-811f-c5a14e592722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:33.937892 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0cfac1-2bdc-4260-811f-c5a14e592722 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:33.938173 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0cfac1-2bdc-4260-811f-c5a14e592722 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:33.938447 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0cfac1-2bdc-4260-811f-c5a14e592722 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:33.939168 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0cfac1-2bdc-4260-811f-c5a14e592722 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:26:33.939466 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0cfac1-2bdc-4260-811f-c5a14e592722 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:26:33.940833 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0cfac1-2bdc-4260-811f-c5a14e592722 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:26:33.952461 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 633/1266] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Apr 11 16:26:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:26:33.958388 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c7f8bc-38f2-4cb1-aca2-0b47cbd448b1 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:34.056197 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c7f8bc-38f2-4cb1-aca2-0b47cbd448b1 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:34.088119 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d75a325-d69e-4eeb-8a53-e15e4af755f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:34.089684 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d75a325-d69e-4eeb-8a53-e15e4af755f6 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:34.089971 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d75a325-d69e-4eeb-8a53-e15e4af755f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:34.090245 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d75a325-d69e-4eeb-8a53-e15e4af755f6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:34.098160 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d75a325-d69e-4eeb-8a53-e15e4af755f6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:26:34.099766 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d75a325-d69e-4eeb-8a53-e15e4af755f6 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:26:34.114606 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-7d75a325-d69e-4eeb-8a53-e15e4af755f6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 11 16:26:34.115820 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 634/1267] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:26:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:26:34.122147 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0cfac1-2bdc-4260-811f-c5a14e592722 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:34.218172 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0cfac1-2bdc-4260-811f-c5a14e592722 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:34.250473 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15a166c-e962-46f4-8cee-513bb492124c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:34.251153 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a166c-e962-46f4-8cee-513bb492124c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:34.251435 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a166c-e962-46f4-8cee-513bb492124c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:34.251740 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a166c-e962-46f4-8cee-513bb492124c None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:34.252571 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15a166c-e962-46f4-8cee-513bb492124c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:26:34.252881 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15a166c-e962-46f4-8cee-513bb492124c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:26:34.254289 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15a166c-e962-46f4-8cee-513bb492124c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:26:34.271225 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 634/1268] 10.222.0.43 () {56 vars in 1143 bytes} [Mon Apr 11 16:26:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:26:34.277576 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d75a325-d69e-4eeb-8a53-e15e4af755f6 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:34.396304 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d75a325-d69e-4eeb-8a53-e15e4af755f6 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:34.429645 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ed66e0-a6b9-4cd7-9507-4c1a699cacc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:34.430458 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed66e0-a6b9-4cd7-9507-4c1a699cacc0 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:34.430746 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed66e0-a6b9-4cd7-9507-4c1a699cacc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:34.431069 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed66e0-a6b9-4cd7-9507-4c1a699cacc0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:34.441767 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ed66e0-a6b9-4cd7-9507-4c1a699cacc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:26:34.443320 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ed66e0-a6b9-4cd7-9507-4c1a699cacc0 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:26:34.459763 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-35ed66e0-a6b9-4cd7-9507-4c1a699cacc0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:26:34.460961 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 635/1269] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:26:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:26:34.467117 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15a166c-e962-46f4-8cee-513bb492124c None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:34.563081 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15a166c-e962-46f4-8cee-513bb492124c None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:34.596088 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e461f19-8674-4d37-897d-29dc44f76d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:34.596744 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e461f19-8674-4d37-897d-29dc44f76d69 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:34.597027 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e461f19-8674-4d37-897d-29dc44f76d69 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:34.597304 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e461f19-8674-4d37-897d-29dc44f76d69 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:34.598022 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e461f19-8674-4d37-897d-29dc44f76d69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:26:34.598336 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e461f19-8674-4d37-897d-29dc44f76d69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:26:34.599727 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e461f19-8674-4d37-897d-29dc44f76d69 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:26:34.611264 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 635/1270] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Apr 11 16:26:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:26:34.616974 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ed66e0-a6b9-4cd7-9507-4c1a699cacc0 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:34.732394 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ed66e0-a6b9-4cd7-9507-4c1a699cacc0 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:34.765402 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21b1e80-7dce-454e-936f-0426d45b8871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:34.766205 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b1e80-7dce-454e-936f-0426d45b8871 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:34.766484 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b1e80-7dce-454e-936f-0426d45b8871 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:34.766757 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b1e80-7dce-454e-936f-0426d45b8871 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:34.773343 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21b1e80-7dce-454e-936f-0426d45b8871 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:26:34.774829 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21b1e80-7dce-454e-936f-0426d45b8871 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:26:34.787955 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-e21b1e80-7dce-454e-936f-0426d45b8871 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 16:26:34.789380 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 636/1271] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Apr 11 16:26:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:26:34.795872 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e461f19-8674-4d37-897d-29dc44f76d69 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:34.899159 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e461f19-8674-4d37-897d-29dc44f76d69 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:34.932013 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e99236b-a7eb-47e9-8c51-35d1315508d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:34.932698 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e99236b-a7eb-47e9-8c51-35d1315508d6 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:34.933162 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e99236b-a7eb-47e9-8c51-35d1315508d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:34.933442 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e99236b-a7eb-47e9-8c51-35d1315508d6 None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:34.934223 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e99236b-a7eb-47e9-8c51-35d1315508d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:26:34.934535 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e99236b-a7eb-47e9-8c51-35d1315508d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:26:34.935974 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e99236b-a7eb-47e9-8c51-35d1315508d6 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:26:34.947186 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 636/1272] 10.222.0.43 () {56 vars in 1148 bytes} [Mon Apr 11 16:26:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:26:34.953181 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21b1e80-7dce-454e-936f-0426d45b8871 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:35.051421 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21b1e80-7dce-454e-936f-0426d45b8871 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:35.084347 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac83734-bd7d-45b7-a585-f60eca810bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:35.085262 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac83734-bd7d-45b7-a585-f60eca810bb3 None admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:35.085574 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac83734-bd7d-45b7-a585-f60eca810bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:35.085852 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac83734-bd7d-45b7-a585-f60eca810bb3 None admin] PATH_INFO: `/v3/projects/477b9d41390e455a82e733c4fc6acd6b/users/6589debd41bf496085c7339ab5409666/roles/702e5e78b5d744529384b96a390ae92f` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:35.087856 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac83734-bd7d-45b7-a585-f60eca810bb3 None admin] RBAC: Authorizing `identity:create_grant(project_id=477b9d41390e455a82e733c4fc6acd6b, user_id=6589debd41bf496085c7339ab5409666, role_id=702e5e78b5d744529384b96a390ae92f)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:26:35.090218 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac83734-bd7d-45b7-a585-f60eca810bb3 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:26:35.218670 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 637/1273] 10.222.0.43 () {58 vars in 1439 bytes} [Mon Apr 11 16:26:34 2022] PUT /identity/v3/projects/477b9d41390e455a82e733c4fc6acd6b/users/6589debd41bf496085c7339ab5409666/roles/702e5e78b5d744529384b96a390ae92f => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:26:37.489315 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb27f2-5230-4f19-bd4c-0946c1722c0c None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:37.489806 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb27f2-5230-4f19-bd4c-0946c1722c0c None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:37.489908 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb27f2-5230-4f19-bd4c-0946c1722c0c None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:37.491221 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 637/1274] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:26:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:26:37.496285 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c738e3-caf6-4525-b673-e450e1c44417 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:37.496760 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c738e3-caf6-4525-b673-e450e1c44417 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:37.496872 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c738e3-caf6-4525-b673-e450e1c44417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:37.515067 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-d2c738e3-caf6-4525-b673-e450e1c44417 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:26:37.516292 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-d2c738e3-caf6-4525-b673-e450e1c44417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:26:37.581747 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 638/1275] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:26:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:26:37.607069 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcb27f2-5230-4f19-bd4c-0946c1722c0c None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:37.705801 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcb27f2-5230-4f19-bd4c-0946c1722c0c None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:37.738746 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489221f7-e06d-412c-90cf-381e202cc372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:37.739464 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489221f7-e06d-412c-90cf-381e202cc372 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:37.739780 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489221f7-e06d-412c-90cf-381e202cc372 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:37.740056 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489221f7-e06d-412c-90cf-381e202cc372 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:37.750799 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489221f7-e06d-412c-90cf-381e202cc372 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:26:37.758300 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-489221f7-e06d-412c-90cf-381e202cc372 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 16:26:37.759550 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 638/1276] 10.222.0.43 () {56 vars in 1096 bytes} [Mon Apr 11 16:26:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:26:37.766391 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c738e3-caf6-4525-b673-e450e1c44417 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:37.860382 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c738e3-caf6-4525-b673-e450e1c44417 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:37.892493 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e108f0e3-9365-4c3a-ba77-afd7856ca190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:37.893149 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e108f0e3-9365-4c3a-ba77-afd7856ca190 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:37.893428 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e108f0e3-9365-4c3a-ba77-afd7856ca190 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:37.893701 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e108f0e3-9365-4c3a-ba77-afd7856ca190 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:37.894432 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e108f0e3-9365-4c3a-ba77-afd7856ca190 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:26:37.894738 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e108f0e3-9365-4c3a-ba77-afd7856ca190 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:26:37.896118 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e108f0e3-9365-4c3a-ba77-afd7856ca190 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:26:37.904620 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 639/1277] 10.222.0.43 () {56 vars in 1099 bytes} [Mon Apr 11 16:26:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:26:37.910445 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489221f7-e06d-412c-90cf-381e202cc372 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:38.004864 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489221f7-e06d-412c-90cf-381e202cc372 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:38.038349 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae0614-1d93-4234-9ab8-69c8afb1d883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:38.038916 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae0614-1d93-4234-9ab8-69c8afb1d883 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:38.039449 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae0614-1d93-4234-9ab8-69c8afb1d883 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:38.039750 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae0614-1d93-4234-9ab8-69c8afb1d883 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:38.050341 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dae0614-1d93-4234-9ab8-69c8afb1d883 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:26:38.051798 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dae0614-1d93-4234-9ab8-69c8afb1d883 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:26:38.068134 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-7dae0614-1d93-4234-9ab8-69c8afb1d883 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:26:38.069303 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 639/1278] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:26:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:26:38.076337 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e108f0e3-9365-4c3a-ba77-afd7856ca190 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:38.173015 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e108f0e3-9365-4c3a-ba77-afd7856ca190 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:38.205283 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28d8ac5-08e5-4725-8fac-d3323d92af3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:38.205944 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d8ac5-08e5-4725-8fac-d3323d92af3b None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:38.206229 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d8ac5-08e5-4725-8fac-d3323d92af3b None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:38.206500 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d8ac5-08e5-4725-8fac-d3323d92af3b None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:38.207213 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28d8ac5-08e5-4725-8fac-d3323d92af3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:26:38.207537 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28d8ac5-08e5-4725-8fac-d3323d92af3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:26:38.208905 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28d8ac5-08e5-4725-8fac-d3323d92af3b None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:26:38.220988 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 640/1279] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Apr 11 16:26:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:26:38.226791 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae0614-1d93-4234-9ab8-69c8afb1d883 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:38.321189 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae0614-1d93-4234-9ab8-69c8afb1d883 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:38.353429 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883cca2c-f4c1-41d4-bcf9-91a427de6298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:38.354227 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883cca2c-f4c1-41d4-bcf9-91a427de6298 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:38.354510 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883cca2c-f4c1-41d4-bcf9-91a427de6298 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:38.354785 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883cca2c-f4c1-41d4-bcf9-91a427de6298 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:38.362107 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883cca2c-f4c1-41d4-bcf9-91a427de6298 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:26:38.363532 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883cca2c-f4c1-41d4-bcf9-91a427de6298 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:26:38.376979 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-883cca2c-f4c1-41d4-bcf9-91a427de6298 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 11 16:26:38.378252 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 640/1280] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:26:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:26:38.384217 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28d8ac5-08e5-4725-8fac-d3323d92af3b None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:38.486158 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28d8ac5-08e5-4725-8fac-d3323d92af3b None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:38.518767 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e233887c-5eed-4a74-8b64-c3b91175b6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:38.519442 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e233887c-5eed-4a74-8b64-c3b91175b6ae None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:38.519761 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e233887c-5eed-4a74-8b64-c3b91175b6ae None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:38.520038 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e233887c-5eed-4a74-8b64-c3b91175b6ae None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:38.520867 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e233887c-5eed-4a74-8b64-c3b91175b6ae None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:26:38.521176 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e233887c-5eed-4a74-8b64-c3b91175b6ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:26:38.522601 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e233887c-5eed-4a74-8b64-c3b91175b6ae None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:26:38.539662 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 641/1281] 10.222.0.43 () {56 vars in 1143 bytes} [Mon Apr 11 16:26:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:26:38.545550 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883cca2c-f4c1-41d4-bcf9-91a427de6298 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:38.640430 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883cca2c-f4c1-41d4-bcf9-91a427de6298 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:38.672462 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cac781-e33a-42dc-a821-9ed5a9c29eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:38.673102 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cac781-e33a-42dc-a821-9ed5a9c29eae None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:38.673383 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cac781-e33a-42dc-a821-9ed5a9c29eae None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:38.673655 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cac781-e33a-42dc-a821-9ed5a9c29eae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:38.739172 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cac781-e33a-42dc-a821-9ed5a9c29eae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:26:38.740671 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cac781-e33a-42dc-a821-9ed5a9c29eae None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:26:38.836521 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 641/1282] 10.222.0.43 () {58 vars in 1282 bytes} [Mon Apr 11 16:26:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 16:26:38.842354 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e233887c-5eed-4a74-8b64-c3b91175b6ae None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:38.946643 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e233887c-5eed-4a74-8b64-c3b91175b6ae None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:38.979575 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643e1db9-d071-450a-96d7-49ee2ea352a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:38.980368 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e1db9-d071-450a-96d7-49ee2ea352a2 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:38.980672 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e1db9-d071-450a-96d7-49ee2ea352a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:38.980949 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e1db9-d071-450a-96d7-49ee2ea352a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:38.990798 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643e1db9-d071-450a-96d7-49ee2ea352a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:26:38.992262 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643e1db9-d071-450a-96d7-49ee2ea352a2 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:26:39.009027 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-643e1db9-d071-450a-96d7-49ee2ea352a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:26:39.011816 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 642/1283] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:26:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:26:39.017233 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cac781-e33a-42dc-a821-9ed5a9c29eae None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:39.120880 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cac781-e33a-42dc-a821-9ed5a9c29eae None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:39.155154 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3546a810-9da4-4962-a3b6-956479ef8b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:39.155853 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3546a810-9da4-4962-a3b6-956479ef8b93 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:39.156139 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3546a810-9da4-4962-a3b6-956479ef8b93 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:39.156415 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3546a810-9da4-4962-a3b6-956479ef8b93 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:39.157131 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3546a810-9da4-4962-a3b6-956479ef8b93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:26:39.157437 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3546a810-9da4-4962-a3b6-956479ef8b93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:26:39.158923 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3546a810-9da4-4962-a3b6-956479ef8b93 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:26:39.170667 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 642/1284] 10.222.0.43 () {56 vars in 1109 bytes} [Mon Apr 11 16:26:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:26:39.176456 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643e1db9-d071-450a-96d7-49ee2ea352a2 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:39.273788 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643e1db9-d071-450a-96d7-49ee2ea352a2 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:39.308156 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5651215f-0762-4d79-8cf1-48ebcdb91db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:39.309560 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651215f-0762-4d79-8cf1-48ebcdb91db6 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:39.310052 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651215f-0762-4d79-8cf1-48ebcdb91db6 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:39.310332 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651215f-0762-4d79-8cf1-48ebcdb91db6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:39.317116 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5651215f-0762-4d79-8cf1-48ebcdb91db6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:26:39.318573 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5651215f-0762-4d79-8cf1-48ebcdb91db6 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:26:39.331623 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.application [None req-5651215f-0762-4d79-8cf1-48ebcdb91db6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 16:26:39.332791 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 643/1285] 10.222.0.43 () {56 vars in 1111 bytes} [Mon Apr 11 16:26:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:26:39.338620 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3546a810-9da4-4962-a3b6-956479ef8b93 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:39.441511 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3546a810-9da4-4962-a3b6-956479ef8b93 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:39.476146 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2312514a-4b56-4c04-b23f-dbdc4c69a96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:39.476813 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2312514a-4b56-4c04-b23f-dbdc4c69a96a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:39.477185 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2312514a-4b56-4c04-b23f-dbdc4c69a96a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:39.477464 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2312514a-4b56-4c04-b23f-dbdc4c69a96a None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:39.478395 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2312514a-4b56-4c04-b23f-dbdc4c69a96a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:26:39.478711 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2312514a-4b56-4c04-b23f-dbdc4c69a96a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:26:39.480164 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2312514a-4b56-4c04-b23f-dbdc4c69a96a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:26:39.492493 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 643/1286] 10.222.0.43 () {56 vars in 1148 bytes} [Mon Apr 11 16:26:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:26:39.498640 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5651215f-0762-4d79-8cf1-48ebcdb91db6 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:39.595331 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5651215f-0762-4d79-8cf1-48ebcdb91db6 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:39.627364 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ae276-8ecc-4948-ae98-69ef34712c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:39.628052 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ae276-8ecc-4948-ae98-69ef34712c52 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:39.628339 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ae276-8ecc-4948-ae98-69ef34712c52 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:39.628627 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ae276-8ecc-4948-ae98-69ef34712c52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:39.629447 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4ae276-8ecc-4948-ae98-69ef34712c52 None admin] RBAC: Adding query filter params (role.id=702e5e78b5d744529384b96a390ae92f, scope.project.id=477b9d41390e455a82e733c4fc6acd6b, user.id=6589debd41bf496085c7339ab5409666) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:26:39.629761 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4ae276-8ecc-4948-ae98-69ef34712c52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:26:39.631178 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4ae276-8ecc-4948-ae98-69ef34712c52 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:26:39.636894 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 644/1287] 10.222.0.43 () {56 vars in 1374 bytes} [Mon Apr 11 16:26:39 2022] GET /identity/v3/role_assignments?user.id=6589debd41bf496085c7339ab5409666&scope.project.id=477b9d41390e455a82e733c4fc6acd6b&role.id=702e5e78b5d744529384b96a390ae92f => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:26:41.969588 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8efc50-e812-4c44-b5fb-05e25976d0e4 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:41.970121 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8efc50-e812-4c44-b5fb-05e25976d0e4 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:41.970121 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8efc50-e812-4c44-b5fb-05e25976d0e4 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:41.971524 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 644/1288] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:26:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:26:41.976561 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e447a9-93c7-46ad-8828-f11cbdee7415 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:41.976940 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e447a9-93c7-46ad-8828-f11cbdee7415 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:41.977108 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e447a9-93c7-46ad-8828-f11cbdee7415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:41.994079 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-45e447a9-93c7-46ad-8828-f11cbdee7415 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:26:41.997718 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-45e447a9-93c7-46ad-8828-f11cbdee7415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:26:42.058892 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 645/1289] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:26:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:26:42.081204 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8efc50-e812-4c44-b5fb-05e25976d0e4 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:42.176827 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8efc50-e812-4c44-b5fb-05e25976d0e4 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:42.208720 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d867390d-0ffd-45eb-8bd1-3acb2ebd251f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:42.209509 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d867390d-0ffd-45eb-8bd1-3acb2ebd251f None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:42.209787 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d867390d-0ffd-45eb-8bd1-3acb2ebd251f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:42.210056 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d867390d-0ffd-45eb-8bd1-3acb2ebd251f None admin] PATH_INFO: `/v3/services/placement` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:42.210707 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d867390d-0ffd-45eb-8bd1-3acb2ebd251f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:26:42.212069 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d867390d-0ffd-45eb-8bd1-3acb2ebd251f None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:26:42.223698 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-d867390d-0ffd-45eb-8bd1-3acb2ebd251f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Apr 11 16:26:42.224862 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 645/1290] 10.222.0.43 () {56 vars in 1117 bytes} [Mon Apr 11 16:26:42 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:26:42.232263 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e447a9-93c7-46ad-8828-f11cbdee7415 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:42.329488 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e447a9-93c7-46ad-8828-f11cbdee7415 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:42.362217 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bcbf5f-5119-4e7b-9764-9c6bdd6b3a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:42.362882 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bcbf5f-5119-4e7b-9764-9c6bdd6b3a24 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:42.363165 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bcbf5f-5119-4e7b-9764-9c6bdd6b3a24 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:42.363443 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bcbf5f-5119-4e7b-9764-9c6bdd6b3a24 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:42.364174 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bcbf5f-5119-4e7b-9764-9c6bdd6b3a24 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:26:42.364485 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bcbf5f-5119-4e7b-9764-9c6bdd6b3a24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:26:42.365832 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bcbf5f-5119-4e7b-9764-9c6bdd6b3a24 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:26:42.370476 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 646/1291] 10.222.0.43 () {56 vars in 1116 bytes} [Mon Apr 11 16:26:42 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:26:42.376644 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d867390d-0ffd-45eb-8bd1-3acb2ebd251f None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:42.474560 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d867390d-0ffd-45eb-8bd1-3acb2ebd251f None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:42.506567 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e32724-1eda-43c5-a1bf-de57490c0cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:42.507237 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e32724-1eda-43c5-a1bf-de57490c0cf9 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:42.507554 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e32724-1eda-43c5-a1bf-de57490c0cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:42.507837 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e32724-1eda-43c5-a1bf-de57490c0cf9 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:42.508547 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e32724-1eda-43c5-a1bf-de57490c0cf9 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:26:42.508857 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e32724-1eda-43c5-a1bf-de57490c0cf9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:26:42.510227 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e32724-1eda-43c5-a1bf-de57490c0cf9 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:26:42.515489 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 646/1292] 10.222.0.43 () {56 vars in 1116 bytes} [Mon Apr 11 16:26:42 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:26:44.849566 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd1aa4d-8092-4e15-ba9b-155f52506db4 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:44.850070 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd1aa4d-8092-4e15-ba9b-155f52506db4 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:44.850070 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd1aa4d-8092-4e15-ba9b-155f52506db4 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:44.851572 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 647/1293] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:26:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:26:44.856822 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0f63e2-80cb-413f-9378-95f3f738e8df None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:44.857213 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0f63e2-80cb-413f-9378-95f3f738e8df None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:44.858120 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0f63e2-80cb-413f-9378-95f3f738e8df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:44.874857 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-9a0f63e2-80cb-413f-9378-95f3f738e8df None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:26:44.876085 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-9a0f63e2-80cb-413f-9378-95f3f738e8df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:26:44.940515 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 647/1294] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:26:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:26:44.964399 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd1aa4d-8092-4e15-ba9b-155f52506db4 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:45.067915 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd1aa4d-8092-4e15-ba9b-155f52506db4 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:45.101458 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1135aa1c-9fa6-4436-916d-b1e304d8d098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:45.102063 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1135aa1c-9fa6-4436-916d-b1e304d8d098 None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:45.102346 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1135aa1c-9fa6-4436-916d-b1e304d8d098 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:45.102622 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1135aa1c-9fa6-4436-916d-b1e304d8d098 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:45.103345 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1135aa1c-9fa6-4436-916d-b1e304d8d098 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:26:45.104715 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1135aa1c-9fa6-4436-916d-b1e304d8d098 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:26:45.187591 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 648/1295] 10.222.0.43 () {60 vars in 1141 bytes} [Mon Apr 11 16:26:44 2022] POST /identity/v3/services => generated 246 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:26:47.479865 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d782797-403d-4000-a1d7-86befd3b389f None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:47.480303 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d782797-403d-4000-a1d7-86befd3b389f None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:47.480437 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d782797-403d-4000-a1d7-86befd3b389f None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:47.481780 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 648/1296] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:26:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:26:47.486881 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615cf6f2-b143-484e-b1fd-5b6db964e5e9 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:47.487343 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615cf6f2-b143-484e-b1fd-5b6db964e5e9 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:47.487449 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615cf6f2-b143-484e-b1fd-5b6db964e5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:47.504118 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-615cf6f2-b143-484e-b1fd-5b6db964e5e9 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:26:47.505307 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-615cf6f2-b143-484e-b1fd-5b6db964e5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:26:47.575741 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 649/1297] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:26:47 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:26:47.600569 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d782797-403d-4000-a1d7-86befd3b389f None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:47.695377 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d782797-403d-4000-a1d7-86befd3b389f None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:47.727969 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88310527-93da-49b9-9a25-c207b92eb577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:47.728699 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88310527-93da-49b9-9a25-c207b92eb577 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:47.728993 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88310527-93da-49b9-9a25-c207b92eb577 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:47.729259 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88310527-93da-49b9-9a25-c207b92eb577 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:47.729905 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88310527-93da-49b9-9a25-c207b92eb577 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:26:47.731255 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88310527-93da-49b9-9a25-c207b92eb577 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:26:47.742532 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-88310527-93da-49b9-9a25-c207b92eb577 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Apr 11 16:26:47.743984 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 649/1298] 10.222.0.43 () {56 vars in 1117 bytes} [Mon Apr 11 16:26:47 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:26:47.750580 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615cf6f2-b143-484e-b1fd-5b6db964e5e9 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:47.851069 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615cf6f2-b143-484e-b1fd-5b6db964e5e9 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:47.884893 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c473a-3f77-40f2-bce5-be954d6d6755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:47.885566 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c473a-3f77-40f2-bce5-be954d6d6755 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:47.885853 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c473a-3f77-40f2-bce5-be954d6d6755 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:47.886125 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c473a-3f77-40f2-bce5-be954d6d6755 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:47.886832 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009c473a-3f77-40f2-bce5-be954d6d6755 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:26:47.887139 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009c473a-3f77-40f2-bce5-be954d6d6755 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:26:47.888542 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009c473a-3f77-40f2-bce5-be954d6d6755 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:26:47.894419 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 650/1299] 10.222.0.43 () {56 vars in 1116 bytes} [Mon Apr 11 16:26:47 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:26:47.900551 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88310527-93da-49b9-9a25-c207b92eb577 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:47.994929 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88310527-93da-49b9-9a25-c207b92eb577 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:48.027621 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7347db8-0463-4bc1-bb8c-1a7797fe9893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:48.028325 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7347db8-0463-4bc1-bb8c-1a7797fe9893 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:48.028605 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7347db8-0463-4bc1-bb8c-1a7797fe9893 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:48.028883 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7347db8-0463-4bc1-bb8c-1a7797fe9893 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:48.029686 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7347db8-0463-4bc1-bb8c-1a7797fe9893 None admin] RBAC: Adding query filter params (interface=public, service_id=a3a951cd09354fdc9f5f524bfd2d6edd, region_id=RegionOne) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:26:48.030050 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7347db8-0463-4bc1-bb8c-1a7797fe9893 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:26:48.031657 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7347db8-0463-4bc1-bb8c-1a7797fe9893 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:26:48.037050 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 650/1300] 10.222.0.43 () {56 vars in 1251 bytes} [Mon Apr 11 16:26:47 2022] GET /identity/v3/endpoints?service_id=a3a951cd09354fdc9f5f524bfd2d6edd&interface=public®ion_id=RegionOne => generated 194 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:26:48.042991 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c473a-3f77-40f2-bce5-be954d6d6755 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:48.142238 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c473a-3f77-40f2-bce5-be954d6d6755 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:48.180133 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b9c4c9-995c-4e9f-8533-ab4be55352b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:48.180806 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b9c4c9-995c-4e9f-8533-ab4be55352b7 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:48.181093 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b9c4c9-995c-4e9f-8533-ab4be55352b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:48.181371 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b9c4c9-995c-4e9f-8533-ab4be55352b7 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:48.182057 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b9c4c9-995c-4e9f-8533-ab4be55352b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:26:48.183418 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b9c4c9-995c-4e9f-8533-ab4be55352b7 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:26:48.191103 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 651/1301] 10.222.0.43 () {56 vars in 1087 bytes} [Mon Apr 11 16:26:48 2022] GET /identity/v3/services => generated 2191 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:26:50.533678 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55358064-a691-476c-842d-00c0d35ab8e7 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:50.534228 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55358064-a691-476c-842d-00c0d35ab8e7 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:50.534228 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55358064-a691-476c-842d-00c0d35ab8e7 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:50.535580 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 651/1302] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:26:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:26:50.540692 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92155898-dcb0-4e28-ae2e-82cc4a9c18cc None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:50.541138 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92155898-dcb0-4e28-ae2e-82cc4a9c18cc None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:50.541241 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92155898-dcb0-4e28-ae2e-82cc4a9c18cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:50.558657 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-92155898-dcb0-4e28-ae2e-82cc4a9c18cc None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:26:50.559883 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-92155898-dcb0-4e28-ae2e-82cc4a9c18cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:26:50.626153 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 652/1303] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:26:50 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:26:50.649942 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55358064-a691-476c-842d-00c0d35ab8e7 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:50.749192 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55358064-a691-476c-842d-00c0d35ab8e7 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:50.784300 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cfa49b-83c5-43c4-9626-ef891869b980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:50.785102 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cfa49b-83c5-43c4-9626-ef891869b980 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:50.786750 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cfa49b-83c5-43c4-9626-ef891869b980 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:50.786750 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cfa49b-83c5-43c4-9626-ef891869b980 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:50.786750 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cfa49b-83c5-43c4-9626-ef891869b980 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:26:50.787656 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cfa49b-83c5-43c4-9626-ef891869b980 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:26:50.799345 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.application [None req-50cfa49b-83c5-43c4-9626-ef891869b980 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Apr 11 16:26:50.800524 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 652/1304] 10.222.0.43 () {56 vars in 1117 bytes} [Mon Apr 11 16:26:50 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:26:50.806780 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92155898-dcb0-4e28-ae2e-82cc4a9c18cc None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:50.919153 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92155898-dcb0-4e28-ae2e-82cc4a9c18cc None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:50.957030 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a1c934-a822-484f-80ff-6e87f7380994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:50.957724 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1c934-a822-484f-80ff-6e87f7380994 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:50.958004 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1c934-a822-484f-80ff-6e87f7380994 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:50.958276 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1c934-a822-484f-80ff-6e87f7380994 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:50.958997 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a1c934-a822-484f-80ff-6e87f7380994 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:26:50.959305 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a1c934-a822-484f-80ff-6e87f7380994 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:26:50.960783 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a1c934-a822-484f-80ff-6e87f7380994 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:26:50.966830 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 653/1305] 10.222.0.43 () {56 vars in 1116 bytes} [Mon Apr 11 16:26:50 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:26:50.973630 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cfa49b-83c5-43c4-9626-ef891869b980 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:26:51.090035 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cfa49b-83c5-43c4-9626-ef891869b980 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:26:51.128848 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414243e4-cc2f-4992-8e67-46c657200afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:26:51.129569 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414243e4-cc2f-4992-8e67-46c657200afb None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:26:51.129870 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414243e4-cc2f-4992-8e67-46c657200afb None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:26:51.130219 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414243e4-cc2f-4992-8e67-46c657200afb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:26:51.131059 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414243e4-cc2f-4992-8e67-46c657200afb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:26:51.132486 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414243e4-cc2f-4992-8e67-46c657200afb None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:26:51.241475 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 653/1306] 10.222.0.43 () {60 vars in 1144 bytes} [Mon Apr 11 16:26:50 2022] POST /identity/v3/endpoints => generated 331 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:34:12.709804 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72adf2a5-a50d-466b-b701-60e55142f91d None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:34:12.710767 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72adf2a5-a50d-466b-b701-60e55142f91d None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:34:12.711287 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72adf2a5-a50d-466b-b701-60e55142f91d None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:34:12.712871 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 654/1307] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:34:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:34:12.719379 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7be7b1-2ed1-4f1b-a3f1-ecadbee1f8d8 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:34:12.720340 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7be7b1-2ed1-4f1b-a3f1-ecadbee1f8d8 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:34:12.720831 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7be7b1-2ed1-4f1b-a3f1-ecadbee1f8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:34:12.821714 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-1b7be7b1-2ed1-4f1b-a3f1-ecadbee1f8d8 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:34:12.823439 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-1b7be7b1-2ed1-4f1b-a3f1-ecadbee1f8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:34:12.964278 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 654/1308] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:34:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:34:13.023532 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc36bb49-7c89-4c13-a5e9-c7850c87b4c7 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:34:13.024029 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc36bb49-7c89-4c13-a5e9-c7850c87b4c7 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:34:13.024773 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc36bb49-7c89-4c13-a5e9-c7850c87b4c7 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:34:13.037471 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 655/1309] 10.222.0.43 () {54 vars in 964 bytes} [Mon Apr 11 16:34:13 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:34:13.047361 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329036a0-e199-4354-93d9-03f15ebe29c3 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:34:13.047879 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329036a0-e199-4354-93d9-03f15ebe29c3 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:34:13.048478 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329036a0-e199-4354-93d9-03f15ebe29c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:34:13.194841 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-329036a0-e199-4354-93d9-03f15ebe29c3 None None] MFA Rules not processed for user `f8c213711e794a1ba47ecf46ecb57769`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:34:13.196221 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-329036a0-e199-4354-93d9-03f15ebe29c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:34:13.287546 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 655/1310] 10.222.0.43 () {58 vars in 1061 bytes} [Mon Apr 11 16:34:13 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:34:13.298592 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc36bb49-7c89-4c13-a5e9-c7850c87b4c7 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:34:13.300835 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-fc36bb49-7c89-4c13-a5e9-c7850c87b4c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:34:13.438947 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc36bb49-7c89-4c13-a5e9-c7850c87b4c7 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:34:13.516679 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8293bdc3-f2b7-4a50-8e9a-8c44c07464e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:34:13.517751 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8293bdc3-f2b7-4a50-8e9a-8c44c07464e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:34:13.518354 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8293bdc3-f2b7-4a50-8e9a-8c44c07464e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:34:13.518853 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8293bdc3-f2b7-4a50-8e9a-8c44c07464e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:34:13.521543 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-8293bdc3-f2b7-4a50-8e9a-8c44c07464e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:34:13.644942 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8293bdc3-f2b7-4a50-8e9a-8c44c07464e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:34:13.647154 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8293bdc3-f2b7-4a50-8e9a-8c44c07464e9 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:34:13.665406 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 656/1311] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:34:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:34:16.324493 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f409dd5-45bd-42a7-8a33-93f543b66f40 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:34:16.325009 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f409dd5-45bd-42a7-8a33-93f543b66f40 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:34:16.325254 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f409dd5-45bd-42a7-8a33-93f543b66f40 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:34:16.327591 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 656/1312] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:34:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:34:16.336125 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72dc3a-38e6-47ba-b9cb-0ef951fc84f1 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:34:16.337049 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72dc3a-38e6-47ba-b9cb-0ef951fc84f1 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:34:16.337337 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72dc3a-38e6-47ba-b9cb-0ef951fc84f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:34:16.411016 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-ec72dc3a-38e6-47ba-b9cb-0ef951fc84f1 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:34:16.412341 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-ec72dc3a-38e6-47ba-b9cb-0ef951fc84f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:34:16.510691 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 657/1313] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:34:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:34:16.552152 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f409dd5-45bd-42a7-8a33-93f543b66f40 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:34:16.553768 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-4f409dd5-45bd-42a7-8a33-93f543b66f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:34:16.660540 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f409dd5-45bd-42a7-8a33-93f543b66f40 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:34:16.738349 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb162e3-5509-4a6e-957d-3c28d6b3a573 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:34:16.739903 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb162e3-5509-4a6e-957d-3c28d6b3a573 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:34:16.740202 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb162e3-5509-4a6e-957d-3c28d6b3a573 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:34:16.740623 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb162e3-5509-4a6e-957d-3c28d6b3a573 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:34:16.742281 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-9fb162e3-5509-4a6e-957d-3c28d6b3a573 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:34:16.867919 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb162e3-5509-4a6e-957d-3c28d6b3a573 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:34:16.869352 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb162e3-5509-4a6e-957d-3c28d6b3a573 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:34:16.890060 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 657/1314] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:34:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:34:19.872697 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db4830d-dcb7-488d-b7ea-a8a02e5417e5 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:34:19.873285 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db4830d-dcb7-488d-b7ea-a8a02e5417e5 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:34:19.873285 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db4830d-dcb7-488d-b7ea-a8a02e5417e5 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:34:19.874671 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 658/1315] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:34:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:34:19.880583 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef7433-a681-4c7b-b84c-0cbccde55368 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:34:19.881021 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef7433-a681-4c7b-b84c-0cbccde55368 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:34:19.881235 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef7433-a681-4c7b-b84c-0cbccde55368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:34:19.945407 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-ceef7433-a681-4c7b-b84c-0cbccde55368 None None] MFA Rules not processed for user `8017d78c60f04cb48bc6bb22afc32115`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:34:19.946614 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ceef7433-a681-4c7b-b84c-0cbccde55368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:34:20.040912 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 658/1316] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:34:19 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:34:20.083452 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db4830d-dcb7-488d-b7ea-a8a02e5417e5 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:34:20.085047 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-0db4830d-dcb7-488d-b7ea-a8a02e5417e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:34:20.183661 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db4830d-dcb7-488d-b7ea-a8a02e5417e5 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:34:20.254937 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12e1040-18aa-4349-9646-e93f91614243 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:34:20.255361 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12e1040-18aa-4349-9646-e93f91614243 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:34:20.255684 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12e1040-18aa-4349-9646-e93f91614243 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:34:20.255993 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12e1040-18aa-4349-9646-e93f91614243 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:34:20.257605 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-c12e1040-18aa-4349-9646-e93f91614243 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:34:20.366961 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12e1040-18aa-4349-9646-e93f91614243 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:34:20.368547 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12e1040-18aa-4349-9646-e93f91614243 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:34:20.387508 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 659/1317] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:34:20 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:34:23.542263 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c919a1f-ee2e-4b14-b4bf-93f6c4d5ca10 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:34:23.542821 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c919a1f-ee2e-4b14-b4bf-93f6c4d5ca10 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:34:23.542821 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c919a1f-ee2e-4b14-b4bf-93f6c4d5ca10 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:34:23.544186 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 659/1318] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:34:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:34:23.549579 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa764d3e-ca50-46b3-b868-d45c19123a9c None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:34:23.549985 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa764d3e-ca50-46b3-b868-d45c19123a9c None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:34:23.550130 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa764d3e-ca50-46b3-b868-d45c19123a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:34:23.612585 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-aa764d3e-ca50-46b3-b868-d45c19123a9c None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:34:23.613811 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-aa764d3e-ca50-46b3-b868-d45c19123a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:34:23.705744 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 660/1319] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:34:23 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:34:23.761586 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40563fdc-1a20-4a87-aca9-46e7746af14b None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:34:23.761878 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40563fdc-1a20-4a87-aca9-46e7746af14b None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:34:23.762157 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40563fdc-1a20-4a87-aca9-46e7746af14b None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:34:23.763539 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 660/1320] 10.222.0.43 () {54 vars in 964 bytes} [Mon Apr 11 16:34:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:34:23.769425 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c5262-d096-4b3d-a6d7-30e8d5cd6e08 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:34:23.769806 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c5262-d096-4b3d-a6d7-30e8d5cd6e08 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:34:23.770139 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c5262-d096-4b3d-a6d7-30e8d5cd6e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:34:23.841469 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-765c5262-d096-4b3d-a6d7-30e8d5cd6e08 None None] MFA Rules not processed for user `f8c213711e794a1ba47ecf46ecb57769`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:34:23.842665 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-765c5262-d096-4b3d-a6d7-30e8d5cd6e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:34:23.916556 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 661/1321] 10.222.0.43 () {58 vars in 1061 bytes} [Mon Apr 11 16:34:23 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:34:23.925902 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40563fdc-1a20-4a87-aca9-46e7746af14b None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:34:23.928075 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-40563fdc-1a20-4a87-aca9-46e7746af14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:34:24.026598 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40563fdc-1a20-4a87-aca9-46e7746af14b None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:34:24.096146 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26202b0b-61c4-46cc-a9f7-7337f14ec073 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:34:24.096792 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26202b0b-61c4-46cc-a9f7-7337f14ec073 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:34:24.097133 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26202b0b-61c4-46cc-a9f7-7337f14ec073 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:34:24.097474 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26202b0b-61c4-46cc-a9f7-7337f14ec073 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:34:24.099711 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-26202b0b-61c4-46cc-a9f7-7337f14ec073 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:34:24.202605 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26202b0b-61c4-46cc-a9f7-7337f14ec073 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:34:24.204194 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26202b0b-61c4-46cc-a9f7-7337f14ec073 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:34:24.224916 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 661/1322] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:34:23 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:34:28.166913 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371fdca0-bf4d-4fbc-aa53-adead172e56b None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:34:28.167451 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371fdca0-bf4d-4fbc-aa53-adead172e56b None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:34:28.167451 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371fdca0-bf4d-4fbc-aa53-adead172e56b None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:34:28.168884 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 662/1323] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:34:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:34:28.174327 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41083b55-e83f-45bf-b14b-3b32514e61e7 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:34:28.174757 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41083b55-e83f-45bf-b14b-3b32514e61e7 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:34:28.175012 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41083b55-e83f-45bf-b14b-3b32514e61e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:34:28.239331 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-41083b55-e83f-45bf-b14b-3b32514e61e7 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:34:28.240580 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-41083b55-e83f-45bf-b14b-3b32514e61e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:34:28.336173 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 662/1324] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:34:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:34:28.373094 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371fdca0-bf4d-4fbc-aa53-adead172e56b None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:34:28.374628 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-371fdca0-bf4d-4fbc-aa53-adead172e56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:34:28.476852 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371fdca0-bf4d-4fbc-aa53-adead172e56b None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:34:28.570281 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0855d8be-0378-44f4-8c03-aa919f24d3c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:34:28.570943 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0855d8be-0378-44f4-8c03-aa919f24d3c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:34:28.571229 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0855d8be-0378-44f4-8c03-aa919f24d3c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:34:28.571506 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0855d8be-0378-44f4-8c03-aa919f24d3c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:34:28.573194 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-0855d8be-0378-44f4-8c03-aa919f24d3c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:34:28.680292 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0855d8be-0378-44f4-8c03-aa919f24d3c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:34:28.682244 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0855d8be-0378-44f4-8c03-aa919f24d3c3 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:34:28.700206 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 663/1325] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:34:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:34:31.113083 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66642d2a-c6ba-410b-bf0c-8af94220966e None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:34:31.114266 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66642d2a-c6ba-410b-bf0c-8af94220966e None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:34:31.114404 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66642d2a-c6ba-410b-bf0c-8af94220966e None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:34:31.115912 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 663/1326] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:34:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:34:31.121073 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df36aba-1b5d-4c37-9142-4594f4084d08 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:34:31.121502 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df36aba-1b5d-4c37-9142-4594f4084d08 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:34:31.121666 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df36aba-1b5d-4c37-9142-4594f4084d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:34:31.188107 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-9df36aba-1b5d-4c37-9142-4594f4084d08 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:34:31.189317 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-9df36aba-1b5d-4c37-9142-4594f4084d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:34:31.290109 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 664/1327] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:34:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:34:31.328557 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66642d2a-c6ba-410b-bf0c-8af94220966e None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:34:31.330077 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-66642d2a-c6ba-410b-bf0c-8af94220966e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:34:31.433272 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66642d2a-c6ba-410b-bf0c-8af94220966e None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:34:31.507171 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33132b85-6d59-43ae-b1dc-937770a86ba9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:34:31.507889 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33132b85-6d59-43ae-b1dc-937770a86ba9 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:34:31.508211 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33132b85-6d59-43ae-b1dc-937770a86ba9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:34:31.508515 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33132b85-6d59-43ae-b1dc-937770a86ba9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:34:31.510289 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-33132b85-6d59-43ae-b1dc-937770a86ba9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:34:31.616648 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33132b85-6d59-43ae-b1dc-937770a86ba9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:34:31.618083 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33132b85-6d59-43ae-b1dc-937770a86ba9 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:34:31.635693 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 664/1328] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:34:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:34:34.052049 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b252f2f-f0e9-421e-b321-4cf6068f32b4 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:34:34.052589 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b252f2f-f0e9-421e-b321-4cf6068f32b4 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:34:34.052589 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b252f2f-f0e9-421e-b321-4cf6068f32b4 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:34:34.054018 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 665/1329] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:34:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:34:34.059537 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8579d-7250-44e9-b105-3e5632e1a91f None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:34:34.059940 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8579d-7250-44e9-b105-3e5632e1a91f None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:34:34.060199 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8579d-7250-44e9-b105-3e5632e1a91f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:34:34.124340 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-87e8579d-7250-44e9-b105-3e5632e1a91f None None] MFA Rules not processed for user `8017d78c60f04cb48bc6bb22afc32115`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:34:34.125550 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-87e8579d-7250-44e9-b105-3e5632e1a91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:34:34.225192 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 665/1330] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:34:34 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:34:34.263488 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b252f2f-f0e9-421e-b321-4cf6068f32b4 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:34:34.265138 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-4b252f2f-f0e9-421e-b321-4cf6068f32b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:34:34.378115 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b252f2f-f0e9-421e-b321-4cf6068f32b4 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:34:34.454290 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553940b5-ef68-470c-9d70-329bbb5dbc0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:34:34.454946 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553940b5-ef68-470c-9d70-329bbb5dbc0f service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:34:34.455235 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553940b5-ef68-470c-9d70-329bbb5dbc0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:34:34.455547 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553940b5-ef68-470c-9d70-329bbb5dbc0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:34:34.457218 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-553940b5-ef68-470c-9d70-329bbb5dbc0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:34:34.569211 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553940b5-ef68-470c-9d70-329bbb5dbc0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:34:34.570649 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553940b5-ef68-470c-9d70-329bbb5dbc0f service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:34:34.588519 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 666/1331] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:34:34 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:34:37.392358 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d2657-0ff4-4dac-a8fe-eb6de4e39152 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:34:37.392883 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d2657-0ff4-4dac-a8fe-eb6de4e39152 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:34:37.392883 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d2657-0ff4-4dac-a8fe-eb6de4e39152 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:34:37.394389 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 666/1332] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:34:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:34:37.400731 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee1db6c-d9d9-46c1-8c15-c72900e48837 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:34:37.401247 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee1db6c-d9d9-46c1-8c15-c72900e48837 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:34:37.401340 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee1db6c-d9d9-46c1-8c15-c72900e48837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:34:37.476469 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-3ee1db6c-d9d9-46c1-8c15-c72900e48837 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:34:37.477703 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-3ee1db6c-d9d9-46c1-8c15-c72900e48837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:34:37.601384 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 667/1333] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:34:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:34:37.644510 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4d2657-0ff4-4dac-a8fe-eb6de4e39152 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:34:37.646672 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ef4d2657-0ff4-4dac-a8fe-eb6de4e39152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:34:37.774667 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4d2657-0ff4-4dac-a8fe-eb6de4e39152 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:34:37.862535 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee7921c-5e33-4ada-93c3-fe12637675ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:34:37.863232 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7921c-5e33-4ada-93c3-fe12637675ed service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:34:37.863699 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7921c-5e33-4ada-93c3-fe12637675ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:34:37.873649 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7921c-5e33-4ada-93c3-fe12637675ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:34:37.873649 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-5ee7921c-5e33-4ada-93c3-fe12637675ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:34:37.983089 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee7921c-5e33-4ada-93c3-fe12637675ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:34:37.984568 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee7921c-5e33-4ada-93c3-fe12637675ed service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:34:38.007546 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 667/1334] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:34:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:34:40.438961 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cebb6d8-7fd3-4087-a8a3-b588a3616072 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:34:40.439551 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cebb6d8-7fd3-4087-a8a3-b588a3616072 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:34:40.439551 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cebb6d8-7fd3-4087-a8a3-b588a3616072 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:34:40.441181 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 668/1335] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:34:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:34:40.446620 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d572ef69-002e-444a-8f82-a35ca6229658 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:34:40.447071 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d572ef69-002e-444a-8f82-a35ca6229658 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:34:40.447171 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d572ef69-002e-444a-8f82-a35ca6229658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:34:40.509253 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-d572ef69-002e-444a-8f82-a35ca6229658 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:34:40.510447 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-d572ef69-002e-444a-8f82-a35ca6229658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:34:40.603950 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 668/1336] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:34:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:34:40.644422 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cebb6d8-7fd3-4087-a8a3-b588a3616072 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:34:40.646656 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-1cebb6d8-7fd3-4087-a8a3-b588a3616072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:34:40.753679 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cebb6d8-7fd3-4087-a8a3-b588a3616072 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:34:40.827387 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4febd0d-6bc5-4b3a-a5a5-f975fc05aa07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:34:40.828074 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4febd0d-6bc5-4b3a-a5a5-f975fc05aa07 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:34:40.828358 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4febd0d-6bc5-4b3a-a5a5-f975fc05aa07 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:34:40.828634 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4febd0d-6bc5-4b3a-a5a5-f975fc05aa07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:34:40.830276 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-c4febd0d-6bc5-4b3a-a5a5-f975fc05aa07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:34:40.940697 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4febd0d-6bc5-4b3a-a5a5-f975fc05aa07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:34:40.942964 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4febd0d-6bc5-4b3a-a5a5-f975fc05aa07 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:34:40.961250 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 669/1337] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:34:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:34:44.040787 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13366edf-1036-49b3-b2c4-79eee1bd787a None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:34:44.041343 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13366edf-1036-49b3-b2c4-79eee1bd787a None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:34:44.041487 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13366edf-1036-49b3-b2c4-79eee1bd787a None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:34:44.042847 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 669/1338] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:34:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:34:44.048151 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce27ef-4c8a-4f7f-a3f7-5bea58174c6d None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:34:44.048538 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce27ef-4c8a-4f7f-a3f7-5bea58174c6d None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:34:44.048715 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce27ef-4c8a-4f7f-a3f7-5bea58174c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:34:44.118675 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-4fce27ef-4c8a-4f7f-a3f7-5bea58174c6d None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:34:44.119925 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-4fce27ef-4c8a-4f7f-a3f7-5bea58174c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:34:44.221887 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 670/1339] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:34:44 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:34:44.257648 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13366edf-1036-49b3-b2c4-79eee1bd787a None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:34:44.259832 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-13366edf-1036-49b3-b2c4-79eee1bd787a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:34:44.352907 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13366edf-1036-49b3-b2c4-79eee1bd787a None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:34:44.356648 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a3f40-3006-43e8-83fa-cdd7cc7a5ae4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:34:44.357345 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a3f40-3006-43e8-83fa-cdd7cc7a5ae4 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:34:44.357628 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a3f40-3006-43e8-83fa-cdd7cc7a5ae4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:34:44.357902 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a3f40-3006-43e8-83fa-cdd7cc7a5ae4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:34:44.368687 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1a3f40-3006-43e8-83fa-cdd7cc7a5ae4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:34:44.370158 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1a3f40-3006-43e8-83fa-cdd7cc7a5ae4 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:34:44.379897 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 670/1340] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:34:44 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 16:34:49.038023 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8996a6b-d943-4a9c-844d-f687a922bf6e None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:34:49.038883 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8996a6b-d943-4a9c-844d-f687a922bf6e None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:34:49.039168 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8996a6b-d943-4a9c-844d-f687a922bf6e None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:34:49.042384 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 671/1341] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:34:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:34:49.048742 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04e63f8-145d-4cf3-b4c7-e97e1722833a None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:34:49.049256 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04e63f8-145d-4cf3-b4c7-e97e1722833a None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:34:49.049337 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04e63f8-145d-4cf3-b4c7-e97e1722833a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:34:49.083682 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-a04e63f8-145d-4cf3-b4c7-e97e1722833a None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:34:49.085243 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a04e63f8-145d-4cf3-b4c7-e97e1722833a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:34:49.166248 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 671/1342] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:34:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:34:49.206184 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8996a6b-d943-4a9c-844d-f687a922bf6e None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:34:49.217080 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8996a6b-d943-4a9c-844d-f687a922bf6e None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:34:49.220621 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8f0037-52df-4a5a-87c4-31568db8b13f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:34:49.223318 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f0037-52df-4a5a-87c4-31568db8b13f service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:34:49.223318 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f0037-52df-4a5a-87c4-31568db8b13f service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:34:49.223318 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f0037-52df-4a5a-87c4-31568db8b13f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:34:49.232097 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8f0037-52df-4a5a-87c4-31568db8b13f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:34:49.233513 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8f0037-52df-4a5a-87c4-31568db8b13f service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:34:49.243808 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 672/1343] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:34:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:34:52.572703 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd4c2d-727d-4e8a-8c0c-088cc528f1ca None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:34:52.573252 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd4c2d-727d-4e8a-8c0c-088cc528f1ca None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:34:52.573252 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd4c2d-727d-4e8a-8c0c-088cc528f1ca None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:34:52.574531 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 672/1344] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:34:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:34:52.579703 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb300fae-2037-471d-8b4f-ee17eec1df1c None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:34:52.580151 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb300fae-2037-471d-8b4f-ee17eec1df1c None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:34:52.580390 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb300fae-2037-471d-8b4f-ee17eec1df1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:34:52.597613 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-cb300fae-2037-471d-8b4f-ee17eec1df1c None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:34:52.598863 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-cb300fae-2037-471d-8b4f-ee17eec1df1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:34:52.606589 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 673/1345] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:34:52 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:34:52.644741 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abd4c2d-727d-4e8a-8c0c-088cc528f1ca None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:34:52.655531 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abd4c2d-727d-4e8a-8c0c-088cc528f1ca None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:34:52.659159 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bb6292-8e2b-4864-ab49-cc14a9b2777b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:34:52.659853 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb6292-8e2b-4864-ab49-cc14a9b2777b service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:34:52.660825 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb6292-8e2b-4864-ab49-cc14a9b2777b service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:34:52.661115 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb6292-8e2b-4864-ab49-cc14a9b2777b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:34:52.670099 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bb6292-8e2b-4864-ab49-cc14a9b2777b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:34:52.671537 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bb6292-8e2b-4864-ab49-cc14a9b2777b service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:34:52.681697 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 673/1346] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:34:52 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:34:57.445833 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b47f8-ac04-47cb-9d64-e11f1c59e8b7 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:34:57.446410 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b47f8-ac04-47cb-9d64-e11f1c59e8b7 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:34:57.446410 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b47f8-ac04-47cb-9d64-e11f1c59e8b7 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:34:57.447785 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 674/1347] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:34:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:34:57.453389 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764743d2-4ad1-4c67-9a06-4a3be0de6d2e None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:34:57.453835 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764743d2-4ad1-4c67-9a06-4a3be0de6d2e None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:34:57.453951 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764743d2-4ad1-4c67-9a06-4a3be0de6d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:34:57.473867 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-764743d2-4ad1-4c67-9a06-4a3be0de6d2e None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:34:57.475360 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-764743d2-4ad1-4c67-9a06-4a3be0de6d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:34:57.490178 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 674/1348] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:34:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:34:57.530387 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b47f8-ac04-47cb-9d64-e11f1c59e8b7 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:34:57.542337 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b47f8-ac04-47cb-9d64-e11f1c59e8b7 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:34:57.545779 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4441c62-a454-4db9-aa8d-546dc8724d92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:34:57.546415 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4441c62-a454-4db9-aa8d-546dc8724d92 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:34:57.546694 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4441c62-a454-4db9-aa8d-546dc8724d92 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:34:57.546969 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4441c62-a454-4db9-aa8d-546dc8724d92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:34:57.558848 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4441c62-a454-4db9-aa8d-546dc8724d92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:34:57.560673 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4441c62-a454-4db9-aa8d-546dc8724d92 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:34:57.572936 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 675/1349] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:34:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:35:03.269919 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb0f60c-13ce-469e-9ea8-f613ef3ebb6f None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:35:03.270740 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb0f60c-13ce-469e-9ea8-f613ef3ebb6f None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:35:03.271323 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb0f60c-13ce-469e-9ea8-f613ef3ebb6f None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:35:03.273545 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 675/1350] 10.222.0.43 () {54 vars in 921 bytes} [Mon Apr 11 16:35:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 16:35:03.279269 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ca395-8b6e-4e66-bcb9-746f286c5bd9 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:35:03.279862 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ca395-8b6e-4e66-bcb9-746f286c5bd9 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:35:03.280210 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ca395-8b6e-4e66-bcb9-746f286c5bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:35:03.358220 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-a59ca395-8b6e-4e66-bcb9-746f286c5bd9 None None] MFA Rules not processed for user `6589debd41bf496085c7339ab5409666`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:35:03.359846 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-a59ca395-8b6e-4e66-bcb9-746f286c5bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:35:03.446921 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 676/1351] 10.222.0.43 () {58 vars in 1018 bytes} [Mon Apr 11 16:35:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:35:08.079837 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b30fa6-7cc3-4481-9ac3-87b35fd60c61 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:35:08.080597 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b30fa6-7cc3-4481-9ac3-87b35fd60c61 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:35:08.081258 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b30fa6-7cc3-4481-9ac3-87b35fd60c61 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:35:08.082954 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 676/1352] 10.222.0.43 () {54 vars in 921 bytes} [Mon Apr 11 16:35:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:35:08.088139 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ee29a-d833-4d6d-8009-5900dbf259e2 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:35:08.088633 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ee29a-d833-4d6d-8009-5900dbf259e2 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:35:08.088734 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ee29a-d833-4d6d-8009-5900dbf259e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:35:08.107358 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-e67ee29a-d833-4d6d-8009-5900dbf259e2 None None] MFA Rules not processed for user `6589debd41bf496085c7339ab5409666`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:35:08.108623 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-e67ee29a-d833-4d6d-8009-5900dbf259e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:35:08.118046 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 677/1353] 10.222.0.43 () {58 vars in 1018 bytes} [Mon Apr 11 16:35:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:35:09.591555 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c36a0f-7dc1-4281-a2f7-16c2941193c5 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:35:09.592096 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c36a0f-7dc1-4281-a2f7-16c2941193c5 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:35:09.592096 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c36a0f-7dc1-4281-a2f7-16c2941193c5 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:35:09.593462 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 677/1354] 10.222.0.43 () {54 vars in 921 bytes} [Mon Apr 11 16:35:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:35:09.599679 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afbe295-9d66-45c5-a033-b34e56ccfc1d None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:35:09.600202 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afbe295-9d66-45c5-a033-b34e56ccfc1d None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:35:09.600307 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afbe295-9d66-45c5-a033-b34e56ccfc1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:35:09.619130 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-0afbe295-9d66-45c5-a033-b34e56ccfc1d None None] MFA Rules not processed for user `6589debd41bf496085c7339ab5409666`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:35:09.620363 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-0afbe295-9d66-45c5-a033-b34e56ccfc1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:35:09.629346 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 678/1355] 10.222.0.43 () {58 vars in 1018 bytes} [Mon Apr 11 16:35:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:35:13.662268 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3080ca21-2246-4658-96a3-87bd8794ba83 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:35:13.662806 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3080ca21-2246-4658-96a3-87bd8794ba83 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:35:13.662806 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3080ca21-2246-4658-96a3-87bd8794ba83 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:35:13.667155 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 678/1356] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:35:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:35:13.669415 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcac2b1-87ad-4d3e-89fa-f74066d044f7 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:35:13.670187 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcac2b1-87ad-4d3e-89fa-f74066d044f7 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:35:13.670467 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcac2b1-87ad-4d3e-89fa-f74066d044f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:35:13.692196 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-9fcac2b1-87ad-4d3e-89fa-f74066d044f7 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:35:13.694014 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-9fcac2b1-87ad-4d3e-89fa-f74066d044f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:35:13.703580 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 679/1357] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:35:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:35:13.753084 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ced3e-fd58-4634-bad5-7369ae60bebf None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:35:13.754272 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ced3e-fd58-4634-bad5-7369ae60bebf None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:35:13.754728 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ced3e-fd58-4634-bad5-7369ae60bebf None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:35:13.756446 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 679/1358] 10.222.0.43 () {54 vars in 960 bytes} [Mon Apr 11 16:35:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:35:13.761931 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11147a-a611-480f-86a0-9f7d0c4ee5f1 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:35:13.762228 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11147a-a611-480f-86a0-9f7d0c4ee5f1 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:35:13.762512 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11147a-a611-480f-86a0-9f7d0c4ee5f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:35:13.814163 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-8f11147a-a611-480f-86a0-9f7d0c4ee5f1 None None] MFA Rules not processed for user `1be2652c984a4283aeee0b937f0555e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:35:13.816457 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-8f11147a-a611-480f-86a0-9f7d0c4ee5f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:35:13.898931 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 680/1359] 10.222.0.43 () {58 vars in 1057 bytes} [Mon Apr 11 16:35:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:35:13.906842 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3ced3e-fd58-4634-bad5-7369ae60bebf None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:35:13.923410 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3ced3e-fd58-4634-bad5-7369ae60bebf None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:35:13.930539 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a2e527-1dfe-4581-99bd-fe9dc5e4daf0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1be2652c984a4283aeee0b937f0555e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:35:13.931215 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a2e527-1dfe-4581-99bd-fe9dc5e4daf0 service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:35:13.931500 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a2e527-1dfe-4581-99bd-fe9dc5e4daf0 service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:35:13.931803 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a2e527-1dfe-4581-99bd-fe9dc5e4daf0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:35:13.942401 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a2e527-1dfe-4581-99bd-fe9dc5e4daf0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:35:13.942663 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a2e527-1dfe-4581-99bd-fe9dc5e4daf0 service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:35:13.953380 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 680/1360] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:35:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 16:35:16.538270 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d386a8-88ff-4ff4-9186-e9bcb719342c None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:35:16.538820 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d386a8-88ff-4ff4-9186-e9bcb719342c None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:35:16.538820 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d386a8-88ff-4ff4-9186-e9bcb719342c None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:35:16.540229 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 681/1361] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:35:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 16:35:16.545377 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc545388-0dfc-4a3a-9e60-195269c857f2 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:35:16.546149 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc545388-0dfc-4a3a-9e60-195269c857f2 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:35:16.546591 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc545388-0dfc-4a3a-9e60-195269c857f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:35:16.564233 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-fc545388-0dfc-4a3a-9e60-195269c857f2 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:35:16.565346 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-fc545388-0dfc-4a3a-9e60-195269c857f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:35:16.574169 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 681/1362] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:35:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:35:16.619755 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d386a8-88ff-4ff4-9186-e9bcb719342c None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:35:16.634293 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d386a8-88ff-4ff4-9186-e9bcb719342c None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:35:16.639903 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ac6856-9b5d-4faa-8ed9-89ef95520750 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1be2652c984a4283aeee0b937f0555e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:35:16.640731 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac6856-9b5d-4faa-8ed9-89ef95520750 service nova] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:35:16.641185 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac6856-9b5d-4faa-8ed9-89ef95520750 service nova] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:35:16.641625 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac6856-9b5d-4faa-8ed9-89ef95520750 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:35:16.650614 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ac6856-9b5d-4faa-8ed9-89ef95520750 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:35:16.652402 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ac6856-9b5d-4faa-8ed9-89ef95520750 service nova] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:35:16.663089 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 682/1363] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:35:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:35:19.478573 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089c3d8-befc-4a77-aa2e-dee5f7ae221c None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:35:19.478971 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089c3d8-befc-4a77-aa2e-dee5f7ae221c None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:35:19.479185 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089c3d8-befc-4a77-aa2e-dee5f7ae221c None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:35:19.480874 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 682/1364] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:35:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:35:19.485894 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83f4d8-4cb1-4015-87f0-98439ed910c0 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:35:19.486296 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83f4d8-4cb1-4015-87f0-98439ed910c0 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:35:19.486450 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83f4d8-4cb1-4015-87f0-98439ed910c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:35:19.507922 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-3d83f4d8-4cb1-4015-87f0-98439ed910c0 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:35:19.509141 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-3d83f4d8-4cb1-4015-87f0-98439ed910c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:35:19.517249 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 683/1365] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:35:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:35:19.563609 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba2324-7d62-4a65-b8e3-218365f4809f None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:35:19.563899 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba2324-7d62-4a65-b8e3-218365f4809f None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:35:19.564178 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba2324-7d62-4a65-b8e3-218365f4809f None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:35:19.566502 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 683/1366] 10.222.0.43 () {54 vars in 960 bytes} [Mon Apr 11 16:35:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:35:19.572281 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8551711a-06a7-44dd-9049-53ede72be3e2 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:35:19.572788 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8551711a-06a7-44dd-9049-53ede72be3e2 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:35:19.573292 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8551711a-06a7-44dd-9049-53ede72be3e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:35:19.592185 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-8551711a-06a7-44dd-9049-53ede72be3e2 None None] MFA Rules not processed for user `1be2652c984a4283aeee0b937f0555e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:35:19.593412 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-8551711a-06a7-44dd-9049-53ede72be3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:35:19.602829 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 684/1367] 10.222.0.43 () {58 vars in 1057 bytes} [Mon Apr 11 16:35:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:35:19.611119 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ba2324-7d62-4a65-b8e3-218365f4809f None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:35:19.625809 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ba2324-7d62-4a65-b8e3-218365f4809f None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:35:19.631944 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a63e1fe-4590-4db7-9988-77408b074ab3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1be2652c984a4283aeee0b937f0555e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:35:19.632645 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63e1fe-4590-4db7-9988-77408b074ab3 service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:35:19.633015 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63e1fe-4590-4db7-9988-77408b074ab3 service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:35:19.633357 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63e1fe-4590-4db7-9988-77408b074ab3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:35:19.641336 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a63e1fe-4590-4db7-9988-77408b074ab3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:35:19.642889 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a63e1fe-4590-4db7-9988-77408b074ab3 service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:35:19.656029 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 684/1368] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:35:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:35:22.214802 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9824756b-4222-4e3e-a26e-645523b1dea0 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:35:22.215400 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9824756b-4222-4e3e-a26e-645523b1dea0 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:35:22.215400 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9824756b-4222-4e3e-a26e-645523b1dea0 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:35:22.216743 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 685/1369] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:35:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:35:22.222985 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d4d4cb-ed70-4fb3-ac29-a6540b6dd200 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:35:22.223871 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d4d4cb-ed70-4fb3-ac29-a6540b6dd200 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:35:22.224148 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d4d4cb-ed70-4fb3-ac29-a6540b6dd200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:35:22.242553 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-30d4d4cb-ed70-4fb3-ac29-a6540b6dd200 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:35:22.243786 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-30d4d4cb-ed70-4fb3-ac29-a6540b6dd200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:35:22.251729 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 685/1370] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:35:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:35:22.396836 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ebfff6-4c23-44f3-82fc-a8e75e9f00e9 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:35:22.397124 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ebfff6-4c23-44f3-82fc-a8e75e9f00e9 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:35:22.397594 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ebfff6-4c23-44f3-82fc-a8e75e9f00e9 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:35:22.398975 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 686/1371] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:35:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:35:22.404878 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c8e8c-aaf1-473d-80da-936673961c46 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:35:22.410198 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c8e8c-aaf1-473d-80da-936673961c46 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:35:22.410198 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c8e8c-aaf1-473d-80da-936673961c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:35:22.423581 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-192c8e8c-aaf1-473d-80da-936673961c46 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:35:22.424822 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-192c8e8c-aaf1-473d-80da-936673961c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:35:22.433511 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 686/1372] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:35:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:35:22.482280 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ebfff6-4c23-44f3-82fc-a8e75e9f00e9 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:35:22.497697 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ebfff6-4c23-44f3-82fc-a8e75e9f00e9 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:35:22.510376 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e8436e-8aa3-43f6-9bbf-4c5488c4080d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1be2652c984a4283aeee0b937f0555e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:35:22.511041 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e8436e-8aa3-43f6-9bbf-4c5488c4080d service nova] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:35:22.511325 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e8436e-8aa3-43f6-9bbf-4c5488c4080d service nova] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:35:22.511633 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e8436e-8aa3-43f6-9bbf-4c5488c4080d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:35:22.521206 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e8436e-8aa3-43f6-9bbf-4c5488c4080d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:35:22.522925 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e8436e-8aa3-43f6-9bbf-4c5488c4080d service nova] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:35:22.533244 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 687/1373] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:35:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 16:35:22.566348 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fcb383-c55d-4b30-9d1e-4b6447d758a8 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:35:22.566348 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fcb383-c55d-4b30-9d1e-4b6447d758a8 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:35:22.568240 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fcb383-c55d-4b30-9d1e-4b6447d758a8 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:35:22.569613 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 687/1374] 10.222.0.43 () {54 vars in 962 bytes} [Mon Apr 11 16:35:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:35:22.574765 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e598b0-2050-4831-a302-c8368ac41e7c None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:35:22.575058 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e598b0-2050-4831-a302-c8368ac41e7c None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:35:22.575371 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e598b0-2050-4831-a302-c8368ac41e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:35:22.623438 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-97e598b0-2050-4831-a302-c8368ac41e7c None None] MFA Rules not processed for user `950b5b5f690d41509ead753065a0b793`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:35:22.624670 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-97e598b0-2050-4831-a302-c8368ac41e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:35:22.692512 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 688/1375] 10.222.0.43 () {58 vars in 1059 bytes} [Mon Apr 11 16:35:22 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:35:22.700576 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fcb383-c55d-4b30-9d1e-4b6447d758a8 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:35:22.713268 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fcb383-c55d-4b30-9d1e-4b6447d758a8 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:35:22.716868 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc5331e-3848-4e91-906c-e9ab28fc96aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '950b5b5f690d41509ead753065a0b793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:35:22.717467 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5331e-3848-4e91-906c-e9ab28fc96aa service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:35:22.717785 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5331e-3848-4e91-906c-e9ab28fc96aa service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:35:22.718063 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5331e-3848-4e91-906c-e9ab28fc96aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:35:22.727507 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc5331e-3848-4e91-906c-e9ab28fc96aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:35:22.728946 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc5331e-3848-4e91-906c-e9ab28fc96aa service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:35:22.738609 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 688/1376] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:35:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 16:35:25.157904 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015153c4-9bce-4cb7-a812-3bef163efe5a None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:35:25.158398 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015153c4-9bce-4cb7-a812-3bef163efe5a None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:35:25.158485 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015153c4-9bce-4cb7-a812-3bef163efe5a None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:35:25.160750 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 689/1377] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:35:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:35:25.167030 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4e1a2-7dca-4c98-b458-55437ba6ec48 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:35:25.167574 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4e1a2-7dca-4c98-b458-55437ba6ec48 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:35:25.168079 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4e1a2-7dca-4c98-b458-55437ba6ec48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:35:25.188368 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-18f4e1a2-7dca-4c98-b458-55437ba6ec48 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:35:25.189611 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-18f4e1a2-7dca-4c98-b458-55437ba6ec48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:35:25.199542 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 689/1378] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:35:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:35:25.245285 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015153c4-9bce-4cb7-a812-3bef163efe5a None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:35:25.262754 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015153c4-9bce-4cb7-a812-3bef163efe5a None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:35:25.268183 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe1a2f1-1ab5-4e0a-a6ea-84ee78da2798 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1be2652c984a4283aeee0b937f0555e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:35:25.268905 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1a2f1-1ab5-4e0a-a6ea-84ee78da2798 service nova] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:35:25.269191 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1a2f1-1ab5-4e0a-a6ea-84ee78da2798 service nova] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:35:25.269470 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1a2f1-1ab5-4e0a-a6ea-84ee78da2798 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:35:25.278095 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe1a2f1-1ab5-4e0a-a6ea-84ee78da2798 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:35:25.279848 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe1a2f1-1ab5-4e0a-a6ea-84ee78da2798 service nova] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:35:25.290330 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 690/1379] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:35:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:35:27.817883 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9af568-691b-4ace-a2d0-e43d8125c8a4 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:35:27.818389 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9af568-691b-4ace-a2d0-e43d8125c8a4 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:35:27.818656 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9af568-691b-4ace-a2d0-e43d8125c8a4 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:35:27.820070 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 690/1380] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:35:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:35:27.825517 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab863514-2ed6-466d-8183-ee035e8883bf None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:35:27.825971 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab863514-2ed6-466d-8183-ee035e8883bf None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:35:27.826259 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab863514-2ed6-466d-8183-ee035e8883bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:35:27.845569 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-ab863514-2ed6-466d-8183-ee035e8883bf None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:35:27.847921 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-ab863514-2ed6-466d-8183-ee035e8883bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:35:27.855940 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 691/1381] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:35:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:35:27.902458 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9af568-691b-4ace-a2d0-e43d8125c8a4 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:35:27.918275 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9af568-691b-4ace-a2d0-e43d8125c8a4 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:35:27.924006 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7967395c-c758-4db1-842c-725e857fbaa4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1be2652c984a4283aeee0b937f0555e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:35:27.925296 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7967395c-c758-4db1-842c-725e857fbaa4 service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:35:27.926313 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7967395c-c758-4db1-842c-725e857fbaa4 service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:35:27.926673 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7967395c-c758-4db1-842c-725e857fbaa4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:35:27.935369 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7967395c-c758-4db1-842c-725e857fbaa4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:35:27.937141 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7967395c-c758-4db1-842c-725e857fbaa4 service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:35:27.948135 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 691/1382] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:35:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:35:30.559637 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6d583-cff8-42f6-a120-6bc0211783f5 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:35:30.560202 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6d583-cff8-42f6-a120-6bc0211783f5 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:35:30.560202 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6d583-cff8-42f6-a120-6bc0211783f5 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:35:30.561697 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 692/1383] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:35:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:35:30.569002 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95f532-983b-4111-86aa-1e88d539b028 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:35:30.569555 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95f532-983b-4111-86aa-1e88d539b028 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:35:30.569555 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95f532-983b-4111-86aa-1e88d539b028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:35:30.589202 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-4f95f532-983b-4111-86aa-1e88d539b028 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:35:30.590454 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-4f95f532-983b-4111-86aa-1e88d539b028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:35:30.602970 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 692/1384] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:35:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:35:30.641589 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd6d583-cff8-42f6-a120-6bc0211783f5 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:35:30.657232 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd6d583-cff8-42f6-a120-6bc0211783f5 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:35:30.663113 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f315e392-b681-4ab9-afb3-127e8f0f6986 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1be2652c984a4283aeee0b937f0555e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:35:30.663901 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f315e392-b681-4ab9-afb3-127e8f0f6986 service nova] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:35:30.664286 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f315e392-b681-4ab9-afb3-127e8f0f6986 service nova] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:35:30.664664 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f315e392-b681-4ab9-afb3-127e8f0f6986 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:35:30.673517 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f315e392-b681-4ab9-afb3-127e8f0f6986 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:35:30.675776 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f315e392-b681-4ab9-afb3-127e8f0f6986 service nova] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:35:30.686336 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 693/1385] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:35:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:35:33.012222 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea9576-14fe-453b-8074-07887bba78bd None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:35:33.013335 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea9576-14fe-453b-8074-07887bba78bd None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:35:33.013335 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea9576-14fe-453b-8074-07887bba78bd None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:35:33.014262 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 693/1386] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:35:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:35:33.021525 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5278ade5-ecbf-4c05-af8a-39509bb80456 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:35:33.022071 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5278ade5-ecbf-4c05-af8a-39509bb80456 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:35:33.022166 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5278ade5-ecbf-4c05-af8a-39509bb80456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:35:33.041154 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-5278ade5-ecbf-4c05-af8a-39509bb80456 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:35:33.042420 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-5278ade5-ecbf-4c05-af8a-39509bb80456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:35:33.051542 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 694/1387] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:35:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:35:33.104352 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea9576-14fe-453b-8074-07887bba78bd None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:35:33.119792 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea9576-14fe-453b-8074-07887bba78bd None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:35:33.125830 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4b0a6d-cb30-45cd-bb5b-d928918cf242 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1be2652c984a4283aeee0b937f0555e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:35:33.126300 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4b0a6d-cb30-45cd-bb5b-d928918cf242 service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:35:33.126579 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4b0a6d-cb30-45cd-bb5b-d928918cf242 service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:35:33.126849 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4b0a6d-cb30-45cd-bb5b-d928918cf242 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:35:33.135768 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4b0a6d-cb30-45cd-bb5b-d928918cf242 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:35:33.137443 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4b0a6d-cb30-45cd-bb5b-d928918cf242 service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:35:33.148748 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 694/1388] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:35:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:35:35.723758 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05df7a9-eecc-4594-881d-b0fe38941441 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:35:35.724429 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05df7a9-eecc-4594-881d-b0fe38941441 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:35:35.724429 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05df7a9-eecc-4594-881d-b0fe38941441 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:35:35.725697 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 695/1389] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:35:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 16:35:35.731975 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325ae77-d788-4271-8eb1-0ce4c3fe04d2 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:35:35.732492 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325ae77-d788-4271-8eb1-0ce4c3fe04d2 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:35:35.732649 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325ae77-d788-4271-8eb1-0ce4c3fe04d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:35:35.755680 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-d325ae77-d788-4271-8eb1-0ce4c3fe04d2 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:35:35.756910 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-d325ae77-d788-4271-8eb1-0ce4c3fe04d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:35:35.766444 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 695/1390] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:35:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:35:35.824246 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05df7a9-eecc-4594-881d-b0fe38941441 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:35:35.840503 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05df7a9-eecc-4594-881d-b0fe38941441 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:35:35.846372 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd6afaa-dc59-46be-8da4-6a5083d114f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1be2652c984a4283aeee0b937f0555e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:35:35.847163 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6afaa-dc59-46be-8da4-6a5083d114f9 service nova] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:35:35.847535 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6afaa-dc59-46be-8da4-6a5083d114f9 service nova] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:35:35.847900 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6afaa-dc59-46be-8da4-6a5083d114f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:35:35.856970 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd6afaa-dc59-46be-8da4-6a5083d114f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:35:35.858562 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd6afaa-dc59-46be-8da4-6a5083d114f9 service nova] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:35:35.869300 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 696/1391] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:35:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:35:38.481860 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb3391-9458-46f9-bb35-291b1541cd4b None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:35:38.482393 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb3391-9458-46f9-bb35-291b1541cd4b None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:35:38.482604 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb3391-9458-46f9-bb35-291b1541cd4b None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:35:38.484055 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 696/1392] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:35:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:35:38.489765 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb47c66-eea2-432a-96f3-8777f7dfc708 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:35:38.490252 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb47c66-eea2-432a-96f3-8777f7dfc708 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:35:38.490463 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb47c66-eea2-432a-96f3-8777f7dfc708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:35:38.508746 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-cbb47c66-eea2-432a-96f3-8777f7dfc708 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:35:38.509962 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-cbb47c66-eea2-432a-96f3-8777f7dfc708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:35:38.523871 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 697/1393] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:35:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:35:38.570526 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cb3391-9458-46f9-bb35-291b1541cd4b None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:35:38.585420 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cb3391-9458-46f9-bb35-291b1541cd4b None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:35:38.590903 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e170bf5c-647c-4b34-afe2-2e95f0049eec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1be2652c984a4283aeee0b937f0555e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:35:38.591590 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e170bf5c-647c-4b34-afe2-2e95f0049eec service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:35:38.591883 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e170bf5c-647c-4b34-afe2-2e95f0049eec service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:35:38.592168 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e170bf5c-647c-4b34-afe2-2e95f0049eec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:35:38.600941 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e170bf5c-647c-4b34-afe2-2e95f0049eec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:35:38.602522 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e170bf5c-647c-4b34-afe2-2e95f0049eec service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:35:38.612319 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 697/1394] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:35:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:35:39.475956 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f120fb-3605-44be-8e5f-00dc6ca76049 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:35:39.476253 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f120fb-3605-44be-8e5f-00dc6ca76049 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:35:39.476533 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f120fb-3605-44be-8e5f-00dc6ca76049 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:35:39.477902 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 698/1395] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:35:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:35:39.483248 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8be7a5-030e-4198-8654-b1021c4d4fa6 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:35:39.483899 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8be7a5-030e-4198-8654-b1021c4d4fa6 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:35:39.483899 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8be7a5-030e-4198-8654-b1021c4d4fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:35:39.503863 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-3b8be7a5-030e-4198-8654-b1021c4d4fa6 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:35:39.506726 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-3b8be7a5-030e-4198-8654-b1021c4d4fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:35:39.513217 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 698/1396] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:35:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:35:39.574093 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db116b77-3486-4ba0-8315-8b0faee4aa07 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:35:39.574651 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db116b77-3486-4ba0-8315-8b0faee4aa07 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:35:39.574651 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db116b77-3486-4ba0-8315-8b0faee4aa07 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:35:39.576087 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 699/1397] 10.222.0.43 () {54 vars in 961 bytes} [Mon Apr 11 16:35:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:35:39.581496 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf110e4-f014-49b6-8638-fb1aa3fea95d None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:35:39.581792 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf110e4-f014-49b6-8638-fb1aa3fea95d None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:35:39.582075 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf110e4-f014-49b6-8638-fb1aa3fea95d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:35:39.635503 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-6bf110e4-f014-49b6-8638-fb1aa3fea95d None None] MFA Rules not processed for user `a0f7cf98d5394b28a475fd67e30fc9c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:35:39.636686 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-6bf110e4-f014-49b6-8638-fb1aa3fea95d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:35:39.698337 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 699/1398] 10.222.0.43 () {58 vars in 1058 bytes} [Mon Apr 11 16:35:39 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:35:39.706978 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db116b77-3486-4ba0-8315-8b0faee4aa07 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:35:39.717814 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db116b77-3486-4ba0-8315-8b0faee4aa07 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:35:39.722451 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46031782-3891-4214-9cbc-4aca0139427f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f7cf98d5394b28a475fd67e30fc9c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:35:39.722742 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46031782-3891-4214-9cbc-4aca0139427f service glance] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:35:39.723027 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46031782-3891-4214-9cbc-4aca0139427f service glance] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:35:39.723305 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46031782-3891-4214-9cbc-4aca0139427f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:35:39.732897 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46031782-3891-4214-9cbc-4aca0139427f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:35:39.734296 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46031782-3891-4214-9cbc-4aca0139427f service glance] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:35:39.743912 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 700/1399] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:35:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:35:40.351432 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208bdae5-9ab9-4c7f-b1b1-37ae65a5111c None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:35:40.351750 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208bdae5-9ab9-4c7f-b1b1-37ae65a5111c None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:35:40.352030 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208bdae5-9ab9-4c7f-b1b1-37ae65a5111c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:35:40.403039 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-208bdae5-9ab9-4c7f-b1b1-37ae65a5111c None None] MFA Rules not processed for user `3252c48fdd5747a29fe4ba89e7162216`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:35:40.404324 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-208bdae5-9ab9-4c7f-b1b1-37ae65a5111c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:35:40.470175 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 700/1400] 10.222.0.43 () {58 vars in 1009 bytes} [Mon Apr 11 16:35:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:35:40.517729 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc500f3d-c61d-402c-a007-7d486466cc4f None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:35:40.518029 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc500f3d-c61d-402c-a007-7d486466cc4f None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:35:40.518313 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc500f3d-c61d-402c-a007-7d486466cc4f None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:35:40.520378 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 701/1401] 10.222.0.43 () {54 vars in 942 bytes} [Mon Apr 11 16:35:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:35:40.526510 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24dea9a-f758-4d50-9961-c8e94779b804 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:35:40.526988 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24dea9a-f758-4d50-9961-c8e94779b804 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:35:40.527197 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24dea9a-f758-4d50-9961-c8e94779b804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:35:40.580311 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-d24dea9a-f758-4d50-9961-c8e94779b804 None None] MFA Rules not processed for user `bb193a1a7abd430fbbcccab970e4f37c`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:35:40.581677 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-d24dea9a-f758-4d50-9961-c8e94779b804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:35:40.667675 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 701/1402] 10.222.0.43 () {58 vars in 1039 bytes} [Mon Apr 11 16:35:40 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:35:40.676774 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc500f3d-c61d-402c-a007-7d486466cc4f None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:35:40.698018 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc500f3d-c61d-402c-a007-7d486466cc4f None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:35:40.703535 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43026b2c-40e5-4f3d-bee7-f51105a91757 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb193a1a7abd430fbbcccab970e4f37c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:35:40.704216 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43026b2c-40e5-4f3d-bee7-f51105a91757 service swift] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:35:40.704497 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43026b2c-40e5-4f3d-bee7-f51105a91757 service swift] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:35:40.704773 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43026b2c-40e5-4f3d-bee7-f51105a91757 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:35:40.713475 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43026b2c-40e5-4f3d-bee7-f51105a91757 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:35:40.715054 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43026b2c-40e5-4f3d-bee7-f51105a91757 service swift] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:35:40.723846 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 702/1403] 10.222.0.43 () {60 vars in 1384 bytes} [Mon Apr 11 16:35:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 11 16:35:41.144176 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f881586-f447-48de-9633-911976b2184e None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:35:41.144469 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f881586-f447-48de-9633-911976b2184e None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:35:41.144750 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f881586-f447-48de-9633-911976b2184e None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:35:41.146108 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 702/1404] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:35:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:35:41.151951 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ba498-71c6-4c9d-bd69-f44ec9867615 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:35:41.152245 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ba498-71c6-4c9d-bd69-f44ec9867615 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:35:41.152743 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ba498-71c6-4c9d-bd69-f44ec9867615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:35:41.176743 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-d30ba498-71c6-4c9d-bd69-f44ec9867615 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:35:41.178847 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-d30ba498-71c6-4c9d-bd69-f44ec9867615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:35:41.195714 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 703/1405] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:35:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:35:41.235355 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f881586-f447-48de-9633-911976b2184e None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:35:41.250720 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f881586-f447-48de-9633-911976b2184e None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:35:41.256381 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9653ac82-82cc-4e16-8812-4095224987f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1be2652c984a4283aeee0b937f0555e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:35:41.257033 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9653ac82-82cc-4e16-8812-4095224987f8 service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:35:41.257326 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9653ac82-82cc-4e16-8812-4095224987f8 service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:35:41.257634 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9653ac82-82cc-4e16-8812-4095224987f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:35:41.270930 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9653ac82-82cc-4e16-8812-4095224987f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:35:41.272562 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9653ac82-82cc-4e16-8812-4095224987f8 service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:35:41.282950 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 703/1406] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:35:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:35:43.888036 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d58711-321b-4cb8-8d9a-a21dd9e0311d None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:35:43.888900 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d58711-321b-4cb8-8d9a-a21dd9e0311d None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:35:43.888900 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d58711-321b-4cb8-8d9a-a21dd9e0311d None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:35:43.891299 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 704/1407] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:35:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:35:43.898924 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1981164e-b684-4692-87b6-c71ceaffe1b4 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:35:43.899474 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1981164e-b684-4692-87b6-c71ceaffe1b4 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:35:43.899691 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1981164e-b684-4692-87b6-c71ceaffe1b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:35:43.922927 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-1981164e-b684-4692-87b6-c71ceaffe1b4 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:35:43.924284 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-1981164e-b684-4692-87b6-c71ceaffe1b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:35:43.935560 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 704/1408] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:35:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:35:43.984514 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d58711-321b-4cb8-8d9a-a21dd9e0311d None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:35:44.000663 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d58711-321b-4cb8-8d9a-a21dd9e0311d None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:35:44.006677 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798988cd-87ff-4e1b-a83e-5dedb939ac08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1be2652c984a4283aeee0b937f0555e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:35:44.007555 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798988cd-87ff-4e1b-a83e-5dedb939ac08 service nova] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:35:44.007844 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798988cd-87ff-4e1b-a83e-5dedb939ac08 service nova] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:35:44.008117 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798988cd-87ff-4e1b-a83e-5dedb939ac08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:35:44.016813 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798988cd-87ff-4e1b-a83e-5dedb939ac08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:35:44.018729 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798988cd-87ff-4e1b-a83e-5dedb939ac08 service nova] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:35:44.033385 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 705/1409] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:35:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:36:05.162179 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2d5ad-a411-4e6a-b346-d9dff0dca19d None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:05.162836 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2d5ad-a411-4e6a-b346-d9dff0dca19d None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:05.162836 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2d5ad-a411-4e6a-b346-d9dff0dca19d None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:05.164194 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 705/1410] 10.222.0.43 () {54 vars in 918 bytes} [Mon Apr 11 16:36:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 16:36:05.169910 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da847c33-83a4-4619-b334-e92e18a30d02 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:05.170422 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da847c33-83a4-4619-b334-e92e18a30d02 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:05.170529 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da847c33-83a4-4619-b334-e92e18a30d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:05.188944 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-da847c33-83a4-4619-b334-e92e18a30d02 None None] MFA Rules not processed for user `6589debd41bf496085c7339ab5409666`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:36:05.190998 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-da847c33-83a4-4619-b334-e92e18a30d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:36:05.199533 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 706/1411] 10.222.0.43 () {58 vars in 1015 bytes} [Mon Apr 11 16:36:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:36:05.215026 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7378f-d0fa-436d-bfe7-3ec45f15a4d5 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:05.215313 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7378f-d0fa-436d-bfe7-3ec45f15a4d5 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:05.215608 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7378f-d0fa-436d-bfe7-3ec45f15a4d5 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:05.216982 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 706/1412] 10.222.0.43 () {54 vars in 918 bytes} [Mon Apr 11 16:36:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:36:05.221774 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad0ff6-a72d-449e-b378-076628feb10a None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:05.222061 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad0ff6-a72d-449e-b378-076628feb10a None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:05.222343 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad0ff6-a72d-449e-b378-076628feb10a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:05.241199 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-89ad0ff6-a72d-449e-b378-076628feb10a None None] MFA Rules not processed for user `1be2652c984a4283aeee0b937f0555e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:36:05.242404 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-89ad0ff6-a72d-449e-b378-076628feb10a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:36:05.251476 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 707/1413] 10.222.0.43 () {58 vars in 1015 bytes} [Mon Apr 11 16:36:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:36:08.082727 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb181e4-c611-40a6-a843-560845ddfa30 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:08.083313 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb181e4-c611-40a6-a843-560845ddfa30 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:08.083313 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb181e4-c611-40a6-a843-560845ddfa30 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:08.084683 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 707/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 11 16:36:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 16:36:08.090005 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40bd6c5-f091-4831-845d-35f1a51a7533 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:08.090457 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40bd6c5-f091-4831-845d-35f1a51a7533 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:08.090566 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40bd6c5-f091-4831-845d-35f1a51a7533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:08.108686 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-e40bd6c5-f091-4831-845d-35f1a51a7533 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:36:08.109896 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-e40bd6c5-f091-4831-845d-35f1a51a7533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:36:08.117884 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 708/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 11 16:36:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:36:08.161882 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb181e4-c611-40a6-a843-560845ddfa30 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:08.176254 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb181e4-c611-40a6-a843-560845ddfa30 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:08.181651 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e41a903-6d86-49d2-8561-06177e6db067 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1be2652c984a4283aeee0b937f0555e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:08.182313 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41a903-6d86-49d2-8561-06177e6db067 service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:08.182593 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41a903-6d86-49d2-8561-06177e6db067 service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:08.182868 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41a903-6d86-49d2-8561-06177e6db067 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:08.192577 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e41a903-6d86-49d2-8561-06177e6db067 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:08.194183 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e41a903-6d86-49d2-8561-06177e6db067 service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:08.204428 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 708/1416] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:36:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:36:09.592480 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0d138-dc13-4a1d-ad63-d0f6bd0d93a3 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:09.593077 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0d138-dc13-4a1d-ad63-d0f6bd0d93a3 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:09.593077 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0d138-dc13-4a1d-ad63-d0f6bd0d93a3 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:09.594500 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 709/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Apr 11 16:36:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:36:09.599794 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7e0c4-d2f1-4ba3-b888-7e5422697d46 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:09.600272 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7e0c4-d2f1-4ba3-b888-7e5422697d46 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:09.600385 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7e0c4-d2f1-4ba3-b888-7e5422697d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:09.620292 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-5ae7e0c4-d2f1-4ba3-b888-7e5422697d46 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:36:09.621533 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-5ae7e0c4-d2f1-4ba3-b888-7e5422697d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:36:09.631835 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 709/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Apr 11 16:36:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:36:09.804598 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd0d138-dc13-4a1d-ad63-d0f6bd0d93a3 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:09.819184 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd0d138-dc13-4a1d-ad63-d0f6bd0d93a3 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:09.824615 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2531246-1fb7-4b44-91e8-4b789e29808d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1be2652c984a4283aeee0b937f0555e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:09.825256 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2531246-1fb7-4b44-91e8-4b789e29808d service nova] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:09.825539 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2531246-1fb7-4b44-91e8-4b789e29808d service nova] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:09.825816 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2531246-1fb7-4b44-91e8-4b789e29808d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:09.834393 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2531246-1fb7-4b44-91e8-4b789e29808d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:09.835996 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2531246-1fb7-4b44-91e8-4b789e29808d service nova] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:09.845315 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 710/1419] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:36:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:36:11.174611 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe88c3-7fc8-4529-abed-8e1171f22733 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:11.175720 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe88c3-7fc8-4529-abed-8e1171f22733 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:11.175915 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe88c3-7fc8-4529-abed-8e1171f22733 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:11.177505 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 710/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Apr 11 16:36:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:36:11.182658 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c23a7bc-36f0-48f2-82c5-71a94bb11ca9 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:11.183132 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c23a7bc-36f0-48f2-82c5-71a94bb11ca9 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:11.183227 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c23a7bc-36f0-48f2-82c5-71a94bb11ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:11.202184 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-5c23a7bc-36f0-48f2-82c5-71a94bb11ca9 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:36:11.203453 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-5c23a7bc-36f0-48f2-82c5-71a94bb11ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:36:11.212560 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 711/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Apr 11 16:36:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:36:11.372895 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbe88c3-7fc8-4529-abed-8e1171f22733 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:11.386583 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbe88c3-7fc8-4529-abed-8e1171f22733 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:11.391789 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b3bc0c-0a1a-474d-9912-a44bcd9bb12c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1be2652c984a4283aeee0b937f0555e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:11.392423 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b3bc0c-0a1a-474d-9912-a44bcd9bb12c service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:11.392700 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b3bc0c-0a1a-474d-9912-a44bcd9bb12c service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:11.392972 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b3bc0c-0a1a-474d-9912-a44bcd9bb12c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:11.401154 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b3bc0c-0a1a-474d-9912-a44bcd9bb12c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:11.402706 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b3bc0c-0a1a-474d-9912-a44bcd9bb12c service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:11.412656 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 711/1422] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:36:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:36:12.722530 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a4eb93-4e56-4020-91fb-91a492d95ae3 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:12.723117 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a4eb93-4e56-4020-91fb-91a492d95ae3 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:12.723117 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a4eb93-4e56-4020-91fb-91a492d95ae3 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:12.724624 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 712/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Apr 11 16:36:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:36:12.729619 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a353265-ccb5-4392-8b6a-bc8166ba85ff None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:12.730051 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a353265-ccb5-4392-8b6a-bc8166ba85ff None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:12.730181 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a353265-ccb5-4392-8b6a-bc8166ba85ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:12.750077 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-8a353265-ccb5-4392-8b6a-bc8166ba85ff None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:36:12.751279 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-8a353265-ccb5-4392-8b6a-bc8166ba85ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:36:12.759760 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 712/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Apr 11 16:36:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:36:12.911246 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a4eb93-4e56-4020-91fb-91a492d95ae3 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:12.926065 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a4eb93-4e56-4020-91fb-91a492d95ae3 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:12.931660 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc8d39-f21b-4028-9574-f2339df877ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1be2652c984a4283aeee0b937f0555e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:12.932315 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc8d39-f21b-4028-9574-f2339df877ef service nova] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:12.932601 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc8d39-f21b-4028-9574-f2339df877ef service nova] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:12.932877 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc8d39-f21b-4028-9574-f2339df877ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:12.942437 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dc8d39-f21b-4028-9574-f2339df877ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:12.944066 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dc8d39-f21b-4028-9574-f2339df877ef service nova] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:12.953501 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 713/1425] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:36:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:36:14.283059 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1025b49-7303-4e6e-9c4a-a4702b0866e1 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:14.283685 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1025b49-7303-4e6e-9c4a-a4702b0866e1 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:14.283685 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1025b49-7303-4e6e-9c4a-a4702b0866e1 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:14.285130 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 713/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Apr 11 16:36:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:36:14.291175 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee196a4-e30c-498f-9f31-2c31b1586923 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:14.291645 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee196a4-e30c-498f-9f31-2c31b1586923 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:14.291770 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee196a4-e30c-498f-9f31-2c31b1586923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:14.309935 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-5ee196a4-e30c-498f-9f31-2c31b1586923 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:36:14.311127 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-5ee196a4-e30c-498f-9f31-2c31b1586923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:36:14.319737 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 714/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Apr 11 16:36:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:36:14.472783 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1025b49-7303-4e6e-9c4a-a4702b0866e1 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:14.486842 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1025b49-7303-4e6e-9c4a-a4702b0866e1 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:14.492208 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866cc822-3333-4cb7-ab8a-4db5dd2ac058 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1be2652c984a4283aeee0b937f0555e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:14.492850 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866cc822-3333-4cb7-ab8a-4db5dd2ac058 service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:14.493133 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866cc822-3333-4cb7-ab8a-4db5dd2ac058 service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:14.493410 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866cc822-3333-4cb7-ab8a-4db5dd2ac058 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:14.501564 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866cc822-3333-4cb7-ab8a-4db5dd2ac058 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:14.503765 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866cc822-3333-4cb7-ab8a-4db5dd2ac058 service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:14.513403 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 714/1428] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:36:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:36:15.845635 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbffd5c-a477-4b8e-9e7d-9fb115b3ac86 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:15.846214 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbffd5c-a477-4b8e-9e7d-9fb115b3ac86 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:15.846214 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbffd5c-a477-4b8e-9e7d-9fb115b3ac86 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:15.847626 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 715/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Apr 11 16:36:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:36:15.853422 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d800e-4676-4328-b7d6-afbb7e941cec None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:15.853996 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d800e-4676-4328-b7d6-afbb7e941cec None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:15.853996 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d800e-4676-4328-b7d6-afbb7e941cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:15.878496 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-052d800e-4676-4328-b7d6-afbb7e941cec None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:36:15.879828 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-052d800e-4676-4328-b7d6-afbb7e941cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:36:15.888581 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 715/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Apr 11 16:36:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:36:16.038472 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbffd5c-a477-4b8e-9e7d-9fb115b3ac86 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:16.054800 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbffd5c-a477-4b8e-9e7d-9fb115b3ac86 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:16.059398 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138f832d-aaa2-49b8-a6ad-8b60b5c6ea5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1be2652c984a4283aeee0b937f0555e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:16.060079 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f832d-aaa2-49b8-a6ad-8b60b5c6ea5a service nova] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:16.060363 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f832d-aaa2-49b8-a6ad-8b60b5c6ea5a service nova] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:16.060658 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f832d-aaa2-49b8-a6ad-8b60b5c6ea5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:16.070485 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138f832d-aaa2-49b8-a6ad-8b60b5c6ea5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:16.072120 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138f832d-aaa2-49b8-a6ad-8b60b5c6ea5a service nova] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:16.082869 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 716/1431] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:36:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:36:17.399049 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1906fb6-448a-4cb1-8610-8dd6d98c7313 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:17.399669 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1906fb6-448a-4cb1-8610-8dd6d98c7313 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:17.399669 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1906fb6-448a-4cb1-8610-8dd6d98c7313 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:17.400972 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 716/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Apr 11 16:36:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:36:17.406040 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4981ce38-8c08-4a10-9a90-6cf763084f4b None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:17.406467 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4981ce38-8c08-4a10-9a90-6cf763084f4b None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:17.406752 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4981ce38-8c08-4a10-9a90-6cf763084f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:17.426659 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-4981ce38-8c08-4a10-9a90-6cf763084f4b None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:36:17.427924 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-4981ce38-8c08-4a10-9a90-6cf763084f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:36:17.436001 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 717/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Apr 11 16:36:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:36:17.588235 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1906fb6-448a-4cb1-8610-8dd6d98c7313 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:17.602951 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1906fb6-448a-4cb1-8610-8dd6d98c7313 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:17.608204 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d6e2d4-d32f-4c3b-a9b2-1b44633333f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1be2652c984a4283aeee0b937f0555e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:17.608843 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d6e2d4-d32f-4c3b-a9b2-1b44633333f6 service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:17.609127 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d6e2d4-d32f-4c3b-a9b2-1b44633333f6 service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:17.609403 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d6e2d4-d32f-4c3b-a9b2-1b44633333f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:17.617551 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d6e2d4-d32f-4c3b-a9b2-1b44633333f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:17.619104 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d6e2d4-d32f-4c3b-a9b2-1b44633333f6 service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:17.628333 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 717/1434] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:36:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:36:18.962935 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0320958-6306-4dbb-aeca-b36c64075a56 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:18.963501 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0320958-6306-4dbb-aeca-b36c64075a56 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:18.963501 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0320958-6306-4dbb-aeca-b36c64075a56 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:18.964884 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 718/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Apr 11 16:36:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:36:18.969775 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa190df-beb5-42db-b6dd-425a7bf5349f None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:18.970171 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa190df-beb5-42db-b6dd-425a7bf5349f None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:18.970857 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa190df-beb5-42db-b6dd-425a7bf5349f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:18.989282 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-bfa190df-beb5-42db-b6dd-425a7bf5349f None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:36:18.990457 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-bfa190df-beb5-42db-b6dd-425a7bf5349f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:36:18.998128 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 718/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Apr 11 16:36:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:36:19.146281 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0320958-6306-4dbb-aeca-b36c64075a56 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:19.161304 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0320958-6306-4dbb-aeca-b36c64075a56 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:19.166772 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c257a3ff-134c-4203-a8c6-28bd34327a4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1be2652c984a4283aeee0b937f0555e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:19.167419 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c257a3ff-134c-4203-a8c6-28bd34327a4b service nova] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:19.169144 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c257a3ff-134c-4203-a8c6-28bd34327a4b service nova] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:19.169144 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c257a3ff-134c-4203-a8c6-28bd34327a4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:19.176481 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c257a3ff-134c-4203-a8c6-28bd34327a4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:19.178072 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c257a3ff-134c-4203-a8c6-28bd34327a4b service nova] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:19.187570 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 719/1437] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:36:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:36:20.605956 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba5a6f-3c69-4c61-aee1-fb93d9daaa94 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:20.606555 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba5a6f-3c69-4c61-aee1-fb93d9daaa94 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:20.606555 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba5a6f-3c69-4c61-aee1-fb93d9daaa94 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:20.607926 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 719/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Apr 11 16:36:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:36:20.612979 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5affbee1-b131-4a9d-859e-802d3b5c8532 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:20.613385 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5affbee1-b131-4a9d-859e-802d3b5c8532 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:20.613515 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5affbee1-b131-4a9d-859e-802d3b5c8532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:20.631133 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-5affbee1-b131-4a9d-859e-802d3b5c8532 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:36:20.632348 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-5affbee1-b131-4a9d-859e-802d3b5c8532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:36:20.639974 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 720/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Apr 11 16:36:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:36:20.791159 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ba5a6f-3c69-4c61-aee1-fb93d9daaa94 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:20.805330 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ba5a6f-3c69-4c61-aee1-fb93d9daaa94 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:20.810699 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e2915d-4622-4420-8f77-3fda6950e828 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1be2652c984a4283aeee0b937f0555e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:20.811341 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e2915d-4622-4420-8f77-3fda6950e828 service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:20.811662 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e2915d-4622-4420-8f77-3fda6950e828 service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:20.811943 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e2915d-4622-4420-8f77-3fda6950e828 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:20.820528 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e2915d-4622-4420-8f77-3fda6950e828 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:20.822108 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e2915d-4622-4420-8f77-3fda6950e828 service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:20.832116 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 720/1440] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:36:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:36:23.054754 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7484a77-586f-4dcc-ab5b-1e53e0cc1717 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:23.055265 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7484a77-586f-4dcc-ab5b-1e53e0cc1717 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:23.055265 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7484a77-586f-4dcc-ab5b-1e53e0cc1717 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:23.056642 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 721/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 11 16:36:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:36:23.061884 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e61f3c-c66c-4f19-a899-2b6cd2482631 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:23.062302 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e61f3c-c66c-4f19-a899-2b6cd2482631 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:23.062456 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e61f3c-c66c-4f19-a899-2b6cd2482631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:23.080781 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-35e61f3c-c66c-4f19-a899-2b6cd2482631 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:36:23.081986 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-35e61f3c-c66c-4f19-a899-2b6cd2482631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:36:23.089809 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 721/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 11 16:36:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:36:23.129877 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7484a77-586f-4dcc-ab5b-1e53e0cc1717 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:23.140545 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7484a77-586f-4dcc-ab5b-1e53e0cc1717 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:23.144639 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8445dcdf-1069-4e9a-8153-8e443725f510 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:23.145275 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8445dcdf-1069-4e9a-8153-8e443725f510 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:23.145558 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8445dcdf-1069-4e9a-8153-8e443725f510 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:23.145864 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8445dcdf-1069-4e9a-8153-8e443725f510 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:23.154614 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8445dcdf-1069-4e9a-8153-8e443725f510 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:23.156068 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8445dcdf-1069-4e9a-8153-8e443725f510 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:23.165908 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 722/1443] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:36:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:36:25.723885 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e215f1f0-76e2-44b9-9808-4a4f74f0928e None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:25.724522 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e215f1f0-76e2-44b9-9808-4a4f74f0928e None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:25.724522 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e215f1f0-76e2-44b9-9808-4a4f74f0928e None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:25.725811 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 722/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 11 16:36:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:36:25.731179 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f2544d-1cbb-4f35-a7d8-4b1a633b944c None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:25.731650 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f2544d-1cbb-4f35-a7d8-4b1a633b944c None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:25.731792 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f2544d-1cbb-4f35-a7d8-4b1a633b944c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:25.749756 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-d2f2544d-1cbb-4f35-a7d8-4b1a633b944c None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:36:25.750943 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-d2f2544d-1cbb-4f35-a7d8-4b1a633b944c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:36:25.759055 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 723/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 11 16:36:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:36:25.798568 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e215f1f0-76e2-44b9-9808-4a4f74f0928e None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:25.810140 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e215f1f0-76e2-44b9-9808-4a4f74f0928e None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:25.813566 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd59e754-b4a8-413e-862a-0afee5d2d86d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:25.814245 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59e754-b4a8-413e-862a-0afee5d2d86d service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:25.814525 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59e754-b4a8-413e-862a-0afee5d2d86d service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:25.814801 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59e754-b4a8-413e-862a-0afee5d2d86d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:25.824227 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd59e754-b4a8-413e-862a-0afee5d2d86d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:25.825651 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd59e754-b4a8-413e-862a-0afee5d2d86d service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:25.835470 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 723/1446] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:36:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:36:28.526626 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4e653-4f10-4ce9-92a2-8053d9a6fab6 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:28.527174 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4e653-4f10-4ce9-92a2-8053d9a6fab6 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:28.527267 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4e653-4f10-4ce9-92a2-8053d9a6fab6 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:28.528884 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 724/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 11 16:36:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:36:28.534942 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b4439e-8c33-473d-abaa-9321b19810bc None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:28.535370 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b4439e-8c33-473d-abaa-9321b19810bc None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:28.535497 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b4439e-8c33-473d-abaa-9321b19810bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:28.553216 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-e7b4439e-8c33-473d-abaa-9321b19810bc None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:36:28.554406 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e7b4439e-8c33-473d-abaa-9321b19810bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:36:28.562028 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 724/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 11 16:36:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:36:28.602635 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de4e653-4f10-4ce9-92a2-8053d9a6fab6 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:28.614539 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de4e653-4f10-4ce9-92a2-8053d9a6fab6 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:28.622280 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19218b7a-7769-4dec-9aa6-c9a34b3105de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:28.622970 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19218b7a-7769-4dec-9aa6-c9a34b3105de service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:28.623263 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19218b7a-7769-4dec-9aa6-c9a34b3105de service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:28.623575 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19218b7a-7769-4dec-9aa6-c9a34b3105de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:28.635648 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19218b7a-7769-4dec-9aa6-c9a34b3105de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:28.637104 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19218b7a-7769-4dec-9aa6-c9a34b3105de service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:28.647626 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 725/1449] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:36:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:36:31.130788 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4587e95-945a-4182-a26a-44c54e0f7613 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:31.131343 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4587e95-945a-4182-a26a-44c54e0f7613 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:31.131343 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4587e95-945a-4182-a26a-44c54e0f7613 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:31.132715 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 725/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 11 16:36:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:36:31.137874 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742fb388-6991-48de-ac67-8d1902785e68 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:31.138316 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742fb388-6991-48de-ac67-8d1902785e68 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:31.138435 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742fb388-6991-48de-ac67-8d1902785e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:31.157079 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-742fb388-6991-48de-ac67-8d1902785e68 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:36:31.159264 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-742fb388-6991-48de-ac67-8d1902785e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:36:31.167331 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 726/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 11 16:36:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:36:31.208082 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4587e95-945a-4182-a26a-44c54e0f7613 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:31.218917 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4587e95-945a-4182-a26a-44c54e0f7613 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:31.223918 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436a51fb-778b-42e7-afd1-d89cd622b045 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:31.224497 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a51fb-778b-42e7-afd1-d89cd622b045 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:31.224497 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a51fb-778b-42e7-afd1-d89cd622b045 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:31.225175 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a51fb-778b-42e7-afd1-d89cd622b045 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:31.234200 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436a51fb-778b-42e7-afd1-d89cd622b045 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:31.235694 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436a51fb-778b-42e7-afd1-d89cd622b045 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:31.244908 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 726/1452] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:36:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:36:33.634255 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0047779-c714-4690-8ae6-3ffefe011c61 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:33.634811 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0047779-c714-4690-8ae6-3ffefe011c61 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:33.634811 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0047779-c714-4690-8ae6-3ffefe011c61 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:33.636219 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 727/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 11 16:36:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:36:33.641387 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c61737-67e6-449c-b0e2-33a904b60ae0 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:33.642077 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c61737-67e6-449c-b0e2-33a904b60ae0 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:33.642077 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c61737-67e6-449c-b0e2-33a904b60ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:33.661570 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-18c61737-67e6-449c-b0e2-33a904b60ae0 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:36:33.662766 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-18c61737-67e6-449c-b0e2-33a904b60ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:36:33.670577 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 727/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 11 16:36:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:36:33.711824 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0047779-c714-4690-8ae6-3ffefe011c61 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:33.722945 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0047779-c714-4690-8ae6-3ffefe011c61 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:33.726896 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d7b17b-61c2-4aaa-bbe9-909904d70147 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:33.727121 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d7b17b-61c2-4aaa-bbe9-909904d70147 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:33.727405 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d7b17b-61c2-4aaa-bbe9-909904d70147 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:33.727711 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d7b17b-61c2-4aaa-bbe9-909904d70147 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:33.737054 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d7b17b-61c2-4aaa-bbe9-909904d70147 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:33.738455 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d7b17b-61c2-4aaa-bbe9-909904d70147 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:33.747617 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 728/1455] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:36:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:36:36.145502 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5150623f-742b-4f8a-a43d-12aedd28ed68 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:36.146096 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5150623f-742b-4f8a-a43d-12aedd28ed68 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:36.146096 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5150623f-742b-4f8a-a43d-12aedd28ed68 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:36.147486 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 728/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 11 16:36:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:36:36.152956 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d03f1-baa3-4230-af22-410dcfe8f8de None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:36.153379 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d03f1-baa3-4230-af22-410dcfe8f8de None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:36.153524 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d03f1-baa3-4230-af22-410dcfe8f8de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:36.172519 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-a88d03f1-baa3-4230-af22-410dcfe8f8de None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:36:36.172519 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-a88d03f1-baa3-4230-af22-410dcfe8f8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:36:36.180175 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 729/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 11 16:36:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:36:36.220571 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5150623f-742b-4f8a-a43d-12aedd28ed68 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:36.231043 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5150623f-742b-4f8a-a43d-12aedd28ed68 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:36.234698 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26086674-fb26-492a-be6f-578550ce7884 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:36.235342 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26086674-fb26-492a-be6f-578550ce7884 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:36.235808 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26086674-fb26-492a-be6f-578550ce7884 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:36.236089 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26086674-fb26-492a-be6f-578550ce7884 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:36.245715 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26086674-fb26-492a-be6f-578550ce7884 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:36.247135 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26086674-fb26-492a-be6f-578550ce7884 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:36.257662 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 729/1458] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:36:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:36:38.697276 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa96f4f-a8a0-449d-ac74-d4fbd43f0ec8 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:38.697893 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa96f4f-a8a0-449d-ac74-d4fbd43f0ec8 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:38.697893 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa96f4f-a8a0-449d-ac74-d4fbd43f0ec8 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:38.699196 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 730/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 11 16:36:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:36:38.704971 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc26bf6-fc14-46de-bd3d-9f48eb338c24 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:38.705725 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc26bf6-fc14-46de-bd3d-9f48eb338c24 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:38.705725 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc26bf6-fc14-46de-bd3d-9f48eb338c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:38.723453 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-7cc26bf6-fc14-46de-bd3d-9f48eb338c24 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:36:38.724703 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-7cc26bf6-fc14-46de-bd3d-9f48eb338c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:36:38.732672 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 730/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 11 16:36:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:36:38.773570 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa96f4f-a8a0-449d-ac74-d4fbd43f0ec8 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:38.784468 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa96f4f-a8a0-449d-ac74-d4fbd43f0ec8 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:38.788110 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e91639e-8552-4d36-a808-a003baecf885 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:38.788758 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91639e-8552-4d36-a808-a003baecf885 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:38.789040 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91639e-8552-4d36-a808-a003baecf885 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:38.789315 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91639e-8552-4d36-a808-a003baecf885 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:38.799440 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e91639e-8552-4d36-a808-a003baecf885 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:38.800898 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e91639e-8552-4d36-a808-a003baecf885 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:38.810890 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 731/1461] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:36:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:36:41.355942 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3faa35f-7041-4bd0-b2c9-b8e15ee8dc14 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:41.356535 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3faa35f-7041-4bd0-b2c9-b8e15ee8dc14 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:41.356535 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3faa35f-7041-4bd0-b2c9-b8e15ee8dc14 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:41.357900 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 731/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 11 16:36:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:36:41.363595 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff6a13-d6ca-4a3b-b1de-05521ebad4c2 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:41.364160 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff6a13-d6ca-4a3b-b1de-05521ebad4c2 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:41.364160 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff6a13-d6ca-4a3b-b1de-05521ebad4c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:41.382520 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-98ff6a13-d6ca-4a3b-b1de-05521ebad4c2 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:36:41.383782 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-98ff6a13-d6ca-4a3b-b1de-05521ebad4c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:36:41.392013 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 732/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 11 16:36:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:36:41.430461 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3faa35f-7041-4bd0-b2c9-b8e15ee8dc14 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:41.445175 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3faa35f-7041-4bd0-b2c9-b8e15ee8dc14 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:41.448875 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd64b04-94c6-4154-a341-6ae091581e5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:41.449528 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd64b04-94c6-4154-a341-6ae091581e5f service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:41.449942 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd64b04-94c6-4154-a341-6ae091581e5f service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:41.450224 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd64b04-94c6-4154-a341-6ae091581e5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:41.460465 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd64b04-94c6-4154-a341-6ae091581e5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:41.461925 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd64b04-94c6-4154-a341-6ae091581e5f service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:41.473150 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 732/1464] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:36:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:36:43.848795 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e4bc9-1d8c-4f87-bb37-46e8be9196b8 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:43.849364 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e4bc9-1d8c-4f87-bb37-46e8be9196b8 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:43.849364 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e4bc9-1d8c-4f87-bb37-46e8be9196b8 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:43.850740 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 733/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 11 16:36:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:36:43.856572 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c00044-8cb2-4a49-b1d9-13939b39355e None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:43.857018 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c00044-8cb2-4a49-b1d9-13939b39355e None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:43.857122 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c00044-8cb2-4a49-b1d9-13939b39355e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:43.875030 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-46c00044-8cb2-4a49-b1d9-13939b39355e None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:36:43.876330 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-46c00044-8cb2-4a49-b1d9-13939b39355e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:36:43.884470 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 733/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 11 16:36:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:36:43.924242 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e4bc9-1d8c-4f87-bb37-46e8be9196b8 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:43.934786 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e4bc9-1d8c-4f87-bb37-46e8be9196b8 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:43.938278 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed10f8a-95e8-44e3-8ede-40316c20bf2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:43.940734 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed10f8a-95e8-44e3-8ede-40316c20bf2c service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:43.941014 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed10f8a-95e8-44e3-8ede-40316c20bf2c service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:43.941329 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed10f8a-95e8-44e3-8ede-40316c20bf2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:43.950647 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed10f8a-95e8-44e3-8ede-40316c20bf2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:43.952089 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed10f8a-95e8-44e3-8ede-40316c20bf2c service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:43.961950 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 734/1467] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:36:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:36:46.341199 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127792d5-9e1f-4a03-81f3-643b3acd1e98 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:46.341770 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127792d5-9e1f-4a03-81f3-643b3acd1e98 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:46.341770 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127792d5-9e1f-4a03-81f3-643b3acd1e98 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:46.343045 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 734/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 11 16:36:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:36:46.349691 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf550da-14b6-48b3-bcdb-15b7780bb762 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:46.350196 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf550da-14b6-48b3-bcdb-15b7780bb762 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:46.350305 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf550da-14b6-48b3-bcdb-15b7780bb762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:46.371999 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-6bf550da-14b6-48b3-bcdb-15b7780bb762 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:36:46.373213 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-6bf550da-14b6-48b3-bcdb-15b7780bb762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:36:46.381440 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 735/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 11 16:36:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:36:46.420791 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127792d5-9e1f-4a03-81f3-643b3acd1e98 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:46.431615 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127792d5-9e1f-4a03-81f3-643b3acd1e98 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:46.435098 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a9afc-050a-47d6-947f-25811d9864e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:46.435776 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a9afc-050a-47d6-947f-25811d9864e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:46.436085 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a9afc-050a-47d6-947f-25811d9864e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:46.436362 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a9afc-050a-47d6-947f-25811d9864e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:46.446743 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7a9afc-050a-47d6-947f-25811d9864e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:46.448259 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7a9afc-050a-47d6-947f-25811d9864e9 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:46.459138 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 735/1470] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:36:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:37:20.509671 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6285beae-0612-4e9a-84d4-4c23b4c7aaf4 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:20.510247 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6285beae-0612-4e9a-84d4-4c23b4c7aaf4 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:20.510344 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6285beae-0612-4e9a-84d4-4c23b4c7aaf4 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:20.512169 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 736/1471] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:37:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:37:20.518010 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb656e-0d45-4466-a5ed-0b12a977ab01 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:20.518553 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb656e-0d45-4466-a5ed-0b12a977ab01 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:20.518674 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb656e-0d45-4466-a5ed-0b12a977ab01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:20.536481 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-7fdb656e-0d45-4466-a5ed-0b12a977ab01 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:37:20.537674 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-7fdb656e-0d45-4466-a5ed-0b12a977ab01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:37:20.545408 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 736/1472] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:37:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:37:20.596953 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab939b-adb1-45fe-9924-e751610f82ed None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:20.597246 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab939b-adb1-45fe-9924-e751610f82ed None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:20.597531 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab939b-adb1-45fe-9924-e751610f82ed None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:20.598943 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 737/1473] 10.222.0.43 () {54 vars in 961 bytes} [Mon Apr 11 16:37:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:37:20.604395 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1ab76-c572-49ea-b10b-c832edc04e12 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:20.604777 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1ab76-c572-49ea-b10b-c832edc04e12 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:20.605157 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1ab76-c572-49ea-b10b-c832edc04e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:20.624240 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-f3f1ab76-c572-49ea-b10b-c832edc04e12 None None] MFA Rules not processed for user `a0f7cf98d5394b28a475fd67e30fc9c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:37:20.625693 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-f3f1ab76-c572-49ea-b10b-c832edc04e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:37:20.632315 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 737/1474] 10.222.0.43 () {58 vars in 1058 bytes} [Mon Apr 11 16:37:20 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:37:20.640041 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aab939b-adb1-45fe-9924-e751610f82ed None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:20.653190 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aab939b-adb1-45fe-9924-e751610f82ed None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:20.658203 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29f4d68-c2ac-4741-a027-2669d18933b7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f7cf98d5394b28a475fd67e30fc9c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:20.659047 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f4d68-c2ac-4741-a027-2669d18933b7 service glance] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:20.659362 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f4d68-c2ac-4741-a027-2669d18933b7 service glance] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:20.659780 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f4d68-c2ac-4741-a027-2669d18933b7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:20.671150 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29f4d68-c2ac-4741-a027-2669d18933b7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:20.673067 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29f4d68-c2ac-4741-a027-2669d18933b7 service glance] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:20.685864 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 738/1475] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:37:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:37:23.153589 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c0781-e63e-4f4a-8eb5-7bdddf39abec None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:23.154187 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c0781-e63e-4f4a-8eb5-7bdddf39abec None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:23.154290 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c0781-e63e-4f4a-8eb5-7bdddf39abec None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:23.155728 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 738/1476] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:37:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:37:23.162235 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f887bd3-b569-4aad-aa65-c0c1211deba3 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:23.162655 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f887bd3-b569-4aad-aa65-c0c1211deba3 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:23.162794 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f887bd3-b569-4aad-aa65-c0c1211deba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:23.180403 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-2f887bd3-b569-4aad-aa65-c0c1211deba3 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:37:23.181605 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-2f887bd3-b569-4aad-aa65-c0c1211deba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:37:23.190714 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 739/1477] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:37:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:37:23.216705 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943c0781-e63e-4f4a-8eb5-7bdddf39abec None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:23.229508 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943c0781-e63e-4f4a-8eb5-7bdddf39abec None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:23.234132 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4603ea-e776-4f53-bc55-d66a581d82e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:23.234765 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4603ea-e776-4f53-bc55-d66a581d82e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:23.235049 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4603ea-e776-4f53-bc55-d66a581d82e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:23.235328 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4603ea-e776-4f53-bc55-d66a581d82e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:23.236103 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4603ea-e776-4f53-bc55-d66a581d82e0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:23.237782 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING py.warnings [None req-bb4603ea-e776-4f53-bc55-d66a581d82e0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 11 16:37:23.237782 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: warnings.warn(msg) Apr 11 16:37:23.237782 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: Apr 11 16:37:23.238920 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4603ea-e776-4f53-bc55-d66a581d82e0 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:23.258916 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 739/1478] 10.222.0.43 () {56 vars in 1108 bytes} [Mon Apr 11 16:37:23 2022] GET /identity/v3/projects => generated 2553 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:37:25.654482 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c20120-d9c6-41de-b1d0-1b4eca5538d9 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:25.655179 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c20120-d9c6-41de-b1d0-1b4eca5538d9 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:25.655179 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c20120-d9c6-41de-b1d0-1b4eca5538d9 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:25.656466 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 740/1479] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:37:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 16:37:25.662219 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f4579-6051-46e2-b1fe-b0dbb7d5314d None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:25.662667 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f4579-6051-46e2-b1fe-b0dbb7d5314d None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:25.662773 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f4579-6051-46e2-b1fe-b0dbb7d5314d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:25.680878 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-f63f4579-6051-46e2-b1fe-b0dbb7d5314d None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:37:25.682066 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-f63f4579-6051-46e2-b1fe-b0dbb7d5314d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:37:25.691270 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 740/1480] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:37:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:37:25.734572 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c20120-d9c6-41de-b1d0-1b4eca5538d9 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:25.753238 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c20120-d9c6-41de-b1d0-1b4eca5538d9 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:25.758755 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dfed7f-deae-4285-99c2-96e6bf9833e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1be2652c984a4283aeee0b937f0555e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:25.759405 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dfed7f-deae-4285-99c2-96e6bf9833e6 service nova] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:25.759718 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dfed7f-deae-4285-99c2-96e6bf9833e6 service nova] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:25.759997 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dfed7f-deae-4285-99c2-96e6bf9833e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:25.768976 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dfed7f-deae-4285-99c2-96e6bf9833e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:25.770554 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dfed7f-deae-4285-99c2-96e6bf9833e6 service nova] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:25.779841 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 741/1481] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:37:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:37:28.312459 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f133edd-933c-42c1-beef-21958baada58 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:28.313057 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f133edd-933c-42c1-beef-21958baada58 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:28.313057 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f133edd-933c-42c1-beef-21958baada58 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:28.314618 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 741/1482] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:37:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:37:28.319959 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db31700-6e95-406e-9bce-8a32ca7a2598 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:28.320375 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db31700-6e95-406e-9bce-8a32ca7a2598 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:28.320526 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db31700-6e95-406e-9bce-8a32ca7a2598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:28.338380 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-9db31700-6e95-406e-9bce-8a32ca7a2598 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:37:28.339604 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-9db31700-6e95-406e-9bce-8a32ca7a2598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:37:28.347966 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 742/1483] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:37:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:37:28.383615 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f133edd-933c-42c1-beef-21958baada58 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:28.394453 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f133edd-933c-42c1-beef-21958baada58 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:28.398498 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59802b00-ca87-4982-b3fe-0ae3b980d34e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:28.399145 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59802b00-ca87-4982-b3fe-0ae3b980d34e service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:28.399429 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59802b00-ca87-4982-b3fe-0ae3b980d34e service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:28.399743 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59802b00-ca87-4982-b3fe-0ae3b980d34e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:28.409343 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59802b00-ca87-4982-b3fe-0ae3b980d34e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:28.410785 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59802b00-ca87-4982-b3fe-0ae3b980d34e service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:28.420510 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 742/1484] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:37:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:37:30.815861 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a402e-9942-4b12-a592-dd36ba02934a None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:30.816354 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a402e-9942-4b12-a592-dd36ba02934a None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:30.816469 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a402e-9942-4b12-a592-dd36ba02934a None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:30.817782 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 743/1485] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:37:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:37:30.823574 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442fabd3-ff97-40c6-913b-26157a2a662b None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:30.824126 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442fabd3-ff97-40c6-913b-26157a2a662b None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:30.824287 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442fabd3-ff97-40c6-913b-26157a2a662b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:30.847632 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-442fabd3-ff97-40c6-913b-26157a2a662b None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:37:30.848842 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-442fabd3-ff97-40c6-913b-26157a2a662b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:37:30.857362 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 743/1486] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:37:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:37:30.896246 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a402e-9942-4b12-a592-dd36ba02934a None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:30.908636 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a402e-9942-4b12-a592-dd36ba02934a None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:30.912625 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a4e0c-4be2-4d35-ad80-dcbb8711ab5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:30.913452 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a4e0c-4be2-4d35-ad80-dcbb8711ab5f service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:30.913813 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a4e0c-4be2-4d35-ad80-dcbb8711ab5f service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:30.914235 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a4e0c-4be2-4d35-ad80-dcbb8711ab5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:30.925146 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671a4e0c-4be2-4d35-ad80-dcbb8711ab5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:30.926559 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671a4e0c-4be2-4d35-ad80-dcbb8711ab5f service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:30.936347 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 744/1487] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:37:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:37:33.641430 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de811b4-02cf-4cbf-a540-085b324f8e65 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:33.642029 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de811b4-02cf-4cbf-a540-085b324f8e65 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:33.642029 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de811b4-02cf-4cbf-a540-085b324f8e65 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:33.643350 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 744/1488] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:37:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:37:33.648801 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a9f44-7494-44c7-839b-8c5b21a13ecb None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:33.649233 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a9f44-7494-44c7-839b-8c5b21a13ecb None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:33.649400 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a9f44-7494-44c7-839b-8c5b21a13ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:33.669264 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-8c9a9f44-7494-44c7-839b-8c5b21a13ecb None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:37:33.669264 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-8c9a9f44-7494-44c7-839b-8c5b21a13ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:37:33.678131 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 745/1489] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:37:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:37:33.718983 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de811b4-02cf-4cbf-a540-085b324f8e65 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:33.730089 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de811b4-02cf-4cbf-a540-085b324f8e65 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:33.733576 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b9ed1a-f826-444b-bfdb-92bff86300e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:33.734361 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b9ed1a-f826-444b-bfdb-92bff86300e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:33.734645 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b9ed1a-f826-444b-bfdb-92bff86300e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:33.734921 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b9ed1a-f826-444b-bfdb-92bff86300e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:33.743902 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b9ed1a-f826-444b-bfdb-92bff86300e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:33.745319 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b9ed1a-f826-444b-bfdb-92bff86300e9 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:33.754757 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 745/1490] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:37:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:37:36.499439 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787eecbf-7943-4edb-817e-1ece12bcf3f9 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:36.499987 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787eecbf-7943-4edb-817e-1ece12bcf3f9 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:36.500235 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787eecbf-7943-4edb-817e-1ece12bcf3f9 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:36.501717 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 746/1491] 10.222.0.43 () {54 vars in 926 bytes} [Mon Apr 11 16:37:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:37:36.507286 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e27693-abe4-442b-9f6b-4830f2805de5 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:36.507841 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e27693-abe4-442b-9f6b-4830f2805de5 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:36.507992 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e27693-abe4-442b-9f6b-4830f2805de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:36.525363 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-c3e27693-abe4-442b-9f6b-4830f2805de5 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:37:36.526565 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-c3e27693-abe4-442b-9f6b-4830f2805de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:37:36.535108 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 746/1492] 10.222.0.43 () {58 vars in 1023 bytes} [Mon Apr 11 16:37:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:37:36.575461 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787eecbf-7943-4edb-817e-1ece12bcf3f9 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:36.589959 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787eecbf-7943-4edb-817e-1ece12bcf3f9 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:36.595656 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7817d0-3b9b-43c6-857b-bad800a5486b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:36.595656 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7817d0-3b9b-43c6-857b-bad800a5486b service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:36.595656 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7817d0-3b9b-43c6-857b-bad800a5486b service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:36.595656 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7817d0-3b9b-43c6-857b-bad800a5486b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:36.604974 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7817d0-3b9b-43c6-857b-bad800a5486b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:36.607297 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7817d0-3b9b-43c6-857b-bad800a5486b service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:36.617459 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 747/1493] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:37:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:39:20.308983 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf53bcb-e064-4c9e-9928-0732cd88612c None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:39:20.309583 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf53bcb-e064-4c9e-9928-0732cd88612c None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:39:20.309583 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf53bcb-e064-4c9e-9928-0732cd88612c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:39:20.329564 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-7bf53bcb-e064-4c9e-9928-0732cd88612c None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:39:20.330965 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-7bf53bcb-e064-4c9e-9928-0732cd88612c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:39:20.340179 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 747/1494] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:39:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:39:20.348416 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f154007-a55b-469b-9fa2-537aae234772 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:39:20.348964 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f154007-a55b-469b-9fa2-537aae234772 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:39:20.349089 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f154007-a55b-469b-9fa2-537aae234772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:39:20.366756 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-0f154007-a55b-469b-9fa2-537aae234772 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:39:20.367989 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-0f154007-a55b-469b-9fa2-537aae234772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:39:20.375891 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 748/1495] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:39:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:39:20.380531 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf53bcb-e064-4c9e-9928-0732cd88612c None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:39:20.390486 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf53bcb-e064-4c9e-9928-0732cd88612c None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:39:20.394910 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3276d91e-b806-42dc-9fbd-3364df584960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:39:20.395600 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3276d91e-b806-42dc-9fbd-3364df584960 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:39:20.395885 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3276d91e-b806-42dc-9fbd-3364df584960 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:39:20.396160 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3276d91e-b806-42dc-9fbd-3364df584960 admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:39:20.396887 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3276d91e-b806-42dc-9fbd-3364df584960 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:39:20.397194 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3276d91e-b806-42dc-9fbd-3364df584960 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:39:20.398193 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING py.warnings [None req-3276d91e-b806-42dc-9fbd-3364df584960 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 11 16:39:20.398193 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: warnings.warn(msg) Apr 11 16:39:20.398193 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: Apr 11 16:39:20.399072 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3276d91e-b806-42dc-9fbd-3364df584960 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:39:20.411314 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 748/1496] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Apr 11 16:39:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:39:20.419538 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f154007-a55b-469b-9fa2-537aae234772 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:39:20.428582 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f154007-a55b-469b-9fa2-537aae234772 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:39:20.433338 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78db396f-dc57-4f12-b6fa-ede7012fe472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:39:20.434165 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78db396f-dc57-4f12-b6fa-ede7012fe472 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:39:20.434501 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78db396f-dc57-4f12-b6fa-ede7012fe472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:39:20.434780 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78db396f-dc57-4f12-b6fa-ede7012fe472 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:39:20.435476 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78db396f-dc57-4f12-b6fa-ede7012fe472 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:39:20.437234 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING py.warnings [None req-78db396f-dc57-4f12-b6fa-ede7012fe472 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 11 16:39:20.437234 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: warnings.warn(msg) Apr 11 16:39:20.437234 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: Apr 11 16:39:20.438668 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78db396f-dc57-4f12-b6fa-ede7012fe472 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:39:20.590831 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 749/1497] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:39:20 2022] POST /identity/v3/projects => generated 377 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:39:20.594665 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3276d91e-b806-42dc-9fbd-3364df584960 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:39:20.604389 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3276d91e-b806-42dc-9fbd-3364df584960 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:39:20.659172 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b81ef-e367-4d64-b9bf-e184ee644d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:39:20.659874 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b81ef-e367-4d64-b9bf-e184ee644d8f admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:39:20.660163 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b81ef-e367-4d64-b9bf-e184ee644d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:39:20.660444 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b81ef-e367-4d64-b9bf-e184ee644d8f admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:39:20.661145 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6b81ef-e367-4d64-b9bf-e184ee644d8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:39:20.662145 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING py.warnings [None req-0b6b81ef-e367-4d64-b9bf-e184ee644d8f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 11 16:39:20.662145 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: warnings.warn(msg) Apr 11 16:39:20.662145 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: Apr 11 16:39:20.663343 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6b81ef-e367-4d64-b9bf-e184ee644d8f admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:39:20.804147 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 749/1498] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:39:20 2022] POST /identity/v3/users => generated 289 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:39:20.808861 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78db396f-dc57-4f12-b6fa-ede7012fe472 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:39:20.819550 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78db396f-dc57-4f12-b6fa-ede7012fe472 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:39:20.825145 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7e8793-d716-4b59-9397-8efea60eb897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:39:20.825833 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e8793-d716-4b59-9397-8efea60eb897 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:39:20.826158 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e8793-d716-4b59-9397-8efea60eb897 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:39:20.826439 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e8793-d716-4b59-9397-8efea60eb897 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:39:20.827202 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7e8793-d716-4b59-9397-8efea60eb897 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:39:20.828275 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING py.warnings [None req-9f7e8793-d716-4b59-9397-8efea60eb897 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 11 16:39:20.828275 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: warnings.warn(msg) Apr 11 16:39:20.828275 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: Apr 11 16:39:20.829186 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7e8793-d716-4b59-9397-8efea60eb897 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:39:20.849124 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 750/1499] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:39:20 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:39:20.853105 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b81ef-e367-4d64-b9bf-e184ee644d8f admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:39:20.863344 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b81ef-e367-4d64-b9bf-e184ee644d8f admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:39:20.868901 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef501d61-a12c-4a3a-ad4a-ebafacc137f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:39:20.868901 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef501d61-a12c-4a3a-ad4a-ebafacc137f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:39:20.868901 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef501d61-a12c-4a3a-ad4a-ebafacc137f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:39:20.869239 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef501d61-a12c-4a3a-ad4a-ebafacc137f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:39:20.869848 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef501d61-a12c-4a3a-ad4a-ebafacc137f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:39:20.871485 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING py.warnings [None req-ef501d61-a12c-4a3a-ad4a-ebafacc137f2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 11 16:39:20.871485 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: warnings.warn(msg) Apr 11 16:39:20.871485 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: Apr 11 16:39:20.872395 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef501d61-a12c-4a3a-ad4a-ebafacc137f2 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:39:20.887768 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 750/1500] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:39:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:39:20.892084 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7e8793-d716-4b59-9397-8efea60eb897 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:39:20.902204 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7e8793-d716-4b59-9397-8efea60eb897 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:39:20.907012 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c558f58-87cb-47f4-a29d-2114257c3423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:39:20.907947 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c558f58-87cb-47f4-a29d-2114257c3423 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:39:20.908236 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c558f58-87cb-47f4-a29d-2114257c3423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:39:20.908675 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c558f58-87cb-47f4-a29d-2114257c3423 admin admin] PATH_INFO: `/v3/projects/e4f1a76a4d324b5299e84ea602850843/users/cd8fdd6a74484cf786cb16e6623d240c/roles/0d41da7bec094450b5bff4e4831be52c` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:39:20.923874 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c558f58-87cb-47f4-a29d-2114257c3423 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4f1a76a4d324b5299e84ea602850843, user_id=cd8fdd6a74484cf786cb16e6623d240c, role_id=0d41da7bec094450b5bff4e4831be52c)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:39:20.924909 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING py.warnings [None req-0c558f58-87cb-47f4-a29d-2114257c3423 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 11 16:39:20.924909 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: warnings.warn(msg) Apr 11 16:39:20.924909 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: Apr 11 16:39:20.926863 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c558f58-87cb-47f4-a29d-2114257c3423 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:39:21.014734 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 751/1501] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:39:20 2022] PUT /identity/v3/projects/e4f1a76a4d324b5299e84ea602850843/users/cd8fdd6a74484cf786cb16e6623d240c/roles/0d41da7bec094450b5bff4e4831be52c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:39:21.026100 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75197128-62a2-45dc-805b-18dc2c4f8535 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:39:21.026392 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75197128-62a2-45dc-805b-18dc2c4f8535 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:39:21.026677 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75197128-62a2-45dc-805b-18dc2c4f8535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:39:21.053259 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-75197128-62a2-45dc-805b-18dc2c4f8535 None None] MFA Rules not processed for user `cd8fdd6a74484cf786cb16e6623d240c`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:39:21.054530 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-75197128-62a2-45dc-805b-18dc2c4f8535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:39:21.123005 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 751/1502] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:39:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:39:21.134282 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c558f58-87cb-47f4-a29d-2114257c3423 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:39:21.206371 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c558f58-87cb-47f4-a29d-2114257c3423 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:39:21.213546 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d31c54-c1d4-4cdf-b690-69dac1ae43dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1be2652c984a4283aeee0b937f0555e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:39:21.216392 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d31c54-c1d4-4cdf-b690-69dac1ae43dc service nova] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:39:21.216392 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d31c54-c1d4-4cdf-b690-69dac1ae43dc service nova] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:39:21.216392 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d31c54-c1d4-4cdf-b690-69dac1ae43dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:39:21.224581 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d31c54-c1d4-4cdf-b690-69dac1ae43dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:39:21.226195 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d31c54-c1d4-4cdf-b690-69dac1ae43dc service nova] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:39:21.236102 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 752/1503] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:39:21 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 16:39:21.309019 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183e802-c0fa-49e6-b41e-f366bd740472 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:39:21.309417 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183e802-c0fa-49e6-b41e-f366bd740472 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:39:21.309604 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183e802-c0fa-49e6-b41e-f366bd740472 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:39:21.310872 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 752/1504] 10.222.0.43 () {52 vars in 829 bytes} [Mon Apr 11 16:39:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:39:21.315551 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d31c54-c1d4-4cdf-b690-69dac1ae43dc service nova] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:39:21.375745 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d31c54-c1d4-4cdf-b690-69dac1ae43dc service nova] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:39:21.380296 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1459937-57ea-45a2-9bc4-b4f818571929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:39:21.381167 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1459937-57ea-45a2-9bc4-b4f818571929 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:39:21.381456 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1459937-57ea-45a2-9bc4-b4f818571929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:39:21.381727 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1459937-57ea-45a2-9bc4-b4f818571929 admin admin] PATH_INFO: `/v3/users/cd8fdd6a74484cf786cb16e6623d240c` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:39:21.382904 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1459937-57ea-45a2-9bc4-b4f818571929 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd8fdd6a74484cf786cb16e6623d240c)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:39:21.383937 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING py.warnings [None req-d1459937-57ea-45a2-9bc4-b4f818571929 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 11 16:39:21.383937 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: warnings.warn(msg) Apr 11 16:39:21.383937 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: Apr 11 16:39:21.385148 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1459937-57ea-45a2-9bc4-b4f818571929 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:39:21.700868 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-d1459937-57ea-45a2-9bc4-b4f818571929 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd8fdd6a74484cf786cb16e6623d240c'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:39:21.849798 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-d1459937-57ea-45a2-9bc4-b4f818571929 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd8fdd6a74484cf786cb16e6623d240c'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:39:21.863837 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-d1459937-57ea-45a2-9bc4-b4f818571929 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd8fdd6a74484cf786cb16e6623d240c'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:39:21.864584 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-d1459937-57ea-45a2-9bc4-b4f818571929 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd8fdd6a74484cf786cb16e6623d240c'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:39:21.883548 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-d1459937-57ea-45a2-9bc4-b4f818571929 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd8fdd6a74484cf786cb16e6623d240c'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:39:21.890266 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 753/1505] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:39:21 2022] DELETE /identity/v3/users/cd8fdd6a74484cf786cb16e6623d240c => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:39:21.894687 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693e83a-9c5e-44e3-b1c2-cabb8db3ede3 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:39:21.895011 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693e83a-9c5e-44e3-b1c2-cabb8db3ede3 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:39:21.895287 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693e83a-9c5e-44e3-b1c2-cabb8db3ede3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:39:21.913307 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-0693e83a-9c5e-44e3-b1c2-cabb8db3ede3 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:39:21.914519 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0693e83a-9c5e-44e3-b1c2-cabb8db3ede3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:39:21.973151 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 753/1506] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:39:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:39:21.982759 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1459937-57ea-45a2-9bc4-b4f818571929 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:39:21.984211 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-d1459937-57ea-45a2-9bc4-b4f818571929 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:39:22.043047 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1459937-57ea-45a2-9bc4-b4f818571929 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:39:22.046712 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173ea4df-0084-4071-be48-e17b97d55a21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:39:22.047369 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ea4df-0084-4071-be48-e17b97d55a21 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:39:22.047714 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ea4df-0084-4071-be48-e17b97d55a21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:39:22.047995 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ea4df-0084-4071-be48-e17b97d55a21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:39:22.056889 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173ea4df-0084-4071-be48-e17b97d55a21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:39:22.058430 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173ea4df-0084-4071-be48-e17b97d55a21 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:39:22.068109 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 754/1507] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:39:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 16:39:22.583295 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0693e83a-9c5e-44e3-b1c2-cabb8db3ede3 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:39:22.584828 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0693e83a-9c5e-44e3-b1c2-cabb8db3ede3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:39:22.596534 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0693e83a-9c5e-44e3-b1c2-cabb8db3ede3 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:39:22.601591 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208962e5-6600-499f-8b9e-9c36c19b278b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:39:22.602465 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208962e5-6600-499f-8b9e-9c36c19b278b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:39:22.602758 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208962e5-6600-499f-8b9e-9c36c19b278b admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:39:22.603032 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208962e5-6600-499f-8b9e-9c36c19b278b admin admin] PATH_INFO: `/v3/projects/e4f1a76a4d324b5299e84ea602850843` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:39:22.604322 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208962e5-6600-499f-8b9e-9c36c19b278b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4f1a76a4d324b5299e84ea602850843)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:39:22.605995 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING py.warnings [None req-208962e5-6600-499f-8b9e-9c36c19b278b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 11 16:39:22.605995 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: warnings.warn(msg) Apr 11 16:39:22.605995 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: Apr 11 16:39:22.607175 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208962e5-6600-499f-8b9e-9c36c19b278b admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:39:22.733641 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-208962e5-6600-499f-8b9e-9c36c19b278b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4f1a76a4d324b5299e84ea602850843', 'request_id': 'req-208962e5-6600-499f-8b9e-9c36c19b278b'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:39:22.739888 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-208962e5-6600-499f-8b9e-9c36c19b278b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4f1a76a4d324b5299e84ea602850843', 'request_id': 'req-208962e5-6600-499f-8b9e-9c36c19b278b'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:39:22.884119 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-208962e5-6600-499f-8b9e-9c36c19b278b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4f1a76a4d324b5299e84ea602850843', 'request_id': 'req-208962e5-6600-499f-8b9e-9c36c19b278b'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:39:22.904614 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-208962e5-6600-499f-8b9e-9c36c19b278b admin admin] The token cache is being invalidate because project e4f1a76a4d324b5299e84ea602850843 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:39:22.904966 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-208962e5-6600-499f-8b9e-9c36c19b278b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:39:22.905785 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-208962e5-6600-499f-8b9e-9c36c19b278b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:39:22.907470 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 754/1508] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:39:22 2022] DELETE /identity/v3/projects/e4f1a76a4d324b5299e84ea602850843 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:41:07.633557 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f0659-c5c5-49f7-9b36-35ee0ad00623 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:41:07.634156 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f0659-c5c5-49f7-9b36-35ee0ad00623 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:41:07.634156 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f0659-c5c5-49f7-9b36-35ee0ad00623 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:41:07.635799 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 755/1509] 127.0.0.1 () {54 vars in 901 bytes} [Mon Apr 11 16:41:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:41:07.641154 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f89a1-10b9-4e4c-902e-b5e7f3544e79 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:41:07.641598 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f89a1-10b9-4e4c-902e-b5e7f3544e79 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:41:07.641707 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f89a1-10b9-4e4c-902e-b5e7f3544e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:41:07.660322 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-e37f89a1-10b9-4e4c-902e-b5e7f3544e79 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:41:07.661521 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e37f89a1-10b9-4e4c-902e-b5e7f3544e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:41:07.718864 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 755/1510] 127.0.0.1 () {58 vars in 998 bytes} [Mon Apr 11 16:41:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:41:07.874252 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9f0659-c5c5-49f7-9b36-35ee0ad00623 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:41:07.876198 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-fc9f0659-c5c5-49f7-9b36-35ee0ad00623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:41:07.949367 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9f0659-c5c5-49f7-9b36-35ee0ad00623 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:41:07.954729 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8e6597-9044-46f2-8674-8cf7df27dd9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1be2652c984a4283aeee0b937f0555e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:41:07.955403 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e6597-9044-46f2-8674-8cf7df27dd9e service nova] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:41:07.955726 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e6597-9044-46f2-8674-8cf7df27dd9e service nova] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:41:07.956006 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e6597-9044-46f2-8674-8cf7df27dd9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:41:07.964773 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8e6597-9044-46f2-8674-8cf7df27dd9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:41:07.966383 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8e6597-9044-46f2-8674-8cf7df27dd9e service nova] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:41:07.975669 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 756/1511] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:41:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:41:08.813550 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc325b-ac90-433b-bc44-81e61676e558 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:41:08.814370 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc325b-ac90-433b-bc44-81e61676e558 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:41:08.814629 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc325b-ac90-433b-bc44-81e61676e558 None None] PATH_INFO: `/v3` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:41:08.816358 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 756/1512] 10.222.0.60 () {54 vars in 925 bytes} [Mon Apr 11 16:41:08 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:41:08.823648 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37980af2-8815-4218-b334-9f1f3c0e728e None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:41:08.824146 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37980af2-8815-4218-b334-9f1f3c0e728e None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:41:08.824267 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37980af2-8815-4218-b334-9f1f3c0e728e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:41:08.843713 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-37980af2-8815-4218-b334-9f1f3c0e728e None None] MFA Rules not processed for user `6589debd41bf496085c7339ab5409666`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:41:08.845058 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-37980af2-8815-4218-b334-9f1f3c0e728e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:41:08.911991 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 757/1513] 10.222.0.60 () {58 vars in 1015 bytes} [Mon Apr 11 16:41:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:41:09.290718 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b930f-aeb5-4d10-b217-4f900225f149 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:41:09.291057 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b930f-aeb5-4d10-b217-4f900225f149 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:41:09.291456 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b930f-aeb5-4d10-b217-4f900225f149 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:41:09.292996 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 757/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Apr 11 16:41:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 16:41:09.298389 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23c8d15-007c-4184-831b-50606049dd14 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:41:09.298678 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23c8d15-007c-4184-831b-50606049dd14 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:41:09.298951 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23c8d15-007c-4184-831b-50606049dd14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:41:09.320586 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-a23c8d15-007c-4184-831b-50606049dd14 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:41:09.321818 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-a23c8d15-007c-4184-831b-50606049dd14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:41:09.330457 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 758/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Apr 11 16:41:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:41:09.499996 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055b930f-aeb5-4d10-b217-4f900225f149 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:41:09.515988 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055b930f-aeb5-4d10-b217-4f900225f149 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:41:09.521275 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4230a6dd-5f16-4537-a37b-edf851dd60c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1be2652c984a4283aeee0b937f0555e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:41:09.521914 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4230a6dd-5f16-4537-a37b-edf851dd60c2 service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:41:09.522198 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4230a6dd-5f16-4537-a37b-edf851dd60c2 service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:41:09.522476 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4230a6dd-5f16-4537-a37b-edf851dd60c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:41:09.530922 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4230a6dd-5f16-4537-a37b-edf851dd60c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:41:09.532533 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4230a6dd-5f16-4537-a37b-edf851dd60c2 service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:41:09.542396 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 758/1516] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:41:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:41:13.295281 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b42ff-33b8-4ed5-95d4-6d83d69bd964 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:41:13.295848 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b42ff-33b8-4ed5-95d4-6d83d69bd964 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:41:13.295964 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b42ff-33b8-4ed5-95d4-6d83d69bd964 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:41:13.297259 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 759/1517] 10.222.0.43 () {54 vars in 960 bytes} [Mon Apr 11 16:41:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:41:13.302317 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aaca3a-ee03-467a-9b22-179e281818e3 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:41:13.302764 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aaca3a-ee03-467a-9b22-179e281818e3 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:41:13.303002 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aaca3a-ee03-467a-9b22-179e281818e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:41:13.328709 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-e5aaca3a-ee03-467a-9b22-179e281818e3 None None] MFA Rules not processed for user `6589debd41bf496085c7339ab5409666`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:41:13.330758 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e5aaca3a-ee03-467a-9b22-179e281818e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:41:13.346423 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 759/1518] 10.222.0.43 () {58 vars in 1057 bytes} [Mon Apr 11 16:41:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:41:13.354034 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b42ff-33b8-4ed5-95d4-6d83d69bd964 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:41:13.367482 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b42ff-33b8-4ed5-95d4-6d83d69bd964 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:41:13.373250 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed8669-f82d-4128-926b-1ab183869adc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6589debd41bf496085c7339ab5409666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:41:13.373913 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed8669-f82d-4128-926b-1ab183869adc service placement] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:41:13.374198 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed8669-f82d-4128-926b-1ab183869adc service placement] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:41:13.374475 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed8669-f82d-4128-926b-1ab183869adc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:41:13.386739 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ed8669-f82d-4128-926b-1ab183869adc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:41:13.388443 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ed8669-f82d-4128-926b-1ab183869adc service placement] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:41:13.398294 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 760/1519] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:41:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:41:21.325469 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d42c7-430c-4f19-b777-273718617214 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:41:21.325469 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d42c7-430c-4f19-b777-273718617214 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:41:21.325469 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d42c7-430c-4f19-b777-273718617214 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:41:21.325469 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 760/1520] 127.0.0.1 () {54 vars in 901 bytes} [Mon Apr 11 16:41:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:41:21.330989 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc952f-7587-4cef-8d14-608fa33405d1 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:41:21.331480 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc952f-7587-4cef-8d14-608fa33405d1 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:41:21.331624 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc952f-7587-4cef-8d14-608fa33405d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:41:21.351369 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-4dcc952f-7587-4cef-8d14-608fa33405d1 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:41:21.352588 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-4dcc952f-7587-4cef-8d14-608fa33405d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:41:21.360857 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 761/1521] 127.0.0.1 () {58 vars in 998 bytes} [Mon Apr 11 16:41:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:41:21.512265 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d42c7-430c-4f19-b777-273718617214 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:41:21.527099 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d42c7-430c-4f19-b777-273718617214 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:41:21.532732 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d747f4e9-ec42-4b3b-a58b-f0b62297d33f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1be2652c984a4283aeee0b937f0555e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:41:21.533372 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747f4e9-ec42-4b3b-a58b-f0b62297d33f service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:41:21.533653 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747f4e9-ec42-4b3b-a58b-f0b62297d33f service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:41:21.533926 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747f4e9-ec42-4b3b-a58b-f0b62297d33f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:41:21.542110 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d747f4e9-ec42-4b3b-a58b-f0b62297d33f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:41:21.543719 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d747f4e9-ec42-4b3b-a58b-f0b62297d33f service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:41:21.553143 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 761/1522] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:41:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:41:22.847487 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d7805-eefd-4770-bc27-20ff3527e8c1 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:41:22.848051 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d7805-eefd-4770-bc27-20ff3527e8c1 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:41:22.848051 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d7805-eefd-4770-bc27-20ff3527e8c1 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:41:22.849369 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 762/1523] 127.0.0.1 () {54 vars in 901 bytes} [Mon Apr 11 16:41:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:41:22.854836 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece28cd1-3c17-4a96-9308-fa4b70b943f5 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:41:22.855292 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece28cd1-3c17-4a96-9308-fa4b70b943f5 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:41:22.855396 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece28cd1-3c17-4a96-9308-fa4b70b943f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:41:22.875107 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-ece28cd1-3c17-4a96-9308-fa4b70b943f5 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:41:22.876349 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ece28cd1-3c17-4a96-9308-fa4b70b943f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:41:22.885389 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 762/1524] 127.0.0.1 () {58 vars in 998 bytes} [Mon Apr 11 16:41:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:41:23.050642 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d7805-eefd-4770-bc27-20ff3527e8c1 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:41:23.065488 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d7805-eefd-4770-bc27-20ff3527e8c1 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:41:23.070789 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92584bf3-9fc0-43f5-b7c9-9bce03ab8731 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1be2652c984a4283aeee0b937f0555e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:41:23.071434 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92584bf3-9fc0-43f5-b7c9-9bce03ab8731 service nova] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:41:23.072293 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92584bf3-9fc0-43f5-b7c9-9bce03ab8731 service nova] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:41:23.072570 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92584bf3-9fc0-43f5-b7c9-9bce03ab8731 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:41:23.080576 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92584bf3-9fc0-43f5-b7c9-9bce03ab8731 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:41:23.082145 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92584bf3-9fc0-43f5-b7c9-9bce03ab8731 service nova] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:41:23.092416 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 763/1525] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:41:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:41:27.637030 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15716fc1-938d-4cf8-be43-9af6e1ac9557 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:41:27.637694 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15716fc1-938d-4cf8-be43-9af6e1ac9557 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:41:27.637694 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15716fc1-938d-4cf8-be43-9af6e1ac9557 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:41:27.638954 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 763/1526] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 11 16:41:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:41:27.644218 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35844452-6131-4867-bc46-893f7d360ace None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:41:27.644654 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35844452-6131-4867-bc46-893f7d360ace None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:41:27.644789 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35844452-6131-4867-bc46-893f7d360ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:41:27.662974 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-35844452-6131-4867-bc46-893f7d360ace None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:41:27.664209 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-35844452-6131-4867-bc46-893f7d360ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:41:27.672037 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 764/1527] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 11 16:41:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:41:27.709165 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15716fc1-938d-4cf8-be43-9af6e1ac9557 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:41:27.710845 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-15716fc1-938d-4cf8-be43-9af6e1ac9557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:41:27.765990 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15716fc1-938d-4cf8-be43-9af6e1ac9557 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:41:27.769370 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8221fcc-bb4d-4d87-be33-876d98de35d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:41:27.770009 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8221fcc-bb4d-4d87-be33-876d98de35d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:41:27.770291 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8221fcc-bb4d-4d87-be33-876d98de35d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:41:27.770566 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8221fcc-bb4d-4d87-be33-876d98de35d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:41:27.779297 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8221fcc-bb4d-4d87-be33-876d98de35d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:41:27.780728 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8221fcc-bb4d-4d87-be33-876d98de35d0 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:41:27.789730 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 764/1528] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:41:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:41:30.146726 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf86582-d50c-46c0-850d-e208ae5b7927 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:41:30.147293 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf86582-d50c-46c0-850d-e208ae5b7927 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:41:30.147293 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf86582-d50c-46c0-850d-e208ae5b7927 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:41:30.148697 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 765/1529] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 11 16:41:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:41:30.155155 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b2448-0e01-4fee-b058-c97f645d8f32 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:41:30.155670 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b2448-0e01-4fee-b058-c97f645d8f32 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:41:30.155761 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b2448-0e01-4fee-b058-c97f645d8f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:41:30.174154 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-916b2448-0e01-4fee-b058-c97f645d8f32 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:41:30.175348 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-916b2448-0e01-4fee-b058-c97f645d8f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:41:30.183247 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 765/1530] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 11 16:41:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:41:30.219422 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf86582-d50c-46c0-850d-e208ae5b7927 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:41:30.231301 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf86582-d50c-46c0-850d-e208ae5b7927 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:41:30.234850 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722a0244-5311-4091-a5cc-e171b8551516 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:41:30.235499 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a0244-5311-4091-a5cc-e171b8551516 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:41:30.235823 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a0244-5311-4091-a5cc-e171b8551516 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:41:30.236129 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a0244-5311-4091-a5cc-e171b8551516 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:41:30.245379 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722a0244-5311-4091-a5cc-e171b8551516 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:41:30.246802 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722a0244-5311-4091-a5cc-e171b8551516 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:41:30.256143 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 766/1531] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:41:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:41:34.150385 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26ac4d-2b9a-48da-8e84-550d1713e6dd None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:41:34.150993 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26ac4d-2b9a-48da-8e84-550d1713e6dd None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:41:34.150993 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26ac4d-2b9a-48da-8e84-550d1713e6dd None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:41:34.152328 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 766/1532] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 11 16:41:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:41:34.158048 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a48006-0af6-4c8c-b836-87a5d6fba267 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:41:34.158487 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a48006-0af6-4c8c-b836-87a5d6fba267 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:41:34.158595 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a48006-0af6-4c8c-b836-87a5d6fba267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:41:34.176770 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-88a48006-0af6-4c8c-b836-87a5d6fba267 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:41:34.177968 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-88a48006-0af6-4c8c-b836-87a5d6fba267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:41:34.186333 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 767/1533] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 11 16:41:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:41:34.465656 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f26ac4d-2b9a-48da-8e84-550d1713e6dd None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:41:34.467365 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-6f26ac4d-2b9a-48da-8e84-550d1713e6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:41:34.524985 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f26ac4d-2b9a-48da-8e84-550d1713e6dd None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:41:34.528677 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c149f62-e221-4e57-bdbd-e0a9d9621418 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '950b5b5f690d41509ead753065a0b793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:41:34.529321 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c149f62-e221-4e57-bdbd-e0a9d9621418 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:41:34.529610 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c149f62-e221-4e57-bdbd-e0a9d9621418 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:41:34.529884 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c149f62-e221-4e57-bdbd-e0a9d9621418 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:41:34.539238 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c149f62-e221-4e57-bdbd-e0a9d9621418 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:41:34.541300 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c149f62-e221-4e57-bdbd-e0a9d9621418 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:41:34.550742 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 767/1534] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:41:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:41:36.949391 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19dbb0d-40db-4bb9-87bb-763eb8ad1b3c None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:41:36.949931 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19dbb0d-40db-4bb9-87bb-763eb8ad1b3c None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:41:36.949931 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19dbb0d-40db-4bb9-87bb-763eb8ad1b3c None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:41:36.951365 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 768/1535] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 11 16:41:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:41:36.956781 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6107dc8-4bc3-4162-a17a-9e42bba819e0 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:41:36.957207 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6107dc8-4bc3-4162-a17a-9e42bba819e0 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:41:36.957377 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6107dc8-4bc3-4162-a17a-9e42bba819e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:41:36.975193 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-d6107dc8-4bc3-4162-a17a-9e42bba819e0 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:41:36.976426 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-d6107dc8-4bc3-4162-a17a-9e42bba819e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:41:36.984232 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 768/1536] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 11 16:41:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:41:37.264319 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85673b9-87f6-4d3d-b3d4-32291f44c2cb None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:41:37.264617 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85673b9-87f6-4d3d-b3d4-32291f44c2cb None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:41:37.264901 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85673b9-87f6-4d3d-b3d4-32291f44c2cb None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:41:37.266272 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 769/1537] 10.222.0.43 () {54 vars in 962 bytes} [Mon Apr 11 16:41:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:41:37.271140 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e68d62-104b-447b-b0e8-b26b97e27951 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:41:37.271432 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e68d62-104b-447b-b0e8-b26b97e27951 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:41:37.271735 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e68d62-104b-447b-b0e8-b26b97e27951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:41:37.289015 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-49e68d62-104b-447b-b0e8-b26b97e27951 None None] MFA Rules not processed for user `950b5b5f690d41509ead753065a0b793`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:41:37.290732 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-49e68d62-104b-447b-b0e8-b26b97e27951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:41:37.297511 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 769/1538] 10.222.0.43 () {58 vars in 1059 bytes} [Mon Apr 11 16:41:37 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:41:37.305116 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85673b9-87f6-4d3d-b3d4-32291f44c2cb None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:41:37.316701 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85673b9-87f6-4d3d-b3d4-32291f44c2cb None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:41:37.320203 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ba7133-91f6-4f6d-811e-67a6eb8d39e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '950b5b5f690d41509ead753065a0b793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:41:37.320837 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba7133-91f6-4f6d-811e-67a6eb8d39e6 service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:41:37.321640 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba7133-91f6-4f6d-811e-67a6eb8d39e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:41:37.321918 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba7133-91f6-4f6d-811e-67a6eb8d39e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:41:37.330736 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ba7133-91f6-4f6d-811e-67a6eb8d39e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:41:37.332187 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ba7133-91f6-4f6d-811e-67a6eb8d39e6 service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:41:37.341965 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 770/1539] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:41:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:43:11.690065 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a7ffc5-6b26-4ad9-aa90-6dc03d8a11d9 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:11.690700 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a7ffc5-6b26-4ad9-aa90-6dc03d8a11d9 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:11.690700 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a7ffc5-6b26-4ad9-aa90-6dc03d8a11d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:11.695423 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c12bd03-74dd-4331-806b-1bc5a5fd815e None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:11.695963 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c12bd03-74dd-4331-806b-1bc5a5fd815e None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:11.696071 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c12bd03-74dd-4331-806b-1bc5a5fd815e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:11.720646 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-05a7ffc5-6b26-4ad9-aa90-6dc03d8a11d9 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:11.721863 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-05a7ffc5-6b26-4ad9-aa90-6dc03d8a11d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:11.725657 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-8c12bd03-74dd-4331-806b-1bc5a5fd815e None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:11.726935 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-8c12bd03-74dd-4331-806b-1bc5a5fd815e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:11.736371 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 770/1540] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:43:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:11.738143 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 771/1541] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:43:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:11.747591 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1bd849-79fc-4a03-88ba-22d08e9e536a None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:11.747930 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1bd849-79fc-4a03-88ba-22d08e9e536a None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:11.748162 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1bd849-79fc-4a03-88ba-22d08e9e536a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:11.752541 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01aa85a-d99d-4fba-80d6-ca789da3da56 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:11.752838 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01aa85a-d99d-4fba-80d6-ca789da3da56 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:11.753120 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01aa85a-d99d-4fba-80d6-ca789da3da56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:11.776264 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-8b1bd849-79fc-4a03-88ba-22d08e9e536a None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:11.777506 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-8b1bd849-79fc-4a03-88ba-22d08e9e536a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:11.781568 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-d01aa85a-d99d-4fba-80d6-ca789da3da56 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:11.782748 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-d01aa85a-d99d-4fba-80d6-ca789da3da56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:11.795281 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 772/1542] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:43:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:43:11.795650 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 771/1543] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:43:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:11.800458 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01aa85a-d99d-4fba-80d6-ca789da3da56 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:11.810450 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1bd849-79fc-4a03-88ba-22d08e9e536a None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:11.814458 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01aa85a-d99d-4fba-80d6-ca789da3da56 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:11.827932 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1bd849-79fc-4a03-88ba-22d08e9e536a None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:11.828164 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017d3e27-fdfb-4530-9f57-6c854404d1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:11.828906 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d3e27-fdfb-4530-9f57-6c854404d1c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:11.829191 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d3e27-fdfb-4530-9f57-6c854404d1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:11.829467 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d3e27-fdfb-4530-9f57-6c854404d1c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:11.830307 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017d3e27-fdfb-4530-9f57-6c854404d1c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:43:11.830620 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017d3e27-fdfb-4530-9f57-6c854404d1c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:11.831671 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING py.warnings [None req-017d3e27-fdfb-4530-9f57-6c854404d1c0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 11 16:43:11.831671 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: warnings.warn(msg) Apr 11 16:43:11.831671 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: Apr 11 16:43:11.832564 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017d3e27-fdfb-4530-9f57-6c854404d1c0 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:11.845026 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687c1562-99d0-4c58-9acd-d74db1051795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:11.845718 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687c1562-99d0-4c58-9acd-d74db1051795 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:11.846004 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687c1562-99d0-4c58-9acd-d74db1051795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:11.846286 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687c1562-99d0-4c58-9acd-d74db1051795 admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:11.847027 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687c1562-99d0-4c58-9acd-d74db1051795 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:43:11.847338 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687c1562-99d0-4c58-9acd-d74db1051795 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:11.848992 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687c1562-99d0-4c58-9acd-d74db1051795 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:11.858177 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 773/1544] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Apr 11 16:43:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:43:11.875534 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 772/1545] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Apr 11 16:43:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:43:11.876833 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687c1562-99d0-4c58-9acd-d74db1051795 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:11.876970 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017d3e27-fdfb-4530-9f57-6c854404d1c0 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:11.887094 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687c1562-99d0-4c58-9acd-d74db1051795 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:11.898906 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017d3e27-fdfb-4530-9f57-6c854404d1c0 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:11.905305 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0822d4b8-ae9e-433e-adb2-e89d84482339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:11.906000 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0822d4b8-ae9e-433e-adb2-e89d84482339 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:11.906288 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0822d4b8-ae9e-433e-adb2-e89d84482339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:11.906568 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0822d4b8-ae9e-433e-adb2-e89d84482339 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:11.908145 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0822d4b8-ae9e-433e-adb2-e89d84482339 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:11.908287 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd4ed2e-2633-4474-bb5f-e8680e57fda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:11.908287 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4ed2e-2633-4474-bb5f-e8680e57fda5 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:11.908287 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4ed2e-2633-4474-bb5f-e8680e57fda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:11.908537 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING py.warnings [None req-0822d4b8-ae9e-433e-adb2-e89d84482339 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 11 16:43:11.908537 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: warnings.warn(msg) Apr 11 16:43:11.908537 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: Apr 11 16:43:11.908752 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4ed2e-2633-4474-bb5f-e8680e57fda5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:11.909249 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd4ed2e-2633-4474-bb5f-e8680e57fda5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:11.909507 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0822d4b8-ae9e-433e-adb2-e89d84482339 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:11.911137 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd4ed2e-2633-4474-bb5f-e8680e57fda5 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:12.025571 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 773/1546] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:43:11 2022] POST /identity/v3/projects => generated 371 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:43:12.030484 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0822d4b8-ae9e-433e-adb2-e89d84482339 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:12.076869 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 774/1547] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:43:11 2022] POST /identity/v3/projects => generated 373 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:43:12.090550 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd4ed2e-2633-4474-bb5f-e8680e57fda5 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:12.120744 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0822d4b8-ae9e-433e-adb2-e89d84482339 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:12.251339 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d11836f-8fe7-4a0e-9a82-c3ee7c2ffb1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:12.252110 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d11836f-8fe7-4a0e-9a82-c3ee7c2ffb1e admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:12.252399 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d11836f-8fe7-4a0e-9a82-c3ee7c2ffb1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:12.252678 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d11836f-8fe7-4a0e-9a82-c3ee7c2ffb1e admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:12.254063 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d11836f-8fe7-4a0e-9a82-c3ee7c2ffb1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:12.256314 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d11836f-8fe7-4a0e-9a82-c3ee7c2ffb1e admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:12.260079 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd4ed2e-2633-4474-bb5f-e8680e57fda5 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:12.275772 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3587736c-57ca-4d64-88a7-62de8f12fc3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:12.276870 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3587736c-57ca-4d64-88a7-62de8f12fc3d admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:12.277434 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3587736c-57ca-4d64-88a7-62de8f12fc3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:12.278115 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3587736c-57ca-4d64-88a7-62de8f12fc3d admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:12.279080 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3587736c-57ca-4d64-88a7-62de8f12fc3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:12.280572 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING py.warnings [None req-3587736c-57ca-4d64-88a7-62de8f12fc3d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 11 16:43:12.280572 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: warnings.warn(msg) Apr 11 16:43:12.280572 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: Apr 11 16:43:12.282311 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3587736c-57ca-4d64-88a7-62de8f12fc3d admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:12.369394 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 774/1548] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:43:12 2022] POST /identity/v3/users => generated 286 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:43:12.370452 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5fb939-fb41-49df-9584-2deec37dc3f3 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:12.370742 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5fb939-fb41-49df-9584-2deec37dc3f3 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:12.371020 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5fb939-fb41-49df-9584-2deec37dc3f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:12.392569 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-2f5fb939-fb41-49df-9584-2deec37dc3f3 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:12.393773 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-2f5fb939-fb41-49df-9584-2deec37dc3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:12.401777 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 775/1549] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:43:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:12.403065 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d6e88-023b-45cd-9060-4a1cbe1d6eb8 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:12.403354 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d6e88-023b-45cd-9060-4a1cbe1d6eb8 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:12.403662 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d6e88-023b-45cd-9060-4a1cbe1d6eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:12.423318 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-e72d6e88-023b-45cd-9060-4a1cbe1d6eb8 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:12.424593 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e72d6e88-023b-45cd-9060-4a1cbe1d6eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:12.433440 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 776/1550] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:43:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:12.434829 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f83fd-e9f4-4431-a186-4501bff7f7c4 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:12.435140 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f83fd-e9f4-4431-a186-4501bff7f7c4 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:12.435506 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f83fd-e9f4-4431-a186-4501bff7f7c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:12.443220 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 775/1551] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:43:12 2022] POST /identity/v3/users => generated 287 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:43:12.445244 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664ff4e-eb6e-4c0b-afd1-52730f646a85 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:12.445544 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664ff4e-eb6e-4c0b-afd1-52730f646a85 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:12.445928 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664ff4e-eb6e-4c0b-afd1-52730f646a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:12.454000 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-a24f83fd-e9f4-4431-a186-4501bff7f7c4 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:12.455215 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a24f83fd-e9f4-4431-a186-4501bff7f7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:12.463904 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 777/1552] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:43:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:12.467828 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-6664ff4e-eb6e-4c0b-afd1-52730f646a85 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:12.469065 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-6664ff4e-eb6e-4c0b-afd1-52730f646a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:12.473042 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780a771-b8b0-44c0-b0cf-cdff334b1040 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:12.473346 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780a771-b8b0-44c0-b0cf-cdff334b1040 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:12.473629 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780a771-b8b0-44c0-b0cf-cdff334b1040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:12.479219 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 776/1553] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:43:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:12.480197 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6664ff4e-eb6e-4c0b-afd1-52730f646a85 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:12.489964 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6664ff4e-eb6e-4c0b-afd1-52730f646a85 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:12.494127 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-e780a771-b8b0-44c0-b0cf-cdff334b1040 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:12.495358 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e780a771-b8b0-44c0-b0cf-cdff334b1040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:12.495540 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0aefa4-14f6-4103-855b-03b8ba2949d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:12.496253 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0aefa4-14f6-4103-855b-03b8ba2949d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:12.496536 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0aefa4-14f6-4103-855b-03b8ba2949d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:12.496808 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0aefa4-14f6-4103-855b-03b8ba2949d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:12.497528 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0aefa4-14f6-4103-855b-03b8ba2949d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:12.499138 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0aefa4-14f6-4103-855b-03b8ba2949d9 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:12.503686 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 778/1554] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:43:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:12.505281 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48da219-b278-4192-a28e-4e48a7416024 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:12.505281 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48da219-b278-4192-a28e-4e48a7416024 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:12.505529 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48da219-b278-4192-a28e-4e48a7416024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:12.513065 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 777/1555] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:43:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:43:12.513065 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1457045d-3d17-47ab-a820-af86f7ac03d9 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:12.513065 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1457045d-3d17-47ab-a820-af86f7ac03d9 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:12.513065 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1457045d-3d17-47ab-a820-af86f7ac03d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:12.527592 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-b48da219-b278-4192-a28e-4e48a7416024 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:12.528702 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b48da219-b278-4192-a28e-4e48a7416024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:12.530201 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-1457045d-3d17-47ab-a820-af86f7ac03d9 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:12.531365 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-1457045d-3d17-47ab-a820-af86f7ac03d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:12.536801 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 779/1556] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:43:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:12.538917 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac989bc-3247-4290-9348-867047828c8f None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:12.539311 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac989bc-3247-4290-9348-867047828c8f None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:12.539616 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac989bc-3247-4290-9348-867047828c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:12.544642 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 778/1557] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:43:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:12.544642 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1457045d-3d17-47ab-a820-af86f7ac03d9 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:12.553108 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1457045d-3d17-47ab-a820-af86f7ac03d9 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:12.558968 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848531d-9293-429e-b9e7-59939266c8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:12.559659 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848531d-9293-429e-b9e7-59939266c8e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:12.559941 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848531d-9293-429e-b9e7-59939266c8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:12.560212 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848531d-9293-429e-b9e7-59939266c8e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:12.560434 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-aac989bc-3247-4290-9348-867047828c8f None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:12.560935 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4848531d-9293-429e-b9e7-59939266c8e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:12.561673 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-aac989bc-3247-4290-9348-867047828c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:12.563178 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4848531d-9293-429e-b9e7-59939266c8e0 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:12.570063 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 780/1558] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:43:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:12.571474 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e72506-5563-4f61-9192-4fb254a53a24 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:12.571793 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e72506-5563-4f61-9192-4fb254a53a24 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:12.572078 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e72506-5563-4f61-9192-4fb254a53a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:12.575466 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 779/1559] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:43:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:43:12.577149 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e4211-5956-420c-9320-5e1a189536a0 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:12.577432 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e4211-5956-420c-9320-5e1a189536a0 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:12.577702 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e4211-5956-420c-9320-5e1a189536a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:12.592608 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-98e72506-5563-4f61-9192-4fb254a53a24 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:12.593811 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-98e72506-5563-4f61-9192-4fb254a53a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:12.595105 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-422e4211-5956-420c-9320-5e1a189536a0 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:12.596295 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-422e4211-5956-420c-9320-5e1a189536a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:12.602069 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 781/1560] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:43:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:12.603374 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd529c-c082-4351-aac5-0c8946869095 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:12.603703 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd529c-c082-4351-aac5-0c8946869095 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:12.603986 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd529c-c082-4351-aac5-0c8946869095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:12.607558 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 780/1561] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:43:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:12.607558 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422e4211-5956-420c-9320-5e1a189536a0 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:12.618136 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422e4211-5956-420c-9320-5e1a189536a0 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:12.622894 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f695ce62-8e6f-4c20-8617-69d4ca0b5f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:12.623585 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f695ce62-8e6f-4c20-8617-69d4ca0b5f44 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:12.623871 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f695ce62-8e6f-4c20-8617-69d4ca0b5f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:12.624265 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f695ce62-8e6f-4c20-8617-69d4ca0b5f44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:12.624375 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-18bd529c-c082-4351-aac5-0c8946869095 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:12.624877 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f695ce62-8e6f-4c20-8617-69d4ca0b5f44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:12.625418 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-18bd529c-c082-4351-aac5-0c8946869095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:12.626474 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f695ce62-8e6f-4c20-8617-69d4ca0b5f44 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:12.634073 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 782/1562] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:43:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:12.634929 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd529c-c082-4351-aac5-0c8946869095 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:12.638056 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 781/1563] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:43:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:43:12.638336 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8aecb2-0f2c-4f31-8ed8-7e25528d5929 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:12.638508 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8aecb2-0f2c-4f31-8ed8-7e25528d5929 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:12.638798 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8aecb2-0f2c-4f31-8ed8-7e25528d5929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:12.644843 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd529c-c082-4351-aac5-0c8946869095 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:12.651411 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08dbe49-0573-47d4-8711-b7952bd33073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:12.652188 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08dbe49-0573-47d4-8711-b7952bd33073 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:12.652496 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08dbe49-0573-47d4-8711-b7952bd33073 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:12.652927 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08dbe49-0573-47d4-8711-b7952bd33073 admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:12.653676 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08dbe49-0573-47d4-8711-b7952bd33073 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:43:12.653989 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08dbe49-0573-47d4-8711-b7952bd33073 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:12.655607 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08dbe49-0573-47d4-8711-b7952bd33073 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:12.656885 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-5b8aecb2-0f2c-4f31-8ed8-7e25528d5929 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:12.658082 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-5b8aecb2-0f2c-4f31-8ed8-7e25528d5929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:12.666812 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 782/1564] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:43:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:12.672797 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 783/1565] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Apr 11 16:43:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:43:12.672984 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8aecb2-0f2c-4f31-8ed8-7e25528d5929 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:12.673073 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08dbe49-0573-47d4-8711-b7952bd33073 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:12.678977 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8aecb2-0f2c-4f31-8ed8-7e25528d5929 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:12.682897 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08dbe49-0573-47d4-8711-b7952bd33073 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:12.684102 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f10e015-e947-47fd-a27e-730a532a35b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:12.684793 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f10e015-e947-47fd-a27e-730a532a35b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:12.685108 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f10e015-e947-47fd-a27e-730a532a35b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:12.685387 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f10e015-e947-47fd-a27e-730a532a35b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:12.686134 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f10e015-e947-47fd-a27e-730a532a35b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:43:12.686472 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f10e015-e947-47fd-a27e-730a532a35b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:12.688153 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f10e015-e947-47fd-a27e-730a532a35b2 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:12.690987 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12af8212-6a46-464e-95b7-ccd0f5e2049d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:12.692265 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af8212-6a46-464e-95b7-ccd0f5e2049d admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:12.692697 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af8212-6a46-464e-95b7-ccd0f5e2049d admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:12.693062 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af8212-6a46-464e-95b7-ccd0f5e2049d admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:12.694389 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12af8212-6a46-464e-95b7-ccd0f5e2049d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:12.696509 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12af8212-6a46-464e-95b7-ccd0f5e2049d admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:12.707572 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 783/1566] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Apr 11 16:43:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:43:12.707572 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f10e015-e947-47fd-a27e-730a532a35b2 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:12.712439 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f10e015-e947-47fd-a27e-730a532a35b2 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:12.713875 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 784/1567] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:43:12 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:43:12.717689 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12af8212-6a46-464e-95b7-ccd0f5e2049d admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:12.718035 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afd3b79-ade4-49dd-8696-afe22344049f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:12.718824 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd3b79-ade4-49dd-8696-afe22344049f admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:12.719108 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd3b79-ade4-49dd-8696-afe22344049f admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:12.719394 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd3b79-ade4-49dd-8696-afe22344049f admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:12.720213 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afd3b79-ade4-49dd-8696-afe22344049f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:43:12.720555 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afd3b79-ade4-49dd-8696-afe22344049f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:12.722445 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afd3b79-ade4-49dd-8696-afe22344049f admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:12.729951 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12af8212-6a46-464e-95b7-ccd0f5e2049d admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:12.735639 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 784/1568] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Apr 11 16:43:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:43:12.736565 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afd3b79-ade4-49dd-8696-afe22344049f admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:12.737226 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1162c708-b692-4563-bd5b-b7a2509d610e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:12.738221 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1162c708-b692-4563-bd5b-b7a2509d610e admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:12.738562 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1162c708-b692-4563-bd5b-b7a2509d610e admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:12.739009 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1162c708-b692-4563-bd5b-b7a2509d610e admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:12.740132 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1162c708-b692-4563-bd5b-b7a2509d610e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:43:12.740594 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1162c708-b692-4563-bd5b-b7a2509d610e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:12.744329 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1162c708-b692-4563-bd5b-b7a2509d610e admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:12.746878 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afd3b79-ade4-49dd-8696-afe22344049f admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:12.751683 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1418284d-d439-4642-a3d2-4fa1b7edaa34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:12.752503 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1418284d-d439-4642-a3d2-4fa1b7edaa34 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:12.752680 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1418284d-d439-4642-a3d2-4fa1b7edaa34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:12.752953 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1418284d-d439-4642-a3d2-4fa1b7edaa34 admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:12.753708 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1418284d-d439-4642-a3d2-4fa1b7edaa34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:43:12.754016 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1418284d-d439-4642-a3d2-4fa1b7edaa34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:12.755716 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1418284d-d439-4642-a3d2-4fa1b7edaa34 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:12.768132 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 785/1569] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Apr 11 16:43:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:43:12.768132 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1162c708-b692-4563-bd5b-b7a2509d610e admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:12.768132 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1162c708-b692-4563-bd5b-b7a2509d610e admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:12.769977 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 785/1570] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Apr 11 16:43:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:43:12.770723 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1418284d-d439-4642-a3d2-4fa1b7edaa34 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:12.777257 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88335c60-2299-4585-a4de-5569199609f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:12.778384 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88335c60-2299-4585-a4de-5569199609f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:12.778630 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88335c60-2299-4585-a4de-5569199609f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:12.778939 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88335c60-2299-4585-a4de-5569199609f1 admin admin] PATH_INFO: `/v3/projects/fe4cf73b83fe4060ad729f87a685b06e/users/e2969f53def54839aa6bd8ca5935ade6/roles/0d41da7bec094450b5bff4e4831be52c` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:12.781782 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1418284d-d439-4642-a3d2-4fa1b7edaa34 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:12.786864 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb4accd-0dd4-470d-a50e-e174ebad42f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:12.787651 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb4accd-0dd4-470d-a50e-e174ebad42f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:12.788584 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb4accd-0dd4-470d-a50e-e174ebad42f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:12.789023 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb4accd-0dd4-470d-a50e-e174ebad42f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:12.789987 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb4accd-0dd4-470d-a50e-e174ebad42f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:43:12.790308 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb4accd-0dd4-470d-a50e-e174ebad42f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:12.792771 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb4accd-0dd4-470d-a50e-e174ebad42f8 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:12.795398 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88335c60-2299-4585-a4de-5569199609f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe4cf73b83fe4060ad729f87a685b06e, user_id=e2969f53def54839aa6bd8ca5935ade6, role_id=0d41da7bec094450b5bff4e4831be52c)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:12.796562 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING py.warnings [None req-88335c60-2299-4585-a4de-5569199609f1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 11 16:43:12.796562 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: warnings.warn(msg) Apr 11 16:43:12.796562 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: Apr 11 16:43:12.798661 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88335c60-2299-4585-a4de-5569199609f1 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:12.809505 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 786/1571] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Apr 11 16:43:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:43:12.810343 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb4accd-0dd4-470d-a50e-e174ebad42f8 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:12.820898 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb4accd-0dd4-470d-a50e-e174ebad42f8 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:12.825771 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ac07cd-2b24-4ef5-9a9a-384f210795b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:12.826433 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac07cd-2b24-4ef5-9a9a-384f210795b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:12.826718 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac07cd-2b24-4ef5-9a9a-384f210795b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:12.826994 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac07cd-2b24-4ef5-9a9a-384f210795b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:12.827733 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ac07cd-2b24-4ef5-9a9a-384f210795b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:12.829633 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ac07cd-2b24-4ef5-9a9a-384f210795b6 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:12.879588 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 786/1572] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:43:12 2022] PUT /identity/v3/projects/fe4cf73b83fe4060ad729f87a685b06e/users/e2969f53def54839aa6bd8ca5935ade6/roles/0d41da7bec094450b5bff4e4831be52c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:43:12.880635 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88335c60-2299-4585-a4de-5569199609f1 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:12.905774 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 787/1573] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:43:12 2022] POST /identity/v3/projects => generated 383 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:43:12.905774 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ac07cd-2b24-4ef5-9a9a-384f210795b6 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:12.946004 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88335c60-2299-4585-a4de-5569199609f1 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:12.970240 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ac07cd-2b24-4ef5-9a9a-384f210795b6 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:12.974970 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27543157-576a-4533-aae8-f7f5844ed04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:12.976449 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27543157-576a-4533-aae8-f7f5844ed04e admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:12.976879 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27543157-576a-4533-aae8-f7f5844ed04e admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:12.977165 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27543157-576a-4533-aae8-f7f5844ed04e admin admin] PATH_INFO: `/v3/projects/8b9b773b5ec643b59f2a482491ee71dd/users/8ae0ffb89179421c947fd2a1018d9642/roles/0d41da7bec094450b5bff4e4831be52c` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:12.992675 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27543157-576a-4533-aae8-f7f5844ed04e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b9b773b5ec643b59f2a482491ee71dd, user_id=8ae0ffb89179421c947fd2a1018d9642, role_id=0d41da7bec094450b5bff4e4831be52c)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:12.995409 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27543157-576a-4533-aae8-f7f5844ed04e admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:13.000141 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6488eac0-1bd0-46e5-ba1f-13d0df7c6704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:13.000813 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488eac0-1bd0-46e5-ba1f-13d0df7c6704 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:13.001144 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488eac0-1bd0-46e5-ba1f-13d0df7c6704 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:13.001437 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488eac0-1bd0-46e5-ba1f-13d0df7c6704 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:13.002171 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6488eac0-1bd0-46e5-ba1f-13d0df7c6704 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:13.004380 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6488eac0-1bd0-46e5-ba1f-13d0df7c6704 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:13.079995 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 788/1574] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:43:12 2022] PUT /identity/v3/projects/8b9b773b5ec643b59f2a482491ee71dd/users/8ae0ffb89179421c947fd2a1018d9642/roles/0d41da7bec094450b5bff4e4831be52c => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:43:13.080723 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27543157-576a-4533-aae8-f7f5844ed04e admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:13.118742 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 787/1575] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:43:12 2022] POST /identity/v3/projects => generated 389 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:43:13.119748 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6488eac0-1bd0-46e5-ba1f-13d0df7c6704 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:13.145863 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27543157-576a-4533-aae8-f7f5844ed04e admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:13.192268 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6488eac0-1bd0-46e5-ba1f-13d0df7c6704 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:13.198010 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f6b3d-a894-491e-b047-3a2948a930df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:13.198852 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f6b3d-a894-491e-b047-3a2948a930df admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:13.199286 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f6b3d-a894-491e-b047-3a2948a930df admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:13.199787 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f6b3d-a894-491e-b047-3a2948a930df admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:13.200828 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45f6b3d-a894-491e-b047-3a2948a930df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:13.203404 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45f6b3d-a894-491e-b047-3a2948a930df admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:13.214424 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d647fd2c-5683-4fc5-8a53-a9797343ad75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:13.215282 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d647fd2c-5683-4fc5-8a53-a9797343ad75 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:13.215871 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d647fd2c-5683-4fc5-8a53-a9797343ad75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:13.216160 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d647fd2c-5683-4fc5-8a53-a9797343ad75 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:13.217104 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d647fd2c-5683-4fc5-8a53-a9797343ad75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:13.220076 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d647fd2c-5683-4fc5-8a53-a9797343ad75 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:13.329600 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 788/1576] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:43:13 2022] POST /identity/v3/projects => generated 377 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:43:13.330486 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f6b3d-a894-491e-b047-3a2948a930df admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:13.336385 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 789/1577] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:43:13 2022] POST /identity/v3/projects => generated 373 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:43:13.336385 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d647fd2c-5683-4fc5-8a53-a9797343ad75 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:13.391343 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f6b3d-a894-491e-b047-3a2948a930df admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:13.403257 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d647fd2c-5683-4fc5-8a53-a9797343ad75 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:13.407926 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59617c44-5ed1-4e2c-bf2c-bb61fc717790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:13.408596 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59617c44-5ed1-4e2c-bf2c-bb61fc717790 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:13.408882 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59617c44-5ed1-4e2c-bf2c-bb61fc717790 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:13.409171 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59617c44-5ed1-4e2c-bf2c-bb61fc717790 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:13.409872 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59617c44-5ed1-4e2c-bf2c-bb61fc717790 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:13.411929 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59617c44-5ed1-4e2c-bf2c-bb61fc717790 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:13.449524 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe939d-406a-49a4-b68b-356c0989ff77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:13.450184 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe939d-406a-49a4-b68b-356c0989ff77 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:13.450465 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe939d-406a-49a4-b68b-356c0989ff77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:13.450740 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe939d-406a-49a4-b68b-356c0989ff77 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:13.451422 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbe939d-406a-49a4-b68b-356c0989ff77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:13.453570 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbe939d-406a-49a4-b68b-356c0989ff77 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:13.535207 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 790/1578] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:43:13 2022] POST /identity/v3/projects => generated 379 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:43:13.537220 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4aa8a-1b00-460d-831f-d45fe2b63049 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:13.537712 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4aa8a-1b00-460d-831f-d45fe2b63049 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:13.538821 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4aa8a-1b00-460d-831f-d45fe2b63049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:13.568530 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-00d4aa8a-1b00-460d-831f-d45fe2b63049 None None] MFA Rules not processed for user `e2969f53def54839aa6bd8ca5935ade6`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:13.572418 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 789/1579] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:43:13 2022] POST /identity/v3/projects => generated 389 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:43:13.572572 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-00d4aa8a-1b00-460d-831f-d45fe2b63049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:13.572671 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe939d-406a-49a4-b68b-356c0989ff77 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:13.632024 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe939d-406a-49a4-b68b-356c0989ff77 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:13.636307 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 791/1580] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:43:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:13.636723 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4165b4-8e3c-4fdd-b59a-a56373992eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:13.637402 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4165b4-8e3c-4fdd-b59a-a56373992eed admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:13.637593 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb45a2a-cac2-4f6f-8ba0-c35c888f9a66 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:13.637740 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4165b4-8e3c-4fdd-b59a-a56373992eed admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:13.638029 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4165b4-8e3c-4fdd-b59a-a56373992eed admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:13.638146 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb45a2a-cac2-4f6f-8ba0-c35c888f9a66 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:13.638315 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb45a2a-cac2-4f6f-8ba0-c35c888f9a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:13.638703 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4165b4-8e3c-4fdd-b59a-a56373992eed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:13.640784 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4165b4-8e3c-4fdd-b59a-a56373992eed admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:13.665269 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-cfb45a2a-cac2-4f6f-8ba0-c35c888f9a66 None None] MFA Rules not processed for user `8ae0ffb89179421c947fd2a1018d9642`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:13.666486 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-cfb45a2a-cac2-4f6f-8ba0-c35c888f9a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:13.730336 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 792/1581] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:43:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:13.731164 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb45a2a-cac2-4f6f-8ba0-c35c888f9a66 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:13.739709 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 790/1582] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:43:13 2022] POST /identity/v3/users => generated 292 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:43:13.741183 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4165b4-8e3c-4fdd-b59a-a56373992eed admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:13.746577 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb45a2a-cac2-4f6f-8ba0-c35c888f9a66 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:13.753224 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4165b4-8e3c-4fdd-b59a-a56373992eed admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:13.754116 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b9b69-2088-4df4-be73-9f7b6686b295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:13.754846 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b9b69-2088-4df4-be73-9f7b6686b295 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:13.755154 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b9b69-2088-4df4-be73-9f7b6686b295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:13.755429 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b9b69-2088-4df4-be73-9f7b6686b295 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:13.756203 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719b9b69-2088-4df4-be73-9f7b6686b295 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:13.758827 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719b9b69-2088-4df4-be73-9f7b6686b295 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:13.759019 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f274a1-9b18-450a-97be-30694f368a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:13.759725 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f274a1-9b18-450a-97be-30694f368a18 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:13.760021 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f274a1-9b18-450a-97be-30694f368a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:13.760304 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f274a1-9b18-450a-97be-30694f368a18 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:13.761063 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f274a1-9b18-450a-97be-30694f368a18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:13.763095 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f274a1-9b18-450a-97be-30694f368a18 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:13.845364 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 793/1583] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:43:13 2022] POST /identity/v3/users => generated 295 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:43:13.846277 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b9b69-2088-4df4-be73-9f7b6686b295 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:13.856134 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b9b69-2088-4df4-be73-9f7b6686b295 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:13.860913 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 791/1584] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:43:13 2022] POST /identity/v3/users => generated 289 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:43:13.860913 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f274a1-9b18-450a-97be-30694f368a18 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:13.863211 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4160cb-df2c-478a-b093-b11814cacf01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:13.866128 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4160cb-df2c-478a-b093-b11814cacf01 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:13.866128 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4160cb-df2c-478a-b093-b11814cacf01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:13.866128 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4160cb-df2c-478a-b093-b11814cacf01 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:13.866128 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4160cb-df2c-478a-b093-b11814cacf01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:13.867447 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4160cb-df2c-478a-b093-b11814cacf01 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:13.870166 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f274a1-9b18-450a-97be-30694f368a18 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:13.874774 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c09e3d-a638-4ffb-81ef-fb35cc2cb1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:13.875446 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c09e3d-a638-4ffb-81ef-fb35cc2cb1ff admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:13.875764 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c09e3d-a638-4ffb-81ef-fb35cc2cb1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:13.876051 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c09e3d-a638-4ffb-81ef-fb35cc2cb1ff admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:13.876743 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c09e3d-a638-4ffb-81ef-fb35cc2cb1ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:13.878789 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c09e3d-a638-4ffb-81ef-fb35cc2cb1ff admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:13.979680 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 794/1585] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:43:13 2022] POST /identity/v3/users => generated 287 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:43:13.980604 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 792/1586] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:43:13 2022] POST /identity/v3/users => generated 290 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:43:13.983445 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4160cb-df2c-478a-b093-b11814cacf01 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:13.992921 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c09e3d-a638-4ffb-81ef-fb35cc2cb1ff admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:13.993872 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c09e3d-a638-4ffb-81ef-fb35cc2cb1ff admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:13.994026 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4160cb-df2c-478a-b093-b11814cacf01 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:13.998825 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51397340-6abe-43ca-b27f-15b7d038e23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:13.999007 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee2382-a539-4146-ad4a-c2d85227bf1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:13.999509 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51397340-6abe-43ca-b27f-15b7d038e23f admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:13.999717 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee2382-a539-4146-ad4a-c2d85227bf1d admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:13.999825 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51397340-6abe-43ca-b27f-15b7d038e23f admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:14.000012 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee2382-a539-4146-ad4a-c2d85227bf1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:14.000172 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51397340-6abe-43ca-b27f-15b7d038e23f admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:14.000263 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee2382-a539-4146-ad4a-c2d85227bf1d admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:14.000828 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51397340-6abe-43ca-b27f-15b7d038e23f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:14.000943 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ee2382-a539-4146-ad4a-c2d85227bf1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:14.002708 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51397340-6abe-43ca-b27f-15b7d038e23f admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:14.002840 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ee2382-a539-4146-ad4a-c2d85227bf1d admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:14.102885 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 795/1587] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:43:13 2022] POST /identity/v3/users => generated 295 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:43:14.102885 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51397340-6abe-43ca-b27f-15b7d038e23f admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:14.110337 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51397340-6abe-43ca-b27f-15b7d038e23f admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:14.114868 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833cdbf1-ce7e-4e51-97b8-a1be23f7cf6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:14.115546 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833cdbf1-ce7e-4e51-97b8-a1be23f7cf6f admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:14.115850 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833cdbf1-ce7e-4e51-97b8-a1be23f7cf6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:14.116181 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833cdbf1-ce7e-4e51-97b8-a1be23f7cf6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:14.117619 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833cdbf1-ce7e-4e51-97b8-a1be23f7cf6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:14.119308 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833cdbf1-ce7e-4e51-97b8-a1be23f7cf6f admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:14.125268 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 793/1588] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:43:13 2022] POST /identity/v3/projects => generated 371 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:43:14.127128 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d502beae-83fe-45e8-ae43-b3a7a7659a67 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:14.127646 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d502beae-83fe-45e8-ae43-b3a7a7659a67 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:14.128125 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d502beae-83fe-45e8-ae43-b3a7a7659a67 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:14.130204 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 794/1589] 10.222.0.43 () {54 vars in 960 bytes} [Mon Apr 11 16:43:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:43:14.136461 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d502beae-83fe-45e8-ae43-b3a7a7659a67 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:14.141054 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 796/1590] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:43:14 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:43:14.141907 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833cdbf1-ce7e-4e51-97b8-a1be23f7cf6f admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:14.157416 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833cdbf1-ce7e-4e51-97b8-a1be23f7cf6f admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:14.210255 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d502beae-83fe-45e8-ae43-b3a7a7659a67 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:14.214825 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5fe981-f47f-4305-88ef-67929caff71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:14.215501 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5fe981-f47f-4305-88ef-67929caff71e admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:14.215813 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5fe981-f47f-4305-88ef-67929caff71e admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:14.216091 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5fe981-f47f-4305-88ef-67929caff71e admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:14.216828 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5fe981-f47f-4305-88ef-67929caff71e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:14.218416 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5fe981-f47f-4305-88ef-67929caff71e admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:14.223597 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef2cb3f-65f2-4310-9d93-2dd7bb7ba0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:14.224292 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2cb3f-65f2-4310-9d93-2dd7bb7ba0a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:14.224572 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2cb3f-65f2-4310-9d93-2dd7bb7ba0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:14.224844 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2cb3f-65f2-4310-9d93-2dd7bb7ba0a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:14.225703 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef2cb3f-65f2-4310-9d93-2dd7bb7ba0a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:14.227358 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef2cb3f-65f2-4310-9d93-2dd7bb7ba0a1 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:14.229451 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 795/1591] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:43:14 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:43:14.230344 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5fe981-f47f-4305-88ef-67929caff71e admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:14.237841 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 797/1592] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:43:14 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:43:14.238694 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef2cb3f-65f2-4310-9d93-2dd7bb7ba0a1 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:14.240158 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5fe981-f47f-4305-88ef-67929caff71e admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:14.245936 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b56dc0-5711-47ea-8d99-c6f87bd5d700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:14.246659 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b56dc0-5711-47ea-8d99-c6f87bd5d700 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:14.247017 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b56dc0-5711-47ea-8d99-c6f87bd5d700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:14.247268 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b56dc0-5711-47ea-8d99-c6f87bd5d700 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:14.248081 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b56dc0-5711-47ea-8d99-c6f87bd5d700 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:14.249066 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef2cb3f-65f2-4310-9d93-2dd7bb7ba0a1 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:14.249697 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b56dc0-5711-47ea-8d99-c6f87bd5d700 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:14.253642 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d4797-19c8-4bd3-9f87-9d9246b4e495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:14.254302 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d4797-19c8-4bd3-9f87-9d9246b4e495 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:14.254586 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d4797-19c8-4bd3-9f87-9d9246b4e495 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:14.254864 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d4797-19c8-4bd3-9f87-9d9246b4e495 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:14.255631 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857d4797-19c8-4bd3-9f87-9d9246b4e495 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:14.257879 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857d4797-19c8-4bd3-9f87-9d9246b4e495 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:14.261303 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 796/1593] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:43:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:43:14.262206 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b56dc0-5711-47ea-8d99-c6f87bd5d700 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:14.268200 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 798/1594] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:43:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:43:14.268893 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d4797-19c8-4bd3-9f87-9d9246b4e495 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:14.273509 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b56dc0-5711-47ea-8d99-c6f87bd5d700 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:14.278057 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d208a71c-8ac3-4a6e-97f1-c58ec5f8c2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:14.278305 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d4797-19c8-4bd3-9f87-9d9246b4e495 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:14.278720 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208a71c-8ac3-4a6e-97f1-c58ec5f8c2d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:14.279003 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208a71c-8ac3-4a6e-97f1-c58ec5f8c2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:14.279275 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208a71c-8ac3-4a6e-97f1-c58ec5f8c2d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:14.280034 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d208a71c-8ac3-4a6e-97f1-c58ec5f8c2d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:14.281599 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d208a71c-8ac3-4a6e-97f1-c58ec5f8c2d7 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:14.282833 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73e60e9-d428-4196-b562-2df41dbd74c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:14.283493 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e60e9-d428-4196-b562-2df41dbd74c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:14.285142 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e60e9-d428-4196-b562-2df41dbd74c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:14.285718 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e60e9-d428-4196-b562-2df41dbd74c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:14.286429 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73e60e9-d428-4196-b562-2df41dbd74c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:14.288438 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73e60e9-d428-4196-b562-2df41dbd74c5 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:14.292516 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 797/1595] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:43:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:43:14.293850 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11444e9e-d541-43a4-83d5-7ef823c1cfc7 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:14.294139 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11444e9e-d541-43a4-83d5-7ef823c1cfc7 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:14.294418 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11444e9e-d541-43a4-83d5-7ef823c1cfc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:14.312903 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-11444e9e-d541-43a4-83d5-7ef823c1cfc7 None None] MFA Rules not processed for user `1be2652c984a4283aeee0b937f0555e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:14.314148 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-11444e9e-d541-43a4-83d5-7ef823c1cfc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:14.372515 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 799/1596] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:43:14 2022] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:43:14.373477 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73e60e9-d428-4196-b562-2df41dbd74c5 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:14.379461 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 798/1597] 10.222.0.43 () {58 vars in 1057 bytes} [Mon Apr 11 16:43:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:14.380430 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11444e9e-d541-43a4-83d5-7ef823c1cfc7 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:14.384186 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73e60e9-d428-4196-b562-2df41dbd74c5 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:14.390066 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0d224f-d448-48fe-a1dc-00ce79ca7af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:14.390738 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d224f-d448-48fe-a1dc-00ce79ca7af6 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:14.391020 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d224f-d448-48fe-a1dc-00ce79ca7af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:14.391312 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d224f-d448-48fe-a1dc-00ce79ca7af6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:14.391861 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11444e9e-d541-43a4-83d5-7ef823c1cfc7 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:14.392059 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0d224f-d448-48fe-a1dc-00ce79ca7af6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:14.393680 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0d224f-d448-48fe-a1dc-00ce79ca7af6 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:14.396517 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b71be1f-709f-406c-b0ae-f033eb9e114a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:14.397241 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b71be1f-709f-406c-b0ae-f033eb9e114a admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:14.397753 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b71be1f-709f-406c-b0ae-f033eb9e114a admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:14.398041 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b71be1f-709f-406c-b0ae-f033eb9e114a admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:14.398828 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b71be1f-709f-406c-b0ae-f033eb9e114a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:14.400563 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b71be1f-709f-406c-b0ae-f033eb9e114a admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:14.406146 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 800/1598] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:43:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:43:14.407054 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0d224f-d448-48fe-a1dc-00ce79ca7af6 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:14.411651 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 799/1599] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:43:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:43:14.413174 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b71be1f-709f-406c-b0ae-f033eb9e114a admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:14.417191 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0d224f-d448-48fe-a1dc-00ce79ca7af6 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:14.421738 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fc93fb-c66b-46cb-8f32-ac9ba6892873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:14.422391 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc93fb-c66b-46cb-8f32-ac9ba6892873 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:14.422672 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc93fb-c66b-46cb-8f32-ac9ba6892873 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:14.422947 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc93fb-c66b-46cb-8f32-ac9ba6892873 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:14.423478 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b71be1f-709f-406c-b0ae-f033eb9e114a admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:14.423715 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fc93fb-c66b-46cb-8f32-ac9ba6892873 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:14.425393 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fc93fb-c66b-46cb-8f32-ac9ba6892873 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:14.428863 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d50d09-5dd8-47b0-bb3a-59bc88fadc0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:14.429763 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d50d09-5dd8-47b0-bb3a-59bc88fadc0d admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:14.430066 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d50d09-5dd8-47b0-bb3a-59bc88fadc0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:14.430347 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d50d09-5dd8-47b0-bb3a-59bc88fadc0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:14.431081 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d50d09-5dd8-47b0-bb3a-59bc88fadc0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:14.432947 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d50d09-5dd8-47b0-bb3a-59bc88fadc0d admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:14.436346 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 801/1600] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:43:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:43:14.437160 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fc93fb-c66b-46cb-8f32-ac9ba6892873 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:14.447245 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 800/1601] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:43:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:43:14.447245 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d50d09-5dd8-47b0-bb3a-59bc88fadc0d admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:14.454875 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fc93fb-c66b-46cb-8f32-ac9ba6892873 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:14.455110 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d50d09-5dd8-47b0-bb3a-59bc88fadc0d admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:14.459624 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7473c84-276b-4f62-b9b7-bdf596beb19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:14.459931 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8377d0b3-a8b8-43ba-aeb5-c8fa357f7992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:14.460305 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7473c84-276b-4f62-b9b7-bdf596beb19f admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:14.460591 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7473c84-276b-4f62-b9b7-bdf596beb19f admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:14.460697 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8377d0b3-a8b8-43ba-aeb5-c8fa357f7992 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:14.460863 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7473c84-276b-4f62-b9b7-bdf596beb19f admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:14.460968 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8377d0b3-a8b8-43ba-aeb5-c8fa357f7992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:14.461283 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8377d0b3-a8b8-43ba-aeb5-c8fa357f7992 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:14.461587 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7473c84-276b-4f62-b9b7-bdf596beb19f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:14.462013 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8377d0b3-a8b8-43ba-aeb5-c8fa357f7992 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:14.463197 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7473c84-276b-4f62-b9b7-bdf596beb19f admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:14.463619 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8377d0b3-a8b8-43ba-aeb5-c8fa357f7992 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:14.473992 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 801/1602] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:43:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:43:14.475143 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7473c84-276b-4f62-b9b7-bdf596beb19f admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:14.479919 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 802/1603] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:43:14 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:43:14.479919 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8377d0b3-a8b8-43ba-aeb5-c8fa357f7992 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:14.485141 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7473c84-276b-4f62-b9b7-bdf596beb19f admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:14.489852 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f67ea9-c3e6-4663-aa55-06ebcba62345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:14.490508 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f67ea9-c3e6-4663-aa55-06ebcba62345 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:14.490612 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8377d0b3-a8b8-43ba-aeb5-c8fa357f7992 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:14.490791 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f67ea9-c3e6-4663-aa55-06ebcba62345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:14.491796 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f67ea9-c3e6-4663-aa55-06ebcba62345 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:14.492526 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f67ea9-c3e6-4663-aa55-06ebcba62345 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:14.494101 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f67ea9-c3e6-4663-aa55-06ebcba62345 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:14.497648 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4761791c-d09e-4f61-91a5-0c242711f48e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1be2652c984a4283aeee0b937f0555e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:14.498425 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4761791c-d09e-4f61-91a5-0c242711f48e service nova] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:14.498879 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4761791c-d09e-4f61-91a5-0c242711f48e service nova] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:14.499296 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4761791c-d09e-4f61-91a5-0c242711f48e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:14.511623 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 802/1604] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:43:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:43:14.511623 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f67ea9-c3e6-4663-aa55-06ebcba62345 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:14.520336 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f67ea9-c3e6-4663-aa55-06ebcba62345 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:14.524973 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a855691b-0793-42ef-ba17-2155d8d4940f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:14.525861 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855691b-0793-42ef-ba17-2155d8d4940f admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:14.526138 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855691b-0793-42ef-ba17-2155d8d4940f admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:14.526420 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855691b-0793-42ef-ba17-2155d8d4940f admin admin] PATH_INFO: `/v3/projects/b0ae846deca14483a59001ea907dd4ff/users/5faca05f433a4397a1176d35f2528b1b/roles/0d41da7bec094450b5bff4e4831be52c` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:14.542676 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a855691b-0793-42ef-ba17-2155d8d4940f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0ae846deca14483a59001ea907dd4ff, user_id=5faca05f433a4397a1176d35f2528b1b, role_id=0d41da7bec094450b5bff4e4831be52c)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:14.545704 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a855691b-0793-42ef-ba17-2155d8d4940f admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:14.559544 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4761791c-d09e-4f61-91a5-0c242711f48e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:14.561134 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4761791c-d09e-4f61-91a5-0c242711f48e service nova] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:14.570505 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 803/1605] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:43:14 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:43:14.571627 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4761791c-d09e-4f61-91a5-0c242711f48e service nova] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:14.582551 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4761791c-d09e-4f61-91a5-0c242711f48e service nova] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:14.587483 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ccfed-8d32-4259-9a0b-e93983a15f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:14.588444 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ccfed-8d32-4259-9a0b-e93983a15f05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:14.588723 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ccfed-8d32-4259-9a0b-e93983a15f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:14.589000 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ccfed-8d32-4259-9a0b-e93983a15f05 admin admin] PATH_INFO: `/v3/projects/e54efcd6582349b9a9d7131150d8aa6f/users/de39f6406f414bc68ee956c7639dab5b/roles/0d41da7bec094450b5bff4e4831be52c` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:14.606420 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080ccfed-8d32-4259-9a0b-e93983a15f05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e54efcd6582349b9a9d7131150d8aa6f, user_id=de39f6406f414bc68ee956c7639dab5b, role_id=0d41da7bec094450b5bff4e4831be52c)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:14.609203 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080ccfed-8d32-4259-9a0b-e93983a15f05 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:14.671859 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 803/1606] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:43:14 2022] PUT /identity/v3/projects/b0ae846deca14483a59001ea907dd4ff/users/5faca05f433a4397a1176d35f2528b1b/roles/0d41da7bec094450b5bff4e4831be52c => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:43:14.672677 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a855691b-0793-42ef-ba17-2155d8d4940f admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:14.705816 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 804/1607] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:43:14 2022] PUT /identity/v3/projects/e54efcd6582349b9a9d7131150d8aa6f/users/de39f6406f414bc68ee956c7639dab5b/roles/0d41da7bec094450b5bff4e4831be52c => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:43:14.706766 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ccfed-8d32-4259-9a0b-e93983a15f05 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:14.738230 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a855691b-0793-42ef-ba17-2155d8d4940f admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:14.770068 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ccfed-8d32-4259-9a0b-e93983a15f05 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:14.775429 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db2f213-50b6-4b6b-a6c6-d211273ae775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:14.776508 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2f213-50b6-4b6b-a6c6-d211273ae775 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:14.776921 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2f213-50b6-4b6b-a6c6-d211273ae775 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:14.777270 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2f213-50b6-4b6b-a6c6-d211273ae775 admin admin] PATH_INFO: `/v3/projects/4bb7c3b41c4149d7895824c78ff1182e/users/2dcefc455dba4693a162e096919bd89a/roles/0d41da7bec094450b5bff4e4831be52c` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:14.808405 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db2f213-50b6-4b6b-a6c6-d211273ae775 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bb7c3b41c4149d7895824c78ff1182e, user_id=2dcefc455dba4693a162e096919bd89a, role_id=0d41da7bec094450b5bff4e4831be52c)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:14.811000 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db2f213-50b6-4b6b-a6c6-d211273ae775 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:14.825783 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3440ce-7b1b-4617-aa16-b1cd513d3434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:14.826768 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3440ce-7b1b-4617-aa16-b1cd513d3434 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:14.827118 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3440ce-7b1b-4617-aa16-b1cd513d3434 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:14.827477 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3440ce-7b1b-4617-aa16-b1cd513d3434 admin admin] PATH_INFO: `/v3/projects/71264cc4e2534798b9599b37f5c1b626/users/8f859f7968de4023b1113461a9dc7228/roles/0d41da7bec094450b5bff4e4831be52c` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:14.841786 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3440ce-7b1b-4617-aa16-b1cd513d3434 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71264cc4e2534798b9599b37f5c1b626, user_id=8f859f7968de4023b1113461a9dc7228, role_id=0d41da7bec094450b5bff4e4831be52c)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:14.844511 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3440ce-7b1b-4617-aa16-b1cd513d3434 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:14.922085 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 805/1608] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:43:14 2022] PUT /identity/v3/projects/4bb7c3b41c4149d7895824c78ff1182e/users/2dcefc455dba4693a162e096919bd89a/roles/0d41da7bec094450b5bff4e4831be52c => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:43:14.923267 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db2f213-50b6-4b6b-a6c6-d211273ae775 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:14.951449 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 804/1609] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:43:14 2022] PUT /identity/v3/projects/71264cc4e2534798b9599b37f5c1b626/users/8f859f7968de4023b1113461a9dc7228/roles/0d41da7bec094450b5bff4e4831be52c => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:43:14.952550 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3440ce-7b1b-4617-aa16-b1cd513d3434 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:14.996126 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db2f213-50b6-4b6b-a6c6-d211273ae775 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:15.019602 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3440ce-7b1b-4617-aa16-b1cd513d3434 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:15.029673 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c91aa8c-1e75-4350-a4ca-ed4764b62792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:15.030608 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c91aa8c-1e75-4350-a4ca-ed4764b62792 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:15.030867 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c91aa8c-1e75-4350-a4ca-ed4764b62792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:15.031140 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c91aa8c-1e75-4350-a4ca-ed4764b62792 admin admin] PATH_INFO: `/v3/projects/1c4fdfc7ca2b4364a9e5c1e3ac30fa87/users/444003e9036a46b1ab0d76f853341b51/roles/0d41da7bec094450b5bff4e4831be52c` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:15.048464 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c91aa8c-1e75-4350-a4ca-ed4764b62792 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c4fdfc7ca2b4364a9e5c1e3ac30fa87, user_id=444003e9036a46b1ab0d76f853341b51, role_id=0d41da7bec094450b5bff4e4831be52c)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:15.051299 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c91aa8c-1e75-4350-a4ca-ed4764b62792 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:15.060056 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360fbcbf-3c65-42a5-9f33-c0ea2b6a7b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:15.061055 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360fbcbf-3c65-42a5-9f33-c0ea2b6a7b27 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:15.067654 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360fbcbf-3c65-42a5-9f33-c0ea2b6a7b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:15.067654 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360fbcbf-3c65-42a5-9f33-c0ea2b6a7b27 admin admin] PATH_INFO: `/v3/projects/4a9922f7c7e54b419b8bad2c6246f1ae/users/975273630f7e4852848335d674693ea7/roles/0d41da7bec094450b5bff4e4831be52c` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:15.077248 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360fbcbf-3c65-42a5-9f33-c0ea2b6a7b27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a9922f7c7e54b419b8bad2c6246f1ae, user_id=975273630f7e4852848335d674693ea7, role_id=0d41da7bec094450b5bff4e4831be52c)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:15.080020 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360fbcbf-3c65-42a5-9f33-c0ea2b6a7b27 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:15.126795 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 805/1610] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:43:14 2022] PUT /identity/v3/projects/1c4fdfc7ca2b4364a9e5c1e3ac30fa87/users/444003e9036a46b1ab0d76f853341b51/roles/0d41da7bec094450b5bff4e4831be52c => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:43:15.127754 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c91aa8c-1e75-4350-a4ca-ed4764b62792 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:15.150729 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 806/1611] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:43:14 2022] PUT /identity/v3/projects/4a9922f7c7e54b419b8bad2c6246f1ae/users/975273630f7e4852848335d674693ea7/roles/0d41da7bec094450b5bff4e4831be52c => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:43:15.156134 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e18fe-832f-4b1d-b091-6c680e330faa None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:15.156134 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e18fe-832f-4b1d-b091-6c680e330faa None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:15.156134 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e18fe-832f-4b1d-b091-6c680e330faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:15.183788 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-cd9e18fe-832f-4b1d-b091-6c680e330faa None None] MFA Rules not processed for user `5faca05f433a4397a1176d35f2528b1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:15.185028 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-cd9e18fe-832f-4b1d-b091-6c680e330faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:15.192051 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c91aa8c-1e75-4350-a4ca-ed4764b62792 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:15.248375 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 807/1612] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:43:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:15.249582 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4915a6-8648-48f4-b14a-07fc192ec8dc None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:15.249869 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4915a6-8648-48f4-b14a-07fc192ec8dc None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:15.250146 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4915a6-8648-48f4-b14a-07fc192ec8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:15.253849 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7898f62f-00cd-4fbe-ba7c-d43ca61eefaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:15.254860 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7898f62f-00cd-4fbe-ba7c-d43ca61eefaa admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:15.255263 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7898f62f-00cd-4fbe-ba7c-d43ca61eefaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:15.255779 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7898f62f-00cd-4fbe-ba7c-d43ca61eefaa admin admin] PATH_INFO: `/v3/projects/a6804a6738174a58834d14917f8ca982/users/4f857d33948548e2aa7e85ec9bc676ba/roles/702e5e78b5d744529384b96a390ae92f` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:15.268025 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-3e4915a6-8648-48f4-b14a-07fc192ec8dc None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:15.269221 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-3e4915a6-8648-48f4-b14a-07fc192ec8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:15.271199 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7898f62f-00cd-4fbe-ba7c-d43ca61eefaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6804a6738174a58834d14917f8ca982, user_id=4f857d33948548e2aa7e85ec9bc676ba, role_id=702e5e78b5d744529384b96a390ae92f)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:15.274143 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7898f62f-00cd-4fbe-ba7c-d43ca61eefaa admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:15.278577 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 808/1613] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:43:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:15.279856 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8405d5-d129-4d0b-85ff-4a3ef5deb228 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:15.280144 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8405d5-d129-4d0b-85ff-4a3ef5deb228 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:15.280416 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8405d5-d129-4d0b-85ff-4a3ef5deb228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:15.308780 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-ec8405d5-d129-4d0b-85ff-4a3ef5deb228 None None] MFA Rules not processed for user `2dcefc455dba4693a162e096919bd89a`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:15.310243 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-ec8405d5-d129-4d0b-85ff-4a3ef5deb228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:15.362279 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 806/1614] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:43:15 2022] PUT /identity/v3/projects/a6804a6738174a58834d14917f8ca982/users/4f857d33948548e2aa7e85ec9bc676ba/roles/702e5e78b5d744529384b96a390ae92f => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:43:15.363637 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2aff7d-b5cc-4d6a-863c-3115f8592bd0 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:15.363925 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2aff7d-b5cc-4d6a-863c-3115f8592bd0 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:15.364199 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2aff7d-b5cc-4d6a-863c-3115f8592bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:15.376413 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 809/1615] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:43:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:15.377761 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c40276-1be9-422b-b517-75a5b5981d5e None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:15.378043 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c40276-1be9-422b-b517-75a5b5981d5e None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:15.378317 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c40276-1be9-422b-b517-75a5b5981d5e None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:15.380045 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 810/1616] 10.222.0.43 () {54 vars in 960 bytes} [Mon Apr 11 16:43:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:43:15.380931 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7df211-36c5-4ca5-abf9-1de78d19382c None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:15.381214 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7df211-36c5-4ca5-abf9-1de78d19382c None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:15.381951 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-3c2aff7d-b5cc-4d6a-863c-3115f8592bd0 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:15.382060 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7df211-36c5-4ca5-abf9-1de78d19382c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:15.383324 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-3c2aff7d-b5cc-4d6a-863c-3115f8592bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:15.408631 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-8f7df211-36c5-4ca5-abf9-1de78d19382c None None] MFA Rules not processed for user `444003e9036a46b1ab0d76f853341b51`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:15.409845 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-8f7df211-36c5-4ca5-abf9-1de78d19382c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:15.441944 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 807/1617] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:43:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:15.443681 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f5932-221d-4f3d-bd6e-a2b06e218ef1 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:15.444669 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f5932-221d-4f3d-bd6e-a2b06e218ef1 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:15.444960 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f5932-221d-4f3d-bd6e-a2b06e218ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:15.462945 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-fc6f5932-221d-4f3d-bd6e-a2b06e218ef1 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:15.464193 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-fc6f5932-221d-4f3d-bd6e-a2b06e218ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:15.472797 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 808/1618] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:43:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:15.473613 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f5932-221d-4f3d-bd6e-a2b06e218ef1 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:15.478689 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 811/1619] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:43:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:15.478689 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7df211-36c5-4ca5-abf9-1de78d19382c None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:15.479578 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-8f7df211-36c5-4ca5-abf9-1de78d19382c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:15.538887 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7df211-36c5-4ca5-abf9-1de78d19382c None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:15.542518 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39952374-70f9-437b-8099-4fc409049132 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:15.543169 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39952374-70f9-437b-8099-4fc409049132 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:15.543452 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39952374-70f9-437b-8099-4fc409049132 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:15.543755 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39952374-70f9-437b-8099-4fc409049132 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:15.550728 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f5932-221d-4f3d-bd6e-a2b06e218ef1 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:15.553099 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39952374-70f9-437b-8099-4fc409049132 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:15.554637 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39952374-70f9-437b-8099-4fc409049132 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:15.557210 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916edb89-e64d-426b-9a41-a052a12574fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1be2652c984a4283aeee0b937f0555e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:15.557870 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916edb89-e64d-426b-9a41-a052a12574fa service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:15.558158 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916edb89-e64d-426b-9a41-a052a12574fa service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:15.558439 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916edb89-e64d-426b-9a41-a052a12574fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:15.564621 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 812/1620] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:43:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:43:15.565432 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39952374-70f9-437b-8099-4fc409049132 service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:15.578012 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39952374-70f9-437b-8099-4fc409049132 service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:15.588145 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ff0ec8-8962-46f4-b4e9-d1489d105609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:15.588838 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ff0ec8-8962-46f4-b4e9-d1489d105609 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:15.589113 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ff0ec8-8962-46f4-b4e9-d1489d105609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:15.589387 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ff0ec8-8962-46f4-b4e9-d1489d105609 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:15.590110 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ff0ec8-8962-46f4-b4e9-d1489d105609 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:15.591725 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ff0ec8-8962-46f4-b4e9-d1489d105609 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:15.601824 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 813/1621] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:43:15 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:43:15.602753 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ff0ec8-8962-46f4-b4e9-d1489d105609 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:15.612904 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ff0ec8-8962-46f4-b4e9-d1489d105609 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:15.617679 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b89b084-6641-475e-883b-c41b8a30d240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:15.618343 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89b084-6641-475e-883b-c41b8a30d240 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:15.618596 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916edb89-e64d-426b-9a41-a052a12574fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:15.618700 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89b084-6641-475e-883b-c41b8a30d240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:15.618880 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89b084-6641-475e-883b-c41b8a30d240 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:15.619587 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b89b084-6641-475e-883b-c41b8a30d240 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:15.620255 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916edb89-e64d-426b-9a41-a052a12574fa service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:15.621523 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b89b084-6641-475e-883b-c41b8a30d240 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:15.629273 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 809/1622] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:43:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:43:15.630570 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404138ec-7939-4325-bc26-abe434b111ad None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:15.630877 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404138ec-7939-4325-bc26-abe434b111ad None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:15.631152 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404138ec-7939-4325-bc26-abe434b111ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:15.651205 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-404138ec-7939-4325-bc26-abe434b111ad None None] MFA Rules not processed for user `1be2652c984a4283aeee0b937f0555e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:15.652472 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-404138ec-7939-4325-bc26-abe434b111ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:15.661753 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 810/1623] 10.222.0.43 () {58 vars in 1057 bytes} [Mon Apr 11 16:43:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:15.664399 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404138ec-7939-4325-bc26-abe434b111ad None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:15.673656 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404138ec-7939-4325-bc26-abe434b111ad None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:15.677260 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e6ac75-f501-4b85-818d-21f2e2d06ae5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:15.677901 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e6ac75-f501-4b85-818d-21f2e2d06ae5 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:15.678188 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e6ac75-f501-4b85-818d-21f2e2d06ae5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:15.679168 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e6ac75-f501-4b85-818d-21f2e2d06ae5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:15.689103 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e6ac75-f501-4b85-818d-21f2e2d06ae5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:15.690511 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e6ac75-f501-4b85-818d-21f2e2d06ae5 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:15.701624 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 811/1624] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:43:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:43:15.702446 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e6ac75-f501-4b85-818d-21f2e2d06ae5 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:15.713332 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e6ac75-f501-4b85-818d-21f2e2d06ae5 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:15.717086 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364ac880-a0b7-4701-8ed8-751a8a11d2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:15.717752 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ac880-a0b7-4701-8ed8-751a8a11d2de admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:15.718039 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ac880-a0b7-4701-8ed8-751a8a11d2de admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:15.718322 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ac880-a0b7-4701-8ed8-751a8a11d2de admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:15.719018 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364ac880-a0b7-4701-8ed8-751a8a11d2de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:15.720941 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364ac880-a0b7-4701-8ed8-751a8a11d2de admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:15.767938 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 814/1625] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:43:15 2022] POST /identity/v3/projects => generated 371 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:43:15.767938 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b89b084-6641-475e-883b-c41b8a30d240 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:15.824551 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b89b084-6641-475e-883b-c41b8a30d240 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:15.828308 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5be863-25f9-48f7-b485-a49e9241cb0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:15.829001 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5be863-25f9-48f7-b485-a49e9241cb0f service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:15.829279 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5be863-25f9-48f7-b485-a49e9241cb0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:15.829578 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5be863-25f9-48f7-b485-a49e9241cb0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:15.876466 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 812/1626] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:43:15 2022] POST /identity/v3/projects => generated 381 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:43:15.877660 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364ac880-a0b7-4701-8ed8-751a8a11d2de admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:15.907940 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5be863-25f9-48f7-b485-a49e9241cb0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:15.909822 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5be863-25f9-48f7-b485-a49e9241cb0f service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:15.920363 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 815/1627] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:43:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:43:15.921589 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0966e78-e448-4583-a2a4-83778f47d74a None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:15.921877 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0966e78-e448-4583-a2a4-83778f47d74a None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:15.922218 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0966e78-e448-4583-a2a4-83778f47d74a None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:15.923573 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 816/1628] 10.222.0.43 () {54 vars in 912 bytes} [Mon Apr 11 16:43:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:43:15.929628 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94ddc7-a468-473b-8455-d1759219c360 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:15.932581 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94ddc7-a468-473b-8455-d1759219c360 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:15.932581 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94ddc7-a468-473b-8455-d1759219c360 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:15.932581 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 817/1629] 10.222.0.43 () {54 vars in 912 bytes} [Mon Apr 11 16:43:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:43:15.932581 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f94ddc7-a468-473b-8455-d1759219c360 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:15.961812 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364ac880-a0b7-4701-8ed8-751a8a11d2de admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:15.967462 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4105f6ec-7337-4f27-8e46-ccecf420e394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:15.968340 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4105f6ec-7337-4f27-8e46-ccecf420e394 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:15.968625 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4105f6ec-7337-4f27-8e46-ccecf420e394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:15.968900 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4105f6ec-7337-4f27-8e46-ccecf420e394 admin admin] PATH_INFO: `/v3/projects/a6804a6738174a58834d14917f8ca982/users/4f857d33948548e2aa7e85ec9bc676ba/roles/702e5e78b5d744529384b96a390ae92f` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:15.971189 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4105f6ec-7337-4f27-8e46-ccecf420e394 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6804a6738174a58834d14917f8ca982, user_id=4f857d33948548e2aa7e85ec9bc676ba, role_id=702e5e78b5d744529384b96a390ae92f)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:15.973643 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4105f6ec-7337-4f27-8e46-ccecf420e394 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:15.998514 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 813/1630] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:43:15 2022] PUT /identity/v3/projects/a6804a6738174a58834d14917f8ca982/users/4f857d33948548e2aa7e85ec9bc676ba/roles/702e5e78b5d744529384b96a390ae92f => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:43:15.998514 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4105f6ec-7337-4f27-8e46-ccecf420e394 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:16.010349 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f94ddc7-a468-473b-8455-d1759219c360 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:16.074380 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4105f6ec-7337-4f27-8e46-ccecf420e394 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:16.076658 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b0b2e9-8e4a-45df-b0e4-22b87530fb63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:16.077522 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b0b2e9-8e4a-45df-b0e4-22b87530fb63 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:16.077811 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b0b2e9-8e4a-45df-b0e4-22b87530fb63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:16.078112 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b0b2e9-8e4a-45df-b0e4-22b87530fb63 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:16.079019 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b0b2e9-8e4a-45df-b0e4-22b87530fb63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:16.081935 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7919dc37-56fa-492a-809d-9345ea6273fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:16.081935 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919dc37-56fa-492a-809d-9345ea6273fe admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:16.082109 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b0b2e9-8e4a-45df-b0e4-22b87530fb63 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:16.082209 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919dc37-56fa-492a-809d-9345ea6273fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:16.082209 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919dc37-56fa-492a-809d-9345ea6273fe admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:16.082353 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7919dc37-56fa-492a-809d-9345ea6273fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:16.084249 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7919dc37-56fa-492a-809d-9345ea6273fe admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:16.169742 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 814/1631] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:43:15 2022] POST /identity/v3/users => generated 297 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:43:16.170978 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c965d-a267-4c93-aa89-443b5e8e71d1 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:16.171275 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c965d-a267-4c93-aa89-443b5e8e71d1 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:16.171565 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c965d-a267-4c93-aa89-443b5e8e71d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:16.177596 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 818/1632] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:43:15 2022] POST /identity/v3/users => generated 292 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:43:16.177596 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f39480-ded2-4d1b-9d0b-def56478ad13 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:16.177596 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f39480-ded2-4d1b-9d0b-def56478ad13 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:16.177945 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f39480-ded2-4d1b-9d0b-def56478ad13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:16.192374 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-111c965d-a267-4c93-aa89-443b5e8e71d1 None None] MFA Rules not processed for user `1be2652c984a4283aeee0b937f0555e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:16.193645 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-111c965d-a267-4c93-aa89-443b5e8e71d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:16.199413 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-33f39480-ded2-4d1b-9d0b-def56478ad13 None None] MFA Rules not processed for user `1be2652c984a4283aeee0b937f0555e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:16.201338 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-33f39480-ded2-4d1b-9d0b-def56478ad13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:16.269531 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 815/1633] 10.222.0.43 () {58 vars in 1009 bytes} [Mon Apr 11 16:43:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:16.271020 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a4acda-75e0-40d7-a868-5399f8fda3f5 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:16.271311 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a4acda-75e0-40d7-a868-5399f8fda3f5 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:16.271617 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a4acda-75e0-40d7-a868-5399f8fda3f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:16.288450 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 819/1634] 10.222.0.43 () {58 vars in 1009 bytes} [Mon Apr 11 16:43:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:16.289552 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f39480-ded2-4d1b-9d0b-def56478ad13 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:16.312763 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f39480-ded2-4d1b-9d0b-def56478ad13 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:16.328106 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-47a4acda-75e0-40d7-a868-5399f8fda3f5 None None] MFA Rules not processed for user `4f857d33948548e2aa7e85ec9bc676ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:16.329385 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-47a4acda-75e0-40d7-a868-5399f8fda3f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:16.330285 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f91e73b-6d71-4361-9ec6-e5491d60b8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:16.331001 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91e73b-6d71-4361-9ec6-e5491d60b8f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:16.331381 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91e73b-6d71-4361-9ec6-e5491d60b8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:16.332413 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91e73b-6d71-4361-9ec6-e5491d60b8f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:16.333335 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f91e73b-6d71-4361-9ec6-e5491d60b8f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:16.338501 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f91e73b-6d71-4361-9ec6-e5491d60b8f2 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:16.350226 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 820/1635] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:43:16 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:43:16.351446 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f91e73b-6d71-4361-9ec6-e5491d60b8f2 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:16.365475 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f91e73b-6d71-4361-9ec6-e5491d60b8f2 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:16.372493 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db95fca0-443f-40fd-84a1-e475a64af3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:16.373977 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95fca0-443f-40fd-84a1-e475a64af3a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:16.374419 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95fca0-443f-40fd-84a1-e475a64af3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:16.374825 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95fca0-443f-40fd-84a1-e475a64af3a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:16.375888 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db95fca0-443f-40fd-84a1-e475a64af3a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:16.378546 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db95fca0-443f-40fd-84a1-e475a64af3a4 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:16.399185 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 821/1636] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:43:16 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:43:16.399185 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db95fca0-443f-40fd-84a1-e475a64af3a4 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:16.423676 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 816/1637] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:43:16 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:16.431297 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a4acda-75e0-40d7-a868-5399f8fda3f5 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:16.461889 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db95fca0-443f-40fd-84a1-e475a64af3a4 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:16.467121 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e583d475-b29f-490f-af27-278f48210326 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '950b5b5f690d41509ead753065a0b793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:16.468095 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583d475-b29f-490f-af27-278f48210326 service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:16.468390 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583d475-b29f-490f-af27-278f48210326 service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:16.468661 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583d475-b29f-490f-af27-278f48210326 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:16.485956 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e583d475-b29f-490f-af27-278f48210326 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:16.488456 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e583d475-b29f-490f-af27-278f48210326 service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:16.502084 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a4acda-75e0-40d7-a868-5399f8fda3f5 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:16.508347 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec5dc40-de5f-425b-bc50-9c069f0ac88b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '950b5b5f690d41509ead753065a0b793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:16.510579 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec5dc40-de5f-425b-bc50-9c069f0ac88b service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:16.510579 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec5dc40-de5f-425b-bc50-9c069f0ac88b service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:16.510579 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec5dc40-de5f-425b-bc50-9c069f0ac88b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:16.510995 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 822/1638] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:43:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:43:16.512453 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e583d475-b29f-490f-af27-278f48210326 service cinder] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:16.522905 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec5dc40-de5f-425b-bc50-9c069f0ac88b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:16.524389 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e583d475-b29f-490f-af27-278f48210326 service cinder] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:16.524532 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec5dc40-de5f-425b-bc50-9c069f0ac88b service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:16.530824 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bc0e56-b5be-4326-9b03-cc40a5dc8ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:16.532384 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc0e56-b5be-4326-9b03-cc40a5dc8ee3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:16.532679 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc0e56-b5be-4326-9b03-cc40a5dc8ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:16.533198 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc0e56-b5be-4326-9b03-cc40a5dc8ee3 admin admin] PATH_INFO: `/v3/projects/54462a63f693411ab2fb267f19762eeb/users/1de9e52bf388443fb632f3459575e71d/roles/702e5e78b5d744529384b96a390ae92f` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:16.539980 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 817/1639] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:43:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:43:16.540955 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec5dc40-de5f-425b-bc50-9c069f0ac88b service cinder] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:16.554116 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bc0e56-b5be-4326-9b03-cc40a5dc8ee3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54462a63f693411ab2fb267f19762eeb, user_id=1de9e52bf388443fb632f3459575e71d, role_id=702e5e78b5d744529384b96a390ae92f)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:16.554955 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec5dc40-de5f-425b-bc50-9c069f0ac88b service cinder] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:16.557851 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bc0e56-b5be-4326-9b03-cc40a5dc8ee3 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:16.561161 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acef098-d7b2-418c-8190-d8656ea0fc20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:16.563088 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acef098-d7b2-418c-8190-d8656ea0fc20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:16.563462 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acef098-d7b2-418c-8190-d8656ea0fc20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:16.563898 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acef098-d7b2-418c-8190-d8656ea0fc20 admin admin] PATH_INFO: `/v3/projects/aef4b6a8017e46938972de3427adf46d/users/ea8e5c1334ba4fb49033a5999c7e342b/roles/702e5e78b5d744529384b96a390ae92f` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:16.580106 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acef098-d7b2-418c-8190-d8656ea0fc20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aef4b6a8017e46938972de3427adf46d, user_id=ea8e5c1334ba4fb49033a5999c7e342b, role_id=702e5e78b5d744529384b96a390ae92f)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:16.582806 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acef098-d7b2-418c-8190-d8656ea0fc20 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:16.627293 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 823/1640] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:43:16 2022] PUT /identity/v3/projects/54462a63f693411ab2fb267f19762eeb/users/1de9e52bf388443fb632f3459575e71d/roles/702e5e78b5d744529384b96a390ae92f => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:43:16.631204 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bc0e56-b5be-4326-9b03-cc40a5dc8ee3 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:16.704002 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 818/1641] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:43:16 2022] PUT /identity/v3/projects/aef4b6a8017e46938972de3427adf46d/users/ea8e5c1334ba4fb49033a5999c7e342b/roles/702e5e78b5d744529384b96a390ae92f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:43:16.705132 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acef098-d7b2-418c-8190-d8656ea0fc20 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:16.750750 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bc0e56-b5be-4326-9b03-cc40a5dc8ee3 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:16.799078 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acef098-d7b2-418c-8190-d8656ea0fc20 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:16.799078 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40804c88-b803-462a-b5d6-c59d35b91968 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '950b5b5f690d41509ead753065a0b793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:16.799078 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40804c88-b803-462a-b5d6-c59d35b91968 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:16.799078 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40804c88-b803-462a-b5d6-c59d35b91968 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:16.800023 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40804c88-b803-462a-b5d6-c59d35b91968 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:16.891816 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ac2de-caeb-4d4c-8b1a-0232ad6813a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:16.892612 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ac2de-caeb-4d4c-8b1a-0232ad6813a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:16.892898 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ac2de-caeb-4d4c-8b1a-0232ad6813a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:16.893172 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ac2de-caeb-4d4c-8b1a-0232ad6813a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:16.896387 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4ac2de-caeb-4d4c-8b1a-0232ad6813a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:16.900251 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4ac2de-caeb-4d4c-8b1a-0232ad6813a6 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:16.919915 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 824/1642] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:43:16 2022] GET /identity/v3/roles => generated 1420 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:43:16.922165 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ac2de-caeb-4d4c-8b1a-0232ad6813a6 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:16.946822 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ac2de-caeb-4d4c-8b1a-0232ad6813a6 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:16.955781 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40804c88-b803-462a-b5d6-c59d35b91968 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:16.957246 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40804c88-b803-462a-b5d6-c59d35b91968 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:16.963740 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ee194e-012b-44cc-a2c0-113057e9c3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:16.964492 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee194e-012b-44cc-a2c0-113057e9c3cb admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:16.964924 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee194e-012b-44cc-a2c0-113057e9c3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:16.965266 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee194e-012b-44cc-a2c0-113057e9c3cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:16.966009 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ee194e-012b-44cc-a2c0-113057e9c3cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:16.968411 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ee194e-012b-44cc-a2c0-113057e9c3cb admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:16.990920 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 819/1643] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:43:16 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:43:16.992437 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40804c88-b803-462a-b5d6-c59d35b91968 service cinder] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:16.996495 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 825/1644] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:43:16 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:43:16.998710 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ee194e-012b-44cc-a2c0-113057e9c3cb admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:17.020619 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ee194e-012b-44cc-a2c0-113057e9c3cb admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:17.032744 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40804c88-b803-462a-b5d6-c59d35b91968 service cinder] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:17.035134 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ed467-cafa-4dc8-9355-604910443505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:17.036441 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ed467-cafa-4dc8-9355-604910443505 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:17.036772 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ed467-cafa-4dc8-9355-604910443505 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:17.037154 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ed467-cafa-4dc8-9355-604910443505 admin admin] PATH_INFO: `/v3/projects/aef4b6a8017e46938972de3427adf46d/users/ea8e5c1334ba4fb49033a5999c7e342b/roles/702e5e78b5d744529384b96a390ae92f` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:17.042119 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6ed467-cafa-4dc8-9355-604910443505 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aef4b6a8017e46938972de3427adf46d, user_id=ea8e5c1334ba4fb49033a5999c7e342b, role_id=702e5e78b5d744529384b96a390ae92f)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:17.044879 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6ed467-cafa-4dc8-9355-604910443505 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:17.045720 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52493a68-b988-4a6d-bf20-961af5cfbc1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:17.051925 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52493a68-b988-4a6d-bf20-961af5cfbc1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:17.051925 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52493a68-b988-4a6d-bf20-961af5cfbc1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:17.051925 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52493a68-b988-4a6d-bf20-961af5cfbc1c admin admin] PATH_INFO: `/v3/projects/54462a63f693411ab2fb267f19762eeb/users/1de9e52bf388443fb632f3459575e71d/roles/702e5e78b5d744529384b96a390ae92f` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:17.051925 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52493a68-b988-4a6d-bf20-961af5cfbc1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=54462a63f693411ab2fb267f19762eeb, user_id=1de9e52bf388443fb632f3459575e71d, role_id=702e5e78b5d744529384b96a390ae92f)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:17.053983 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52493a68-b988-4a6d-bf20-961af5cfbc1c admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:17.063624 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 826/1645] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:43:16 2022] PUT /identity/v3/projects/aef4b6a8017e46938972de3427adf46d/users/ea8e5c1334ba4fb49033a5999c7e342b/roles/702e5e78b5d744529384b96a390ae92f => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:43:17.072381 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 820/1646] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:43:16 2022] PUT /identity/v3/projects/54462a63f693411ab2fb267f19762eeb/users/1de9e52bf388443fb632f3459575e71d/roles/702e5e78b5d744529384b96a390ae92f => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:43:17.072551 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812fc845-4be0-4f81-af74-86348cd305e4 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:17.072744 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812fc845-4be0-4f81-af74-86348cd305e4 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:17.073002 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812fc845-4be0-4f81-af74-86348cd305e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:17.083808 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fddc322-d667-4b93-b7a6-332701b19903 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:17.084140 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fddc322-d667-4b93-b7a6-332701b19903 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:17.084384 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fddc322-d667-4b93-b7a6-332701b19903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:17.109064 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-812fc845-4be0-4f81-af74-86348cd305e4 None None] MFA Rules not processed for user `ea8e5c1334ba4fb49033a5999c7e342b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:17.110858 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-812fc845-4be0-4f81-af74-86348cd305e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:17.119427 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-1fddc322-d667-4b93-b7a6-332701b19903 None None] MFA Rules not processed for user `1de9e52bf388443fb632f3459575e71d`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:17.120732 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-1fddc322-d667-4b93-b7a6-332701b19903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:17.212317 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 827/1647] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:43:17 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:43:17.245742 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 821/1648] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:43:17 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:43:17.399918 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812fc845-4be0-4f81-af74-86348cd305e4 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:17.514493 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812fc845-4be0-4f81-af74-86348cd305e4 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:17.518708 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779fb8d2-4b4c-40c3-91ec-1958fb95086a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '950b5b5f690d41509ead753065a0b793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:17.519379 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779fb8d2-4b4c-40c3-91ec-1958fb95086a service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:17.519708 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779fb8d2-4b4c-40c3-91ec-1958fb95086a service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:17.520010 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779fb8d2-4b4c-40c3-91ec-1958fb95086a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:17.531660 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779fb8d2-4b4c-40c3-91ec-1958fb95086a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:17.533303 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779fb8d2-4b4c-40c3-91ec-1958fb95086a service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:17.546142 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 828/1649] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:43:17 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:43:17.666692 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fddc322-d667-4b93-b7a6-332701b19903 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:17.674281 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779fb8d2-4b4c-40c3-91ec-1958fb95086a service cinder] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:17.677553 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fddc322-d667-4b93-b7a6-332701b19903 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:17.690919 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c9105a-e449-427a-9388-793ac509ba55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '950b5b5f690d41509ead753065a0b793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:17.691888 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9105a-e449-427a-9388-793ac509ba55 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:17.692417 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9105a-e449-427a-9388-793ac509ba55 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:17.692800 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9105a-e449-427a-9388-793ac509ba55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:17.711885 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c9105a-e449-427a-9388-793ac509ba55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:17.713719 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c9105a-e449-427a-9388-793ac509ba55 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:17.727423 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 822/1650] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:43:17 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:43:17.795161 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779fb8d2-4b4c-40c3-91ec-1958fb95086a service cinder] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:17.802162 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5aa1bb-99e1-4810-86b4-6730c767e9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:17.803074 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5aa1bb-99e1-4810-86b4-6730c767e9b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:17.803589 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5aa1bb-99e1-4810-86b4-6730c767e9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:17.803978 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5aa1bb-99e1-4810-86b4-6730c767e9b0 admin admin] PATH_INFO: `/v3/users/8ae0ffb89179421c947fd2a1018d9642` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:17.805324 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5aa1bb-99e1-4810-86b4-6730c767e9b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ae0ffb89179421c947fd2a1018d9642)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:17.807630 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5aa1bb-99e1-4810-86b4-6730c767e9b0 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:18.155220 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4635b24f-0def-4fbe-b1c6-0fa79ae0afd2 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:18.155787 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4635b24f-0def-4fbe-b1c6-0fa79ae0afd2 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:18.156013 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4635b24f-0def-4fbe-b1c6-0fa79ae0afd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:18.226535 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-dd5aa1bb-99e1-4810-86b4-6730c767e9b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ae0ffb89179421c947fd2a1018d9642'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:18.234643 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-4635b24f-0def-4fbe-b1c6-0fa79ae0afd2 None None] MFA Rules not processed for user `8f859f7968de4023b1113461a9dc7228`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:18.236116 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-4635b24f-0def-4fbe-b1c6-0fa79ae0afd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:18.323079 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-dd5aa1bb-99e1-4810-86b4-6730c767e9b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ae0ffb89179421c947fd2a1018d9642'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:18.346573 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-dd5aa1bb-99e1-4810-86b4-6730c767e9b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ae0ffb89179421c947fd2a1018d9642'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:18.348095 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-dd5aa1bb-99e1-4810-86b4-6730c767e9b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ae0ffb89179421c947fd2a1018d9642'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:18.388162 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 823/1651] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:43:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:43:18.389192 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4635b24f-0def-4fbe-b1c6-0fa79ae0afd2 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:18.391108 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-4635b24f-0def-4fbe-b1c6-0fa79ae0afd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:18.392296 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-dd5aa1bb-99e1-4810-86b4-6730c767e9b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ae0ffb89179421c947fd2a1018d9642'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:18.408163 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 829/1652] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:43:17 2022] DELETE /identity/v3/users/8ae0ffb89179421c947fd2a1018d9642 => generated 0 bytes in 734 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:43:18.409631 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4635b24f-0def-4fbe-b1c6-0fa79ae0afd2 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:18.411824 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5aa1bb-99e1-4810-86b4-6730c767e9b0 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:18.414542 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-dd5aa1bb-99e1-4810-86b4-6730c767e9b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:18.513972 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aea75d-6bdc-4dd2-8ec9-768f90df875c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '950b5b5f690d41509ead753065a0b793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:18.515360 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aea75d-6bdc-4dd2-8ec9-768f90df875c service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:18.516377 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aea75d-6bdc-4dd2-8ec9-768f90df875c service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:18.516764 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aea75d-6bdc-4dd2-8ec9-768f90df875c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:18.519110 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-01aea75d-6bdc-4dd2-8ec9-768f90df875c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:18.538172 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5aa1bb-99e1-4810-86b4-6730c767e9b0 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:18.543015 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c80b0c-49f8-4dca-9d54-ba4dff21ea00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '950b5b5f690d41509ead753065a0b793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:18.544053 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c80b0c-49f8-4dca-9d54-ba4dff21ea00 service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:18.544497 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c80b0c-49f8-4dca-9d54-ba4dff21ea00 service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:18.545213 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c80b0c-49f8-4dca-9d54-ba4dff21ea00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:18.547714 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-54c80b0c-49f8-4dca-9d54-ba4dff21ea00 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:18.607174 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aea75d-6bdc-4dd2-8ec9-768f90df875c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:18.609008 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aea75d-6bdc-4dd2-8ec9-768f90df875c service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:18.628311 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 824/1653] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:43:18 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:43:18.648381 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8349ef80-08b9-46c8-9940-9e7b0a41723e None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:18.648936 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8349ef80-08b9-46c8-9940-9e7b0a41723e None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:18.649919 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8349ef80-08b9-46c8-9940-9e7b0a41723e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:18.662990 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c80b0c-49f8-4dca-9d54-ba4dff21ea00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:18.664488 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c80b0c-49f8-4dca-9d54-ba4dff21ea00 service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:18.687976 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 830/1654] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:43:18 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:43:18.693274 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c606b701-e72f-405a-b533-76a37bf36e2c None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:18.694871 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c606b701-e72f-405a-b533-76a37bf36e2c None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:18.695366 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c606b701-e72f-405a-b533-76a37bf36e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:18.712253 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-8349ef80-08b9-46c8-9940-9e7b0a41723e None None] MFA Rules not processed for user `8f859f7968de4023b1113461a9dc7228`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:18.721839 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-8349ef80-08b9-46c8-9940-9e7b0a41723e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:18.754000 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-c606b701-e72f-405a-b533-76a37bf36e2c None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:18.754325 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-c606b701-e72f-405a-b533-76a37bf36e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:18.888085 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 825/1655] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:43:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:18.904629 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8349ef80-08b9-46c8-9940-9e7b0a41723e None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:18.906387 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-8349ef80-08b9-46c8-9940-9e7b0a41723e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:18.907079 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 831/1656] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:43:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:18.951071 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c606b701-e72f-405a-b533-76a37bf36e2c None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:18.952976 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-c606b701-e72f-405a-b533-76a37bf36e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:19.047232 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8349ef80-08b9-46c8-9940-9e7b0a41723e None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:19.102250 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c606b701-e72f-405a-b533-76a37bf36e2c None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:19.102424 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08548aa5-acd6-4302-8c5a-77dcf714132e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1be2652c984a4283aeee0b937f0555e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:19.102424 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08548aa5-acd6-4302-8c5a-77dcf714132e service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:19.102596 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43864ac2-f0ad-4061-8680-316cc00f6ec1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:19.102724 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08548aa5-acd6-4302-8c5a-77dcf714132e service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:19.102724 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08548aa5-acd6-4302-8c5a-77dcf714132e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:19.102965 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43864ac2-f0ad-4061-8680-316cc00f6ec1 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:19.102965 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43864ac2-f0ad-4061-8680-316cc00f6ec1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:19.102965 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43864ac2-f0ad-4061-8680-316cc00f6ec1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:19.126506 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08548aa5-acd6-4302-8c5a-77dcf714132e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:19.132967 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08548aa5-acd6-4302-8c5a-77dcf714132e service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:19.142501 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43864ac2-f0ad-4061-8680-316cc00f6ec1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:19.144008 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43864ac2-f0ad-4061-8680-316cc00f6ec1 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:19.172353 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 832/1657] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:43:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 16:43:19.174735 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 826/1658] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:43:18 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:43:20.236640 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14efe999-0831-44be-9265-aec4e9774a69 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:20.236640 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14efe999-0831-44be-9265-aec4e9774a69 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:20.236640 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14efe999-0831-44be-9265-aec4e9774a69 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:20.239045 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 833/1659] 10.222.0.43 () {54 vars in 912 bytes} [Mon Apr 11 16:43:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:43:20.248455 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6257e7e-6b4f-4bea-a1db-74fd9c990126 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:20.249313 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6257e7e-6b4f-4bea-a1db-74fd9c990126 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:20.249313 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6257e7e-6b4f-4bea-a1db-74fd9c990126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:20.302029 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-c6257e7e-6b4f-4bea-a1db-74fd9c990126 None None] MFA Rules not processed for user `f8c213711e794a1ba47ecf46ecb57769`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:20.315430 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-c6257e7e-6b4f-4bea-a1db-74fd9c990126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:20.344970 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 827/1660] 10.222.0.43 () {58 vars in 1009 bytes} [Mon Apr 11 16:43:20 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:20.354311 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14efe999-0831-44be-9265-aec4e9774a69 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:20.371485 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14efe999-0831-44be-9265-aec4e9774a69 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:20.376032 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aac9d5-edfe-427f-9a13-2e9381b7580d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:20.377251 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aac9d5-edfe-427f-9a13-2e9381b7580d service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:20.378608 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aac9d5-edfe-427f-9a13-2e9381b7580d service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:20.379062 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aac9d5-edfe-427f-9a13-2e9381b7580d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:20.391295 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aac9d5-edfe-427f-9a13-2e9381b7580d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:20.393688 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aac9d5-edfe-427f-9a13-2e9381b7580d service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:20.405426 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 834/1661] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:43:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:43:20.690228 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6257e7e-6b4f-4bea-a1db-74fd9c990126 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:20.692465 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-c6257e7e-6b4f-4bea-a1db-74fd9c990126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:20.741642 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6257e7e-6b4f-4bea-a1db-74fd9c990126 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:20.760296 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a8d8b-e82a-4e8d-8744-e97ca6e5cc80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:20.761673 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a8d8b-e82a-4e8d-8744-e97ca6e5cc80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:20.762221 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a8d8b-e82a-4e8d-8744-e97ca6e5cc80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:20.762579 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a8d8b-e82a-4e8d-8744-e97ca6e5cc80 admin admin] PATH_INFO: `/v3/projects/8b9b773b5ec643b59f2a482491ee71dd` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:20.781087 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559a8d8b-e82a-4e8d-8744-e97ca6e5cc80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b9b773b5ec643b59f2a482491ee71dd)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:20.781087 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559a8d8b-e82a-4e8d-8744-e97ca6e5cc80 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:21.212999 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-559a8d8b-e82a-4e8d-8744-e97ca6e5cc80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b9b773b5ec643b59f2a482491ee71dd', 'request_id': 'req-559a8d8b-e82a-4e8d-8744-e97ca6e5cc80'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:21.212999 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-559a8d8b-e82a-4e8d-8744-e97ca6e5cc80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b9b773b5ec643b59f2a482491ee71dd', 'request_id': 'req-559a8d8b-e82a-4e8d-8744-e97ca6e5cc80'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:21.316317 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-559a8d8b-e82a-4e8d-8744-e97ca6e5cc80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b9b773b5ec643b59f2a482491ee71dd', 'request_id': 'req-559a8d8b-e82a-4e8d-8744-e97ca6e5cc80'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:21.347293 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-559a8d8b-e82a-4e8d-8744-e97ca6e5cc80 admin admin] The token cache is being invalidate because project 8b9b773b5ec643b59f2a482491ee71dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:43:21.347625 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-559a8d8b-e82a-4e8d-8744-e97ca6e5cc80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:21.349743 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-559a8d8b-e82a-4e8d-8744-e97ca6e5cc80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:21.353834 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 828/1662] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:43:20 2022] DELETE /identity/v3/projects/8b9b773b5ec643b59f2a482491ee71dd => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:43:21.359889 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a3be2-bab1-4e00-b98e-83980b5cb4e2 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:21.360774 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a3be2-bab1-4e00-b98e-83980b5cb4e2 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:21.361217 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a3be2-bab1-4e00-b98e-83980b5cb4e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:21.410005 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-a00a3be2-bab1-4e00-b98e-83980b5cb4e2 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:21.416550 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-a00a3be2-bab1-4e00-b98e-83980b5cb4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:21.512292 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a8d8b-e82a-4e8d-8744-e97ca6e5cc80 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:21.514089 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-559a8d8b-e82a-4e8d-8744-e97ca6e5cc80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:21.542454 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 835/1663] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:43:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:21.550704 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc1e5e-eb71-45b9-9259-7eed76595353 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:21.551129 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc1e5e-eb71-45b9-9259-7eed76595353 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:21.551508 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc1e5e-eb71-45b9-9259-7eed76595353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:21.579783 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-3fcc1e5e-eb71-45b9-9259-7eed76595353 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:21.581581 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-3fcc1e5e-eb71-45b9-9259-7eed76595353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:21.595443 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 836/1664] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:43:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:43:21.596676 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc1e5e-eb71-45b9-9259-7eed76595353 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:21.614175 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc1e5e-eb71-45b9-9259-7eed76595353 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:21.621818 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab113545-e108-4172-ac5f-3e7f7e98993e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:21.622843 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab113545-e108-4172-ac5f-3e7f7e98993e admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:21.623329 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab113545-e108-4172-ac5f-3e7f7e98993e admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:21.624500 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab113545-e108-4172-ac5f-3e7f7e98993e admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:21.625623 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab113545-e108-4172-ac5f-3e7f7e98993e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:43:21.626143 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab113545-e108-4172-ac5f-3e7f7e98993e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:21.628453 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab113545-e108-4172-ac5f-3e7f7e98993e admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:21.642595 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a8d8b-e82a-4e8d-8744-e97ca6e5cc80 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:21.652283 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 837/1665] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Apr 11 16:43:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:43:21.656674 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab113545-e108-4172-ac5f-3e7f7e98993e admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:21.663224 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a0cd65-edad-4ad9-a325-514596bf5416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:21.667293 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a0cd65-edad-4ad9-a325-514596bf5416 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:21.668558 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a0cd65-edad-4ad9-a325-514596bf5416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:21.670920 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a0cd65-edad-4ad9-a325-514596bf5416 admin admin] PATH_INFO: `/v3/users/e2969f53def54839aa6bd8ca5935ade6` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:21.674802 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a0cd65-edad-4ad9-a325-514596bf5416 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2969f53def54839aa6bd8ca5935ade6)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:21.676084 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: WARNING py.warnings [None req-12a0cd65-edad-4ad9-a325-514596bf5416 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 11 16:43:21.676084 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: warnings.warn(msg) Apr 11 16:43:21.676084 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: Apr 11 16:43:21.680883 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a0cd65-edad-4ad9-a325-514596bf5416 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:21.680955 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab113545-e108-4172-ac5f-3e7f7e98993e admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:21.692315 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503ce779-6bf7-4cee-8cf9-7676d249a2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:21.693091 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ce779-6bf7-4cee-8cf9-7676d249a2e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:21.694499 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ce779-6bf7-4cee-8cf9-7676d249a2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:21.695637 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ce779-6bf7-4cee-8cf9-7676d249a2e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:21.697728 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503ce779-6bf7-4cee-8cf9-7676d249a2e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:21.701550 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503ce779-6bf7-4cee-8cf9-7676d249a2e9 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:21.883299 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 838/1666] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:43:21 2022] POST /identity/v3/projects => generated 385 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:43:21.883299 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503ce779-6bf7-4cee-8cf9-7676d249a2e9 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:22.048832 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-12a0cd65-edad-4ad9-a325-514596bf5416 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2969f53def54839aa6bd8ca5935ade6'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:22.051854 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-12a0cd65-edad-4ad9-a325-514596bf5416 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2969f53def54839aa6bd8ca5935ade6'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:22.163836 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-12a0cd65-edad-4ad9-a325-514596bf5416 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2969f53def54839aa6bd8ca5935ade6'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:22.188319 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-12a0cd65-edad-4ad9-a325-514596bf5416 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2969f53def54839aa6bd8ca5935ade6'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:22.195950 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503ce779-6bf7-4cee-8cf9-7676d249a2e9 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:22.207047 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea687f8-9fe8-459b-906e-b7a63bb01863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:22.208040 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea687f8-9fe8-459b-906e-b7a63bb01863 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:22.208486 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea687f8-9fe8-459b-906e-b7a63bb01863 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:22.208881 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea687f8-9fe8-459b-906e-b7a63bb01863 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:22.210866 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea687f8-9fe8-459b-906e-b7a63bb01863 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:22.214533 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea687f8-9fe8-459b-906e-b7a63bb01863 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:22.276746 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-12a0cd65-edad-4ad9-a325-514596bf5416 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2969f53def54839aa6bd8ca5935ade6'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:22.287012 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 829/1667] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:43:21 2022] DELETE /identity/v3/users/e2969f53def54839aa6bd8ca5935ade6 => generated 0 bytes in 775 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:43:22.289492 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e003f-3c9f-4f24-96e0-25e98c9b88ff None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:22.289932 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e003f-3c9f-4f24-96e0-25e98c9b88ff None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:22.290379 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e003f-3c9f-4f24-96e0-25e98c9b88ff None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:22.296999 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 830/1668] 10.222.0.43 () {54 vars in 960 bytes} [Mon Apr 11 16:43:22 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:43:22.298578 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f77ff36-a2a4-4b8b-8d5a-482510294b09 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:22.299010 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f77ff36-a2a4-4b8b-8d5a-482510294b09 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:22.299428 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f77ff36-a2a4-4b8b-8d5a-482510294b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:22.319249 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-6f77ff36-a2a4-4b8b-8d5a-482510294b09 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:22.321641 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-6f77ff36-a2a4-4b8b-8d5a-482510294b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:22.378815 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 839/1669] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:43:21 2022] POST /identity/v3/users => generated 293 bytes in 495 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:43:22.378815 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc02d09-1f62-40b5-8383-23a94284737e None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:22.378815 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc02d09-1f62-40b5-8383-23a94284737e None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:22.380754 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc02d09-1f62-40b5-8383-23a94284737e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:22.395433 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 831/1670] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:43:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:22.397247 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f77ff36-a2a4-4b8b-8d5a-482510294b09 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:22.398897 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-6f77ff36-a2a4-4b8b-8d5a-482510294b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:22.412518 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f77ff36-a2a4-4b8b-8d5a-482510294b09 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:22.418162 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf7b811-ccf4-45de-aee7-93521b8c7fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:22.419066 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7b811-ccf4-45de-aee7-93521b8c7fac admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:22.419549 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7b811-ccf4-45de-aee7-93521b8c7fac admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:22.419964 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7b811-ccf4-45de-aee7-93521b8c7fac admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:22.420866 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf7b811-ccf4-45de-aee7-93521b8c7fac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:22.422626 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf7b811-ccf4-45de-aee7-93521b8c7fac admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:22.430902 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-0fc02d09-1f62-40b5-8383-23a94284737e None None] MFA Rules not processed for user `6589debd41bf496085c7339ab5409666`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:22.434563 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-0fc02d09-1f62-40b5-8383-23a94284737e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:22.438986 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 832/1671] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:43:22 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:43:22.440276 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf7b811-ccf4-45de-aee7-93521b8c7fac admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:22.444508 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-bbf7b811-ccf4-45de-aee7-93521b8c7fac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:22.547943 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf7b811-ccf4-45de-aee7-93521b8c7fac admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:22.554718 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6fd70a-1007-457a-bebb-3dc12944e285 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:22.555646 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6fd70a-1007-457a-bebb-3dc12944e285 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:22.556073 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6fd70a-1007-457a-bebb-3dc12944e285 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:22.556522 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6fd70a-1007-457a-bebb-3dc12944e285 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:22.569880 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6fd70a-1007-457a-bebb-3dc12944e285 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:22.571656 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6fd70a-1007-457a-bebb-3dc12944e285 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:22.583674 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 833/1672] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:43:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:43:22.586169 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6fd70a-1007-457a-bebb-3dc12944e285 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:22.588536 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 840/1673] 10.222.0.43 () {58 vars in 1057 bytes} [Mon Apr 11 16:43:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:22.596746 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc02d09-1f62-40b5-8383-23a94284737e None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:22.605436 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6fd70a-1007-457a-bebb-3dc12944e285 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:22.613280 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc02d09-1f62-40b5-8383-23a94284737e None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:22.617570 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae1b96-7d26-4392-822d-652d2d1e0950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:22.619563 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae1b96-7d26-4392-822d-652d2d1e0950 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:22.620497 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae1b96-7d26-4392-822d-652d2d1e0950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:22.621462 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae1b96-7d26-4392-822d-652d2d1e0950 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:22.622380 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bae1b96-7d26-4392-822d-652d2d1e0950 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:22.626035 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bae1b96-7d26-4392-822d-652d2d1e0950 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:22.626349 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6b9e08-f5e8-4d68-ac36-4dee8522b5d5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6589debd41bf496085c7339ab5409666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:22.627223 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b9e08-f5e8-4d68-ac36-4dee8522b5d5 service placement] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:22.629226 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b9e08-f5e8-4d68-ac36-4dee8522b5d5 service placement] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:22.629668 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b9e08-f5e8-4d68-ac36-4dee8522b5d5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:22.637267 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-ac6b9e08-f5e8-4d68-ac36-4dee8522b5d5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:22.656222 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 834/1674] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:43:22 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:43:22.657911 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae1b96-7d26-4392-822d-652d2d1e0950 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:22.666125 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6b9e08-f5e8-4d68-ac36-4dee8522b5d5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:22.668089 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6b9e08-f5e8-4d68-ac36-4dee8522b5d5 service placement] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:22.679134 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae1b96-7d26-4392-822d-652d2d1e0950 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:22.706996 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 841/1675] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:43:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 16:43:22.707974 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53957d7-3cb9-4ce9-b3b0-c67d976902a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:22.709058 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53957d7-3cb9-4ce9-b3b0-c67d976902a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:22.712394 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53957d7-3cb9-4ce9-b3b0-c67d976902a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:22.712889 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53957d7-3cb9-4ce9-b3b0-c67d976902a2 admin admin] PATH_INFO: `/v3/projects/6f707a0634a644bab365266403cdae42/users/42d715e183b944c6a440dd36c3b08887/roles/0d41da7bec094450b5bff4e4831be52c` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:22.748357 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53957d7-3cb9-4ce9-b3b0-c67d976902a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f707a0634a644bab365266403cdae42, user_id=42d715e183b944c6a440dd36c3b08887, role_id=0d41da7bec094450b5bff4e4831be52c)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:22.756068 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53957d7-3cb9-4ce9-b3b0-c67d976902a2 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:22.850422 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 835/1676] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:43:22 2022] PUT /identity/v3/projects/6f707a0634a644bab365266403cdae42/users/42d715e183b944c6a440dd36c3b08887/roles/0d41da7bec094450b5bff4e4831be52c => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:43:22.864256 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c87ae-a20f-4ad3-959f-2fd391a85cd4 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:22.864645 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c87ae-a20f-4ad3-959f-2fd391a85cd4 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:22.864935 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c87ae-a20f-4ad3-959f-2fd391a85cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:22.917710 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-a45c87ae-a20f-4ad3-959f-2fd391a85cd4 None None] MFA Rules not processed for user `42d715e183b944c6a440dd36c3b08887`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:22.918980 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-a45c87ae-a20f-4ad3-959f-2fd391a85cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:23.070859 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 842/1677] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:43:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:23.075927 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53957d7-3cb9-4ce9-b3b0-c67d976902a2 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:23.230880 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53957d7-3cb9-4ce9-b3b0-c67d976902a2 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:23.243668 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f036b3-3364-4e6e-8de1-10448f25c748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:23.244619 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f036b3-3364-4e6e-8de1-10448f25c748 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:23.244739 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f036b3-3364-4e6e-8de1-10448f25c748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:23.244921 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f036b3-3364-4e6e-8de1-10448f25c748 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:23.245643 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f036b3-3364-4e6e-8de1-10448f25c748 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:23.251274 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f036b3-3364-4e6e-8de1-10448f25c748 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:23.413074 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 836/1678] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:43:23 2022] POST /identity/v3/projects => generated 383 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:43:23.417533 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45c87ae-a20f-4ad3-959f-2fd391a85cd4 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:23.444652 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45c87ae-a20f-4ad3-959f-2fd391a85cd4 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:23.544652 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6229004-8765-4b43-bef9-f2b986ba849c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:23.545595 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6229004-8765-4b43-bef9-f2b986ba849c admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:23.545967 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6229004-8765-4b43-bef9-f2b986ba849c admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:23.546318 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6229004-8765-4b43-bef9-f2b986ba849c admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:23.547110 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6229004-8765-4b43-bef9-f2b986ba849c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:23.549611 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6229004-8765-4b43-bef9-f2b986ba849c admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:23.638841 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 843/1679] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:43:23 2022] POST /identity/v3/users => generated 298 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:43:23.640104 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f036b3-3364-4e6e-8de1-10448f25c748 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:23.658315 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f036b3-3364-4e6e-8de1-10448f25c748 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:23.668172 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0bd111-ed32-40f3-b0ce-e8cd12d9baec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:23.670285 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0bd111-ed32-40f3-b0ce-e8cd12d9baec admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:23.670692 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0bd111-ed32-40f3-b0ce-e8cd12d9baec admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:23.671719 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0bd111-ed32-40f3-b0ce-e8cd12d9baec admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:23.674277 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0bd111-ed32-40f3-b0ce-e8cd12d9baec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:23.677418 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0bd111-ed32-40f3-b0ce-e8cd12d9baec admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:23.698877 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 837/1680] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:43:23 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:43:23.711251 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6229004-8765-4b43-bef9-f2b986ba849c admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:23.728116 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6229004-8765-4b43-bef9-f2b986ba849c admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:23.743907 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bf477c-d688-48a6-b4bb-593083ec07ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:23.744799 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf477c-d688-48a6-b4bb-593083ec07ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:23.745000 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf477c-d688-48a6-b4bb-593083ec07ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:23.745297 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf477c-d688-48a6-b4bb-593083ec07ec admin admin] PATH_INFO: `/v3/projects/85e44dc133ab459f8feda06a5a52f7a1/users/3a3a1612a0b54a14a2dbbe5236cce3e3/roles/702e5e78b5d744529384b96a390ae92f` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:23.752939 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0bd111-ed32-40f3-b0ce-e8cd12d9baec admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:23.755090 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ac0bd111-ed32-40f3-b0ce-e8cd12d9baec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:23.777517 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0bd111-ed32-40f3-b0ce-e8cd12d9baec admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:23.786124 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5f2126-0c65-46b2-af5a-ec7c95e19d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:23.787158 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f2126-0c65-46b2-af5a-ec7c95e19d62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:23.788723 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f2126-0c65-46b2-af5a-ec7c95e19d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:23.789157 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f2126-0c65-46b2-af5a-ec7c95e19d62 admin admin] PATH_INFO: `/v3/projects/fe4cf73b83fe4060ad729f87a685b06e` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:23.791773 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5f2126-0c65-46b2-af5a-ec7c95e19d62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe4cf73b83fe4060ad729f87a685b06e)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:23.794987 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5f2126-0c65-46b2-af5a-ec7c95e19d62 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:23.796054 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bf477c-d688-48a6-b4bb-593083ec07ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=85e44dc133ab459f8feda06a5a52f7a1, user_id=3a3a1612a0b54a14a2dbbe5236cce3e3, role_id=702e5e78b5d744529384b96a390ae92f)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:23.798920 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bf477c-d688-48a6-b4bb-593083ec07ec admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:23.922682 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 844/1681] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:43:23 2022] PUT /identity/v3/projects/85e44dc133ab459f8feda06a5a52f7a1/users/3a3a1612a0b54a14a2dbbe5236cce3e3/roles/702e5e78b5d744529384b96a390ae92f => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:43:23.927195 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bf477c-d688-48a6-b4bb-593083ec07ec admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:24.026000 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-5f5f2126-0c65-46b2-af5a-ec7c95e19d62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe4cf73b83fe4060ad729f87a685b06e', 'request_id': 'req-5f5f2126-0c65-46b2-af5a-ec7c95e19d62'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:24.040846 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-5f5f2126-0c65-46b2-af5a-ec7c95e19d62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe4cf73b83fe4060ad729f87a685b06e', 'request_id': 'req-5f5f2126-0c65-46b2-af5a-ec7c95e19d62'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:24.050827 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bf477c-d688-48a6-b4bb-593083ec07ec admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:24.132489 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c03e61-2a37-4c7d-ad9c-cf74f81495c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:24.133347 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c03e61-2a37-4c7d-ad9c-cf74f81495c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:24.133733 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c03e61-2a37-4c7d-ad9c-cf74f81495c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:24.134109 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c03e61-2a37-4c7d-ad9c-cf74f81495c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:24.135010 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c03e61-2a37-4c7d-ad9c-cf74f81495c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:24.136936 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c03e61-2a37-4c7d-ad9c-cf74f81495c2 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:24.144919 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-5f5f2126-0c65-46b2-af5a-ec7c95e19d62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe4cf73b83fe4060ad729f87a685b06e', 'request_id': 'req-5f5f2126-0c65-46b2-af5a-ec7c95e19d62'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:24.170867 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-5f5f2126-0c65-46b2-af5a-ec7c95e19d62 admin admin] The token cache is being invalidate because project fe4cf73b83fe4060ad729f87a685b06e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:43:24.173457 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-5f5f2126-0c65-46b2-af5a-ec7c95e19d62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:24.189955 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-5f5f2126-0c65-46b2-af5a-ec7c95e19d62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:24.193560 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 838/1682] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:43:23 2022] DELETE /identity/v3/projects/fe4cf73b83fe4060ad729f87a685b06e => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:43:24.193968 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 845/1683] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:43:23 2022] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:43:24.198527 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c03e61-2a37-4c7d-ad9c-cf74f81495c2 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:24.199027 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5f2126-0c65-46b2-af5a-ec7c95e19d62 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:24.202334 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-5f5f2126-0c65-46b2-af5a-ec7c95e19d62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:24.203298 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-a8c03e61-2a37-4c7d-ad9c-cf74f81495c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:24.244718 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5f2126-0c65-46b2-af5a-ec7c95e19d62 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:24.247660 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c03e61-2a37-4c7d-ad9c-cf74f81495c2 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:24.269568 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cccc0f-a080-4adb-940b-1d4f71cd6eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:24.275878 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cccc0f-a080-4adb-940b-1d4f71cd6eec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:24.276056 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6427d9-9b68-4c91-a036-ac99f66f029c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:24.276151 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cccc0f-a080-4adb-940b-1d4f71cd6eec admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:24.276151 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cccc0f-a080-4adb-940b-1d4f71cd6eec admin admin] PATH_INFO: `/v3/users/4f857d33948548e2aa7e85ec9bc676ba` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:24.276283 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6427d9-9b68-4c91-a036-ac99f66f029c admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:24.276283 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6427d9-9b68-4c91-a036-ac99f66f029c admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:24.276283 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6427d9-9b68-4c91-a036-ac99f66f029c admin admin] PATH_INFO: `/v3/projects/85e44dc133ab459f8feda06a5a52f7a1/users/3a3a1612a0b54a14a2dbbe5236cce3e3/roles/702e5e78b5d744529384b96a390ae92f` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:24.278980 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cccc0f-a080-4adb-940b-1d4f71cd6eec admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f857d33948548e2aa7e85ec9bc676ba)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:24.281238 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cccc0f-a080-4adb-940b-1d4f71cd6eec admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:24.281806 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6427d9-9b68-4c91-a036-ac99f66f029c admin admin] RBAC: Authorizing `identity:create_grant(project_id=85e44dc133ab459f8feda06a5a52f7a1, user_id=3a3a1612a0b54a14a2dbbe5236cce3e3, role_id=702e5e78b5d744529384b96a390ae92f)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:24.300777 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6427d9-9b68-4c91-a036-ac99f66f029c admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:24.325218 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 846/1684] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:43:24 2022] PUT /identity/v3/projects/85e44dc133ab459f8feda06a5a52f7a1/users/3a3a1612a0b54a14a2dbbe5236cce3e3/roles/702e5e78b5d744529384b96a390ae92f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:43:24.336254 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc6812-5922-4f77-b367-6263cc3a49b6 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:24.336552 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc6812-5922-4f77-b367-6263cc3a49b6 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:24.336837 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc6812-5922-4f77-b367-6263cc3a49b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:24.405700 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-bcdc6812-5922-4f77-b367-6263cc3a49b6 None None] MFA Rules not processed for user `3a3a1612a0b54a14a2dbbe5236cce3e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:24.407641 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-bcdc6812-5922-4f77-b367-6263cc3a49b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:24.535769 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e2cccc0f-a080-4adb-940b-1d4f71cd6eec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f857d33948548e2aa7e85ec9bc676ba'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:24.539197 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e2cccc0f-a080-4adb-940b-1d4f71cd6eec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f857d33948548e2aa7e85ec9bc676ba'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:24.580657 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 847/1685] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:43:24 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:43:24.592820 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdc6812-5922-4f77-b367-6263cc3a49b6 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:24.594741 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-bcdc6812-5922-4f77-b367-6263cc3a49b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:24.727501 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e2cccc0f-a080-4adb-940b-1d4f71cd6eec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f857d33948548e2aa7e85ec9bc676ba'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:24.738288 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e2cccc0f-a080-4adb-940b-1d4f71cd6eec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f857d33948548e2aa7e85ec9bc676ba'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:24.773990 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdc6812-5922-4f77-b367-6263cc3a49b6 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:24.790576 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa7e0f3-3166-420e-897a-a6e1788352f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '950b5b5f690d41509ead753065a0b793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:24.790576 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7e0f3-3166-420e-897a-a6e1788352f2 service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:24.791356 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7e0f3-3166-420e-897a-a6e1788352f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:24.791356 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7e0f3-3166-420e-897a-a6e1788352f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:24.796869 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e2cccc0f-a080-4adb-940b-1d4f71cd6eec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f857d33948548e2aa7e85ec9bc676ba'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:24.814944 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 839/1686] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:43:24 2022] DELETE /identity/v3/users/4f857d33948548e2aa7e85ec9bc676ba => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:43:24.825617 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa7e0f3-3166-420e-897a-a6e1788352f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:24.825617 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa7e0f3-3166-420e-897a-a6e1788352f2 service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:24.858728 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 848/1687] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:43:24 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:43:24.989046 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cccc0f-a080-4adb-940b-1d4f71cd6eec admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:24.992148 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e2cccc0f-a080-4adb-940b-1d4f71cd6eec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:25.149424 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cccc0f-a080-4adb-940b-1d4f71cd6eec admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:25.156922 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8635b3-cc19-4563-a307-5c4740a5d165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:25.158341 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8635b3-cc19-4563-a307-5c4740a5d165 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:25.158636 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8635b3-cc19-4563-a307-5c4740a5d165 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:25.158919 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8635b3-cc19-4563-a307-5c4740a5d165 admin admin] PATH_INFO: `/v3/users/42d715e183b944c6a440dd36c3b08887` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:25.160334 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8635b3-cc19-4563-a307-5c4740a5d165 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42d715e183b944c6a440dd36c3b08887)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:25.163012 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8635b3-cc19-4563-a307-5c4740a5d165 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:25.479817 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-eb8635b3-cc19-4563-a307-5c4740a5d165 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42d715e183b944c6a440dd36c3b08887'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:25.480548 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-eb8635b3-cc19-4563-a307-5c4740a5d165 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42d715e183b944c6a440dd36c3b08887'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:25.582944 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-eb8635b3-cc19-4563-a307-5c4740a5d165 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42d715e183b944c6a440dd36c3b08887'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:25.591817 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-eb8635b3-cc19-4563-a307-5c4740a5d165 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42d715e183b944c6a440dd36c3b08887'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:25.606114 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-eb8635b3-cc19-4563-a307-5c4740a5d165 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42d715e183b944c6a440dd36c3b08887'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:25.623967 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 840/1688] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:43:24 2022] DELETE /identity/v3/users/42d715e183b944c6a440dd36c3b08887 => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:43:25.628290 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9621fd40-afd4-4d14-8a2c-36c48af8e8fc None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:25.629207 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9621fd40-afd4-4d14-8a2c-36c48af8e8fc None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:25.629692 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9621fd40-afd4-4d14-8a2c-36c48af8e8fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:25.667319 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-9621fd40-afd4-4d14-8a2c-36c48af8e8fc None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:25.669411 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-9621fd40-afd4-4d14-8a2c-36c48af8e8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:25.779028 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 849/1689] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:43:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:43:25.794798 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8635b3-cc19-4563-a307-5c4740a5d165 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:25.798149 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-eb8635b3-cc19-4563-a307-5c4740a5d165 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:25.956739 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8635b3-cc19-4563-a307-5c4740a5d165 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:25.960988 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa560bd-6a7d-471f-8acc-425a3e00f0ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:25.961989 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa560bd-6a7d-471f-8acc-425a3e00f0ef service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:25.962502 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa560bd-6a7d-471f-8acc-425a3e00f0ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:25.962844 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa560bd-6a7d-471f-8acc-425a3e00f0ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:25.979680 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa560bd-6a7d-471f-8acc-425a3e00f0ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:25.980694 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa560bd-6a7d-471f-8acc-425a3e00f0ef service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:25.996729 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 841/1690] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:43:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:43:26.088697 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc73c8-e535-4850-9e47-4fb896a07e3d None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:26.088993 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc73c8-e535-4850-9e47-4fb896a07e3d None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:26.089278 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc73c8-e535-4850-9e47-4fb896a07e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:26.181809 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-18bc73c8-e535-4850-9e47-4fb896a07e3d None None] MFA Rules not processed for user `975273630f7e4852848335d674693ea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:26.198982 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-18bc73c8-e535-4850-9e47-4fb896a07e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:26.238357 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa560bd-6a7d-471f-8acc-425a3e00f0ef service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:26.239926 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-cfa560bd-6a7d-471f-8acc-425a3e00f0ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:26.272434 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa560bd-6a7d-471f-8acc-425a3e00f0ef service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:26.289893 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14f01af-538f-424c-ab24-bb4dccde32fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:26.291413 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f01af-538f-424c-ab24-bb4dccde32fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:26.307126 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f01af-538f-424c-ab24-bb4dccde32fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:26.307126 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f01af-538f-424c-ab24-bb4dccde32fb admin admin] PATH_INFO: `/v3/projects/a6804a6738174a58834d14917f8ca982` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:26.307126 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14f01af-538f-424c-ab24-bb4dccde32fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6804a6738174a58834d14917f8ca982)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:26.307126 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14f01af-538f-424c-ab24-bb4dccde32fb admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:26.319077 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 850/1691] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:43:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:43:26.330742 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685d4c5-6638-4fab-9557-1fcf7d286a6d None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:26.331262 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685d4c5-6638-4fab-9557-1fcf7d286a6d None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:26.332242 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685d4c5-6638-4fab-9557-1fcf7d286a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:26.362956 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-4685d4c5-6638-4fab-9557-1fcf7d286a6d None None] MFA Rules not processed for user `975273630f7e4852848335d674693ea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:26.365620 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-4685d4c5-6638-4fab-9557-1fcf7d286a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:26.385647 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 851/1692] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:43:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:43:26.397457 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4685d4c5-6638-4fab-9557-1fcf7d286a6d None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:26.399786 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-4685d4c5-6638-4fab-9557-1fcf7d286a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:26.541345 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4685d4c5-6638-4fab-9557-1fcf7d286a6d None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:26.548743 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac1510-f802-4e5a-a325-aa0f35685e46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1be2652c984a4283aeee0b937f0555e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:26.549926 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac1510-f802-4e5a-a325-aa0f35685e46 service nova] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:26.550382 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac1510-f802-4e5a-a325-aa0f35685e46 service nova] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:26.550949 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac1510-f802-4e5a-a325-aa0f35685e46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:26.562437 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eac1510-f802-4e5a-a325-aa0f35685e46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:26.565011 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eac1510-f802-4e5a-a325-aa0f35685e46 service nova] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:26.605036 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 852/1693] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:43:26 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:43:26.643203 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f14f01af-538f-424c-ab24-bb4dccde32fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6804a6738174a58834d14917f8ca982', 'request_id': 'req-f14f01af-538f-424c-ab24-bb4dccde32fb'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:26.652156 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f14f01af-538f-424c-ab24-bb4dccde32fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6804a6738174a58834d14917f8ca982', 'request_id': 'req-f14f01af-538f-424c-ab24-bb4dccde32fb'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:26.767554 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f14f01af-538f-424c-ab24-bb4dccde32fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6804a6738174a58834d14917f8ca982', 'request_id': 'req-f14f01af-538f-424c-ab24-bb4dccde32fb'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:26.782057 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f14f01af-538f-424c-ab24-bb4dccde32fb admin admin] The token cache is being invalidate because project a6804a6738174a58834d14917f8ca982 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:43:26.782681 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f14f01af-538f-424c-ab24-bb4dccde32fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:26.784952 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f14f01af-538f-424c-ab24-bb4dccde32fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:26.787463 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 842/1694] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:43:26 2022] DELETE /identity/v3/projects/a6804a6738174a58834d14917f8ca982 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:43:26.792282 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74594d5-9fd0-466f-909a-c8b2c25c2c5c None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:26.793766 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74594d5-9fd0-466f-909a-c8b2c25c2c5c None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:26.794178 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74594d5-9fd0-466f-909a-c8b2c25c2c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:26.825835 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-e74594d5-9fd0-466f-909a-c8b2c25c2c5c None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:26.827099 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-e74594d5-9fd0-466f-909a-c8b2c25c2c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:26.924922 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 853/1695] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:43:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:26.927357 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e83d7-20fa-47ac-8076-ce6975e40340 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:26.930027 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e83d7-20fa-47ac-8076-ce6975e40340 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:26.930532 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e83d7-20fa-47ac-8076-ce6975e40340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:27.004144 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-7c5e83d7-20fa-47ac-8076-ce6975e40340 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:27.005412 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-7c5e83d7-20fa-47ac-8076-ce6975e40340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:27.029124 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 843/1696] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:43:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:27.033650 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74594d5-9fd0-466f-909a-c8b2c25c2c5c None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:27.045690 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74594d5-9fd0-466f-909a-c8b2c25c2c5c None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:27.063507 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69af4328-3ce7-4348-ad6c-425b89a3eb4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:27.064576 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69af4328-3ce7-4348-ad6c-425b89a3eb4f admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:27.065021 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69af4328-3ce7-4348-ad6c-425b89a3eb4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:27.072733 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69af4328-3ce7-4348-ad6c-425b89a3eb4f admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:27.072733 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69af4328-3ce7-4348-ad6c-425b89a3eb4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:43:27.072733 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69af4328-3ce7-4348-ad6c-425b89a3eb4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:27.072733 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69af4328-3ce7-4348-ad6c-425b89a3eb4f admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:27.111967 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 854/1697] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Apr 11 16:43:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:43:27.119648 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e83d7-20fa-47ac-8076-ce6975e40340 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:27.138596 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e83d7-20fa-47ac-8076-ce6975e40340 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:27.153876 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9cb988-f062-4cba-bb58-c155196d1667 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:27.154293 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9cb988-f062-4cba-bb58-c155196d1667 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:27.154773 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9cb988-f062-4cba-bb58-c155196d1667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:27.156297 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a0220-b70f-4bc0-b503-1acf52523c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:27.157160 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a0220-b70f-4bc0-b503-1acf52523c98 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:27.157589 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a0220-b70f-4bc0-b503-1acf52523c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:27.158168 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a0220-b70f-4bc0-b503-1acf52523c98 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:27.159053 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64a0220-b70f-4bc0-b503-1acf52523c98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:27.161765 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64a0220-b70f-4bc0-b503-1acf52523c98 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:27.224584 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-af9cb988-f062-4cba-bb58-c155196d1667 None None] MFA Rules not processed for user `de39f6406f414bc68ee956c7639dab5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:27.226335 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-af9cb988-f062-4cba-bb58-c155196d1667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:27.268455 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 844/1698] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:43:27 2022] POST /identity/v3/projects => generated 363 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:43:27.274902 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a0220-b70f-4bc0-b503-1acf52523c98 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:27.395383 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 855/1699] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:43:27 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:27.423062 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a0220-b70f-4bc0-b503-1acf52523c98 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:27.442242 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9cb988-f062-4cba-bb58-c155196d1667 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:27.444341 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-af9cb988-f062-4cba-bb58-c155196d1667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:27.446214 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed61755-8fb1-48a0-b78a-f6a281f42652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:27.448308 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed61755-8fb1-48a0-b78a-f6a281f42652 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:27.448612 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed61755-8fb1-48a0-b78a-f6a281f42652 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:27.448900 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed61755-8fb1-48a0-b78a-f6a281f42652 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:27.449629 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed61755-8fb1-48a0-b78a-f6a281f42652 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:27.451718 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed61755-8fb1-48a0-b78a-f6a281f42652 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:27.559252 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 845/1700] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:43:27 2022] POST /identity/v3/users => generated 282 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:43:27.559252 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed61755-8fb1-48a0-b78a-f6a281f42652 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:27.567724 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-5ed61755-8fb1-48a0-b78a-f6a281f42652 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:27.594576 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed61755-8fb1-48a0-b78a-f6a281f42652 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:27.610592 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337304f4-970d-43d2-bbfc-70e7bfaa76e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:27.612704 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337304f4-970d-43d2-bbfc-70e7bfaa76e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:27.614107 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337304f4-970d-43d2-bbfc-70e7bfaa76e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:27.614477 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337304f4-970d-43d2-bbfc-70e7bfaa76e9 admin admin] PATH_INFO: `/v3/projects/6f707a0634a644bab365266403cdae42` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:27.616735 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337304f4-970d-43d2-bbfc-70e7bfaa76e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f707a0634a644bab365266403cdae42)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:27.622642 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337304f4-970d-43d2-bbfc-70e7bfaa76e9 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:27.623884 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9cb988-f062-4cba-bb58-c155196d1667 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:27.750276 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099c690b-0d80-40a9-9562-537f49fbe175 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1be2652c984a4283aeee0b937f0555e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:27.752439 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c690b-0d80-40a9-9562-537f49fbe175 service nova] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:27.755129 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c690b-0d80-40a9-9562-537f49fbe175 service nova] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:27.755423 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c690b-0d80-40a9-9562-537f49fbe175 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:27.819707 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-337304f4-970d-43d2-bbfc-70e7bfaa76e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f707a0634a644bab365266403cdae42', 'request_id': 'req-337304f4-970d-43d2-bbfc-70e7bfaa76e9'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:27.831091 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-337304f4-970d-43d2-bbfc-70e7bfaa76e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f707a0634a644bab365266403cdae42', 'request_id': 'req-337304f4-970d-43d2-bbfc-70e7bfaa76e9'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:27.853148 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099c690b-0d80-40a9-9562-537f49fbe175 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:27.855704 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099c690b-0d80-40a9-9562-537f49fbe175 service nova] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:27.869244 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 856/1701] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:43:27 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:43:27.870659 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099c690b-0d80-40a9-9562-537f49fbe175 service nova] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:27.882220 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099c690b-0d80-40a9-9562-537f49fbe175 service nova] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:27.933460 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-337304f4-970d-43d2-bbfc-70e7bfaa76e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f707a0634a644bab365266403cdae42', 'request_id': 'req-337304f4-970d-43d2-bbfc-70e7bfaa76e9'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:27.958348 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-337304f4-970d-43d2-bbfc-70e7bfaa76e9 admin admin] The token cache is being invalidate because project 6f707a0634a644bab365266403cdae42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:43:27.958450 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-337304f4-970d-43d2-bbfc-70e7bfaa76e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:27.968443 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-337304f4-970d-43d2-bbfc-70e7bfaa76e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:27.971608 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 846/1702] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:43:27 2022] DELETE /identity/v3/projects/6f707a0634a644bab365266403cdae42 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:43:27.975565 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337304f4-970d-43d2-bbfc-70e7bfaa76e9 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:27.976702 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-337304f4-970d-43d2-bbfc-70e7bfaa76e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:27.996889 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493357a8-5f83-4a3b-a6c7-47c1d0e2bad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:27.998656 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493357a8-5f83-4a3b-a6c7-47c1d0e2bad4 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:27.999072 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493357a8-5f83-4a3b-a6c7-47c1d0e2bad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:27.999506 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493357a8-5f83-4a3b-a6c7-47c1d0e2bad4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:28.000428 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493357a8-5f83-4a3b-a6c7-47c1d0e2bad4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:28.002901 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493357a8-5f83-4a3b-a6c7-47c1d0e2bad4 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:28.029651 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 857/1703] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:43:27 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:43:28.044552 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493357a8-5f83-4a3b-a6c7-47c1d0e2bad4 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:28.049920 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-493357a8-5f83-4a3b-a6c7-47c1d0e2bad4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:28.090247 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493357a8-5f83-4a3b-a6c7-47c1d0e2bad4 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:28.100719 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b66e5fe-09ab-48db-bee2-3aa1f8d638c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:28.102390 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66e5fe-09ab-48db-bee2-3aa1f8d638c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:28.103070 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66e5fe-09ab-48db-bee2-3aa1f8d638c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:28.104766 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66e5fe-09ab-48db-bee2-3aa1f8d638c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:28.108325 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b66e5fe-09ab-48db-bee2-3aa1f8d638c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:28.112494 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b66e5fe-09ab-48db-bee2-3aa1f8d638c8 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:28.142663 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 858/1704] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:43:28 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:43:28.145036 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b66e5fe-09ab-48db-bee2-3aa1f8d638c8 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:28.179834 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b66e5fe-09ab-48db-bee2-3aa1f8d638c8 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:28.186764 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc428b3-8976-4198-94c7-f5b1d7ea31a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:28.187983 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc428b3-8976-4198-94c7-f5b1d7ea31a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:28.188485 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc428b3-8976-4198-94c7-f5b1d7ea31a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:28.188899 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc428b3-8976-4198-94c7-f5b1d7ea31a9 admin admin] PATH_INFO: `/v3/projects/009f7e32cda84a8aac19fa63f3f6bcb3/users/1f352deb2dde4cdca55f3e78f4fcffc5/roles/0d41da7bec094450b5bff4e4831be52c` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:28.211791 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337304f4-970d-43d2-bbfc-70e7bfaa76e9 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:28.247547 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc428b3-8976-4198-94c7-f5b1d7ea31a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=009f7e32cda84a8aac19fa63f3f6bcb3, user_id=1f352deb2dde4cdca55f3e78f4fcffc5, role_id=0d41da7bec094450b5bff4e4831be52c)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:28.253898 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc428b3-8976-4198-94c7-f5b1d7ea31a9 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:28.268452 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0350489-1cae-4a8a-b668-6f819ccb5dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:28.269397 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0350489-1cae-4a8a-b668-6f819ccb5dbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:28.269681 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0350489-1cae-4a8a-b668-6f819ccb5dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:28.269955 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0350489-1cae-4a8a-b668-6f819ccb5dbe admin admin] PATH_INFO: `/v3/users/3a3a1612a0b54a14a2dbbe5236cce3e3` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:28.276608 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0350489-1cae-4a8a-b668-6f819ccb5dbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a3a1612a0b54a14a2dbbe5236cce3e3)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:28.294302 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0350489-1cae-4a8a-b668-6f819ccb5dbe admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:28.391696 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 859/1705] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:43:28 2022] PUT /identity/v3/projects/009f7e32cda84a8aac19fa63f3f6bcb3/users/1f352deb2dde4cdca55f3e78f4fcffc5/roles/0d41da7bec094450b5bff4e4831be52c => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:43:28.397355 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc782f-cd62-4195-a7a6-d06cd01c6780 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:28.397355 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc782f-cd62-4195-a7a6-d06cd01c6780 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:28.397355 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc782f-cd62-4195-a7a6-d06cd01c6780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:28.516942 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-f6dc782f-cd62-4195-a7a6-d06cd01c6780 None None] MFA Rules not processed for user `975273630f7e4852848335d674693ea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:28.523914 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-f6dc782f-cd62-4195-a7a6-d06cd01c6780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:28.605667 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c0350489-1cae-4a8a-b668-6f819ccb5dbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a3a1612a0b54a14a2dbbe5236cce3e3'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:28.606852 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c0350489-1cae-4a8a-b668-6f819ccb5dbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a3a1612a0b54a14a2dbbe5236cce3e3'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:28.654817 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 860/1706] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:43:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:28.656795 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b7d82-d066-4b28-aea5-9837d8d098d6 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:28.656986 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b7d82-d066-4b28-aea5-9837d8d098d6 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:28.657270 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b7d82-d066-4b28-aea5-9837d8d098d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:28.686020 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c0350489-1cae-4a8a-b668-6f819ccb5dbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a3a1612a0b54a14a2dbbe5236cce3e3'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:28.723685 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-831b7d82-d066-4b28-aea5-9837d8d098d6 None None] MFA Rules not processed for user `1f352deb2dde4cdca55f3e78f4fcffc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:28.728103 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-831b7d82-d066-4b28-aea5-9837d8d098d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:28.731854 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c0350489-1cae-4a8a-b668-6f819ccb5dbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a3a1612a0b54a14a2dbbe5236cce3e3'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:28.797022 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c0350489-1cae-4a8a-b668-6f819ccb5dbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a3a1612a0b54a14a2dbbe5236cce3e3'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:28.836426 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 847/1707] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:43:27 2022] DELETE /identity/v3/users/3a3a1612a0b54a14a2dbbe5236cce3e3 => generated 0 bytes in 861 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:43:29.058501 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 861/1708] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:43:28 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 403 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:29.063423 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0350489-1cae-4a8a-b668-6f819ccb5dbe admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:29.066090 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-c0350489-1cae-4a8a-b668-6f819ccb5dbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:29.354391 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0350489-1cae-4a8a-b668-6f819ccb5dbe admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:29.370035 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe60fb-fa76-47c6-9605-b55dcb303df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:29.373062 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe60fb-fa76-47c6-9605-b55dcb303df4 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:29.379059 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe60fb-fa76-47c6-9605-b55dcb303df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:29.379059 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe60fb-fa76-47c6-9605-b55dcb303df4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:29.379059 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fe60fb-fa76-47c6-9605-b55dcb303df4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:29.382371 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fe60fb-fa76-47c6-9605-b55dcb303df4 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:29.453630 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c55d9-58b6-47e9-92aa-87c7283b4635 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:29.454160 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c55d9-58b6-47e9-92aa-87c7283b4635 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:29.454578 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c55d9-58b6-47e9-92aa-87c7283b4635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:29.484488 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-2b3c55d9-58b6-47e9-92aa-87c7283b4635 None None] MFA Rules not processed for user `3252c48fdd5747a29fe4ba89e7162216`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:29.486092 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-2b3c55d9-58b6-47e9-92aa-87c7283b4635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:29.547406 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 848/1709] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:43:29 2022] POST /identity/v3/projects => generated 365 bytes in 485 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:43:29.551165 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe60fb-fa76-47c6-9605-b55dcb303df4 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:29.584371 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 862/1710] 10.222.0.43 () {58 vars in 1009 bytes} [Mon Apr 11 16:43:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:43:29.668418 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe60fb-fa76-47c6-9605-b55dcb303df4 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:29.674073 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79b23d0-82b4-4983-986f-7de86e32d735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:29.675609 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b23d0-82b4-4983-986f-7de86e32d735 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:29.675609 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b23d0-82b4-4983-986f-7de86e32d735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:29.675779 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b23d0-82b4-4983-986f-7de86e32d735 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:29.677222 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79b23d0-82b4-4983-986f-7de86e32d735 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:29.679188 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79b23d0-82b4-4983-986f-7de86e32d735 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:29.887290 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 849/1711] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:43:29 2022] POST /identity/v3/users => generated 289 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:43:29.891411 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3c55d9-58b6-47e9-92aa-87c7283b4635 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:29.922510 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3c55d9-58b6-47e9-92aa-87c7283b4635 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:29.949210 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd696f4-9e0d-401d-adb7-e32aa296632e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:29.951098 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd696f4-9e0d-401d-adb7-e32aa296632e admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:29.951669 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd696f4-9e0d-401d-adb7-e32aa296632e admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:29.952001 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd696f4-9e0d-401d-adb7-e32aa296632e admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:29.952820 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd696f4-9e0d-401d-adb7-e32aa296632e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:29.963712 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd696f4-9e0d-401d-adb7-e32aa296632e admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:29.973818 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65693146-e180-4a3d-a20f-97a85ed2d099 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:29.974118 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65693146-e180-4a3d-a20f-97a85ed2d099 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:29.974407 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65693146-e180-4a3d-a20f-97a85ed2d099 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:29.977468 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 850/1712] 10.222.0.43 () {54 vars in 912 bytes} [Mon Apr 11 16:43:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:43:29.983915 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4217e3c-9f97-432b-be8f-cb19f514f4ba None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:29.984498 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4217e3c-9f97-432b-be8f-cb19f514f4ba None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:29.984959 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4217e3c-9f97-432b-be8f-cb19f514f4ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:29.988375 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 863/1713] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:43:29 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:43:29.996973 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd696f4-9e0d-401d-adb7-e32aa296632e admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:30.035269 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd696f4-9e0d-401d-adb7-e32aa296632e admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:30.041175 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af38644-3634-4964-a147-58be81714f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:30.042295 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af38644-3634-4964-a147-58be81714f19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:30.042724 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af38644-3634-4964-a147-58be81714f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:30.043140 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af38644-3634-4964-a147-58be81714f19 admin admin] PATH_INFO: `/v3/projects/716f89e307d5424d9c8da74ca6a588c5/users/5c063f45295c430084c2e81c337d0b9c/roles/702e5e78b5d744529384b96a390ae92f` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:30.076252 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-b4217e3c-9f97-432b-be8f-cb19f514f4ba None None] MFA Rules not processed for user `f8c213711e794a1ba47ecf46ecb57769`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:30.080387 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b4217e3c-9f97-432b-be8f-cb19f514f4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:30.114258 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af38644-3634-4964-a147-58be81714f19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=716f89e307d5424d9c8da74ca6a588c5, user_id=5c063f45295c430084c2e81c337d0b9c, role_id=702e5e78b5d744529384b96a390ae92f)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:30.118032 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af38644-3634-4964-a147-58be81714f19 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:30.237811 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 864/1714] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:43:29 2022] PUT /identity/v3/projects/716f89e307d5424d9c8da74ca6a588c5/users/5c063f45295c430084c2e81c337d0b9c/roles/702e5e78b5d744529384b96a390ae92f => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:43:30.241429 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af38644-3634-4964-a147-58be81714f19 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:30.242767 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 851/1715] 10.222.0.43 () {58 vars in 1009 bytes} [Mon Apr 11 16:43:29 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:43:30.247944 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4217e3c-9f97-432b-be8f-cb19f514f4ba None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:30.249473 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-7af38644-3634-4964-a147-58be81714f19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:30.279414 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4217e3c-9f97-432b-be8f-cb19f514f4ba None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:30.399481 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af38644-3634-4964-a147-58be81714f19 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:30.415130 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc674076-4f36-4a06-ab68-2d083e46ae96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:30.416701 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc674076-4f36-4a06-ab68-2d083e46ae96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:30.417989 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6449b73-0398-4edf-95de-0d0e78c42856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:30.418373 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc674076-4f36-4a06-ab68-2d083e46ae96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:30.419057 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc674076-4f36-4a06-ab68-2d083e46ae96 admin admin] PATH_INFO: `/v3/projects/85e44dc133ab459f8feda06a5a52f7a1` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:30.419730 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6449b73-0398-4edf-95de-0d0e78c42856 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:30.420888 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6449b73-0398-4edf-95de-0d0e78c42856 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:30.421318 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6449b73-0398-4edf-95de-0d0e78c42856 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:30.422895 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc674076-4f36-4a06-ab68-2d083e46ae96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85e44dc133ab459f8feda06a5a52f7a1)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:30.423360 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6449b73-0398-4edf-95de-0d0e78c42856 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:30.424569 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: WARNING py.warnings [None req-cc674076-4f36-4a06-ab68-2d083e46ae96 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 11 16:43:30.424569 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: warnings.warn(msg) Apr 11 16:43:30.424569 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: Apr 11 16:43:30.428796 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6449b73-0398-4edf-95de-0d0e78c42856 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:30.429922 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc674076-4f36-4a06-ab68-2d083e46ae96 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:30.454037 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 852/1716] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:43:30 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:43:30.454037 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6449b73-0398-4edf-95de-0d0e78c42856 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:30.464551 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a6449b73-0398-4edf-95de-0d0e78c42856 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:30.609743 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6449b73-0398-4edf-95de-0d0e78c42856 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:30.628008 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb48e89-f605-478b-834c-bfe016151d4a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb193a1a7abd430fbbcccab970e4f37c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:30.629010 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb48e89-f605-478b-834c-bfe016151d4a service swift] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:30.629416 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb48e89-f605-478b-834c-bfe016151d4a service swift] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:30.633260 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb48e89-f605-478b-834c-bfe016151d4a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:30.695622 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-cc674076-4f36-4a06-ab68-2d083e46ae96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85e44dc133ab459f8feda06a5a52f7a1', 'request_id': 'req-cc674076-4f36-4a06-ab68-2d083e46ae96'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:30.739336 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb48e89-f605-478b-834c-bfe016151d4a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:30.741080 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb48e89-f605-478b-834c-bfe016151d4a service swift] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:30.752282 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 853/1717] 10.222.0.43 () {60 vars in 1384 bytes} [Mon Apr 11 16:43:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 11 16:43:30.753207 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb48e89-f605-478b-834c-bfe016151d4a service swift] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:30.754830 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-1cb48e89-f605-478b-834c-bfe016151d4a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:30.825240 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-cc674076-4f36-4a06-ab68-2d083e46ae96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85e44dc133ab459f8feda06a5a52f7a1', 'request_id': 'req-cc674076-4f36-4a06-ab68-2d083e46ae96'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:30.835976 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-cc674076-4f36-4a06-ab68-2d083e46ae96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85e44dc133ab459f8feda06a5a52f7a1', 'request_id': 'req-cc674076-4f36-4a06-ab68-2d083e46ae96'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:30.848130 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb48e89-f605-478b-834c-bfe016151d4a service swift] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:30.885890 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-cc674076-4f36-4a06-ab68-2d083e46ae96 admin admin] The token cache is being invalidate because project 85e44dc133ab459f8feda06a5a52f7a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:43:30.886295 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-cc674076-4f36-4a06-ab68-2d083e46ae96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:30.889034 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-cc674076-4f36-4a06-ab68-2d083e46ae96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:30.909720 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 865/1718] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:43:30 2022] DELETE /identity/v3/projects/85e44dc133ab459f8feda06a5a52f7a1 => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:43:30.911148 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc674076-4f36-4a06-ab68-2d083e46ae96 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:30.913765 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-cc674076-4f36-4a06-ab68-2d083e46ae96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:30.950617 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f85ca8d-489c-4a1e-835f-ea70ee36dfd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:30.951371 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85ca8d-489c-4a1e-835f-ea70ee36dfd2 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:30.951716 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85ca8d-489c-4a1e-835f-ea70ee36dfd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:30.954176 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85ca8d-489c-4a1e-835f-ea70ee36dfd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:30.958200 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-3f85ca8d-489c-4a1e-835f-ea70ee36dfd2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:30.979853 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f85ca8d-489c-4a1e-835f-ea70ee36dfd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:30.982796 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f85ca8d-489c-4a1e-835f-ea70ee36dfd2 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:31.010408 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 854/1719] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:43:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:43:31.012446 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eb718b-d4b4-4acd-9e4e-8bc79204b947 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:31.012446 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eb718b-d4b4-4acd-9e4e-8bc79204b947 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:31.012647 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eb718b-d4b4-4acd-9e4e-8bc79204b947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:31.111426 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-88eb718b-d4b4-4acd-9e4e-8bc79204b947 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:31.122586 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-88eb718b-d4b4-4acd-9e4e-8bc79204b947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:31.141372 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 855/1720] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:43:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:31.152044 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44dca47-2ad6-46c8-bf8b-de16acb18f8d None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:31.153422 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44dca47-2ad6-46c8-bf8b-de16acb18f8d None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:31.153855 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44dca47-2ad6-46c8-bf8b-de16acb18f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:31.167172 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc674076-4f36-4a06-ab68-2d083e46ae96 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:31.183770 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e6c03d-9944-4211-8dbb-d757598bc6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:31.184713 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6c03d-9944-4211-8dbb-d757598bc6db admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:31.184995 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6c03d-9944-4211-8dbb-d757598bc6db admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:31.185270 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6c03d-9944-4211-8dbb-d757598bc6db admin admin] PATH_INFO: `/v3/projects/716f89e307d5424d9c8da74ca6a588c5/users/5c063f45295c430084c2e81c337d0b9c/roles/702e5e78b5d744529384b96a390ae92f` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:31.190408 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e6c03d-9944-4211-8dbb-d757598bc6db admin admin] RBAC: Authorizing `identity:create_grant(project_id=716f89e307d5424d9c8da74ca6a588c5, user_id=5c063f45295c430084c2e81c337d0b9c, role_id=702e5e78b5d744529384b96a390ae92f)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:31.193154 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e6c03d-9944-4211-8dbb-d757598bc6db admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:31.214213 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-c44dca47-2ad6-46c8-bf8b-de16acb18f8d None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:31.221181 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-c44dca47-2ad6-46c8-bf8b-de16acb18f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:31.235881 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 866/1721] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:43:30 2022] PUT /identity/v3/projects/716f89e307d5424d9c8da74ca6a588c5/users/5c063f45295c430084c2e81c337d0b9c/roles/702e5e78b5d744529384b96a390ae92f => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:43:31.249342 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ae54a-a165-445c-8a12-3e5ebab5727d None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:31.249738 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ae54a-a165-445c-8a12-3e5ebab5727d None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:31.250113 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ae54a-a165-445c-8a12-3e5ebab5727d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:31.350697 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-c08ae54a-a165-445c-8a12-3e5ebab5727d None None] MFA Rules not processed for user `5c063f45295c430084c2e81c337d0b9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:31.357970 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-c08ae54a-a165-445c-8a12-3e5ebab5727d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:31.436379 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 856/1722] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:43:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:31.440648 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44dca47-2ad6-46c8-bf8b-de16acb18f8d None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:31.459364 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44dca47-2ad6-46c8-bf8b-de16acb18f8d None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:31.478274 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf58cd7-3367-4475-ba40-a90e220a5c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:31.479089 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf58cd7-3367-4475-ba40-a90e220a5c30 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:31.479377 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf58cd7-3367-4475-ba40-a90e220a5c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:31.479688 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf58cd7-3367-4475-ba40-a90e220a5c30 admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:31.482866 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf58cd7-3367-4475-ba40-a90e220a5c30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:43:31.484789 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf58cd7-3367-4475-ba40-a90e220a5c30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:31.488377 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf58cd7-3367-4475-ba40-a90e220a5c30 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:31.510079 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 857/1723] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Apr 11 16:43:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:43:31.529458 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf58cd7-3367-4475-ba40-a90e220a5c30 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:31.550585 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf58cd7-3367-4475-ba40-a90e220a5c30 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:31.569188 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a344c876-963b-4785-b9e6-dfdb1fe87519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:31.569884 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a344c876-963b-4785-b9e6-dfdb1fe87519 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:31.570165 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a344c876-963b-4785-b9e6-dfdb1fe87519 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:31.570454 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a344c876-963b-4785-b9e6-dfdb1fe87519 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:31.571202 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a344c876-963b-4785-b9e6-dfdb1fe87519 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:31.573695 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a344c876-963b-4785-b9e6-dfdb1fe87519 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:31.577498 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 867/1724] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:43:31 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:31.591465 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ae54a-a165-445c-8a12-3e5ebab5727d None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:31.592978 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-c08ae54a-a165-445c-8a12-3e5ebab5727d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:31.726140 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 858/1725] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:43:31 2022] POST /identity/v3/projects => generated 393 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:43:31.728460 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a344c876-963b-4785-b9e6-dfdb1fe87519 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:31.734953 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ae54a-a165-445c-8a12-3e5ebab5727d None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:31.821058 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a344c876-963b-4785-b9e6-dfdb1fe87519 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:31.826796 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e1c9c-98a4-4ae6-aaa6-8685e4906123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:31.827723 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e1c9c-98a4-4ae6-aaa6-8685e4906123 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:31.828456 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e1c9c-98a4-4ae6-aaa6-8685e4906123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:31.828966 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e1c9c-98a4-4ae6-aaa6-8685e4906123 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:31.829779 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991e1c9c-98a4-4ae6-aaa6-8685e4906123 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:31.832048 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991e1c9c-98a4-4ae6-aaa6-8685e4906123 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:31.855384 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba275e4-7286-40b1-b602-eaf4bc5bd1a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '950b5b5f690d41509ead753065a0b793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:31.856417 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba275e4-7286-40b1-b602-eaf4bc5bd1a2 service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:31.856799 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba275e4-7286-40b1-b602-eaf4bc5bd1a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:31.857235 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba275e4-7286-40b1-b602-eaf4bc5bd1a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:31.948916 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 859/1726] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:43:31 2022] POST /identity/v3/users => generated 297 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:43:31.949998 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e1c9c-98a4-4ae6-aaa6-8685e4906123 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:32.000256 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba275e4-7286-40b1-b602-eaf4bc5bd1a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:32.002054 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e1c9c-98a4-4ae6-aaa6-8685e4906123 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:32.005961 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba275e4-7286-40b1-b602-eaf4bc5bd1a2 service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:32.027186 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25df123-ff6a-4c04-bea3-155e91e62b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:32.028753 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25df123-ff6a-4c04-bea3-155e91e62b53 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:32.029149 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25df123-ff6a-4c04-bea3-155e91e62b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:32.030865 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25df123-ff6a-4c04-bea3-155e91e62b53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:32.038494 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 868/1727] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:43:31 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 16:43:32.057736 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25df123-ff6a-4c04-bea3-155e91e62b53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:32.060673 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25df123-ff6a-4c04-bea3-155e91e62b53 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:32.104554 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 860/1728] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:43:31 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:43:32.111869 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba275e4-7286-40b1-b602-eaf4bc5bd1a2 service cinder] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:32.130339 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba275e4-7286-40b1-b602-eaf4bc5bd1a2 service cinder] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:32.147498 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533abe27-588c-4b2e-944d-7bf32941ab4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:32.149889 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533abe27-588c-4b2e-944d-7bf32941ab4f admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:32.150203 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533abe27-588c-4b2e-944d-7bf32941ab4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:32.150899 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533abe27-588c-4b2e-944d-7bf32941ab4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:32.152621 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533abe27-588c-4b2e-944d-7bf32941ab4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:32.156878 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533abe27-588c-4b2e-944d-7bf32941ab4f admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:32.183005 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 869/1729] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:43:32 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:43:32.187430 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25df123-ff6a-4c04-bea3-155e91e62b53 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:32.214553 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25df123-ff6a-4c04-bea3-155e91e62b53 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:32.242804 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d46d08-629e-4bf1-bcd8-f5946cfda8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:32.252579 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d46d08-629e-4bf1-bcd8-f5946cfda8a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:32.252861 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d46d08-629e-4bf1-bcd8-f5946cfda8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:32.253143 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d46d08-629e-4bf1-bcd8-f5946cfda8a3 admin admin] PATH_INFO: `/v3/projects/6f5b08e3e1954623b1439ed641bdda5d/users/e6efd863b2a54892987fdbac7127156b/roles/0d41da7bec094450b5bff4e4831be52c` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:32.288466 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d46d08-629e-4bf1-bcd8-f5946cfda8a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f5b08e3e1954623b1439ed641bdda5d, user_id=e6efd863b2a54892987fdbac7127156b, role_id=0d41da7bec094450b5bff4e4831be52c)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:32.296549 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d46d08-629e-4bf1-bcd8-f5946cfda8a3 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:32.399042 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533abe27-588c-4b2e-944d-7bf32941ab4f admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:32.430199 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533abe27-588c-4b2e-944d-7bf32941ab4f admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:32.435153 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b640fdc9-2d84-43dd-84aa-9d42fa8ff207 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '950b5b5f690d41509ead753065a0b793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:32.436550 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b640fdc9-2d84-43dd-84aa-9d42fa8ff207 service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:32.436958 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b640fdc9-2d84-43dd-84aa-9d42fa8ff207 service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:32.443308 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b640fdc9-2d84-43dd-84aa-9d42fa8ff207 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:32.450211 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 861/1730] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:43:32 2022] PUT /identity/v3/projects/6f5b08e3e1954623b1439ed641bdda5d/users/e6efd863b2a54892987fdbac7127156b/roles/0d41da7bec094450b5bff4e4831be52c => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:43:32.451363 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-b640fdc9-2d84-43dd-84aa-9d42fa8ff207 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:32.462181 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8452378-c895-4506-8f5a-5fa4a1319b23 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:32.463241 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8452378-c895-4506-8f5a-5fa4a1319b23 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:32.464208 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8452378-c895-4506-8f5a-5fa4a1319b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:32.602399 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-c8452378-c895-4506-8f5a-5fa4a1319b23 None None] MFA Rules not processed for user `e6efd863b2a54892987fdbac7127156b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:32.605687 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-c8452378-c895-4506-8f5a-5fa4a1319b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:32.760108 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b640fdc9-2d84-43dd-84aa-9d42fa8ff207 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:32.760108 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b640fdc9-2d84-43dd-84aa-9d42fa8ff207 service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:32.760108 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 870/1731] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:43:32 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:43:32.761487 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 862/1732] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:43:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:43:32.762194 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b640fdc9-2d84-43dd-84aa-9d42fa8ff207 service cinder] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:32.767884 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b640fdc9-2d84-43dd-84aa-9d42fa8ff207 service cinder] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:32.854666 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f6ba0b-882f-4747-8460-c8a0bdfd3cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:32.855349 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f6ba0b-882f-4747-8460-c8a0bdfd3cd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:32.855697 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f6ba0b-882f-4747-8460-c8a0bdfd3cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:32.855960 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f6ba0b-882f-4747-8460-c8a0bdfd3cd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:32.856661 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f6ba0b-882f-4747-8460-c8a0bdfd3cd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:32.858586 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f6ba0b-882f-4747-8460-c8a0bdfd3cd8 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:33.158782 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 871/1733] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:43:32 2022] POST /identity/v3/projects => generated 391 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:43:33.160167 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8452378-c895-4506-8f5a-5fa4a1319b23 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:33.178015 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8452378-c895-4506-8f5a-5fa4a1319b23 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:33.370837 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d7cb7-6c16-4030-a86a-8a389aec740e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:33.373209 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d7cb7-6c16-4030-a86a-8a389aec740e admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:33.373687 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d7cb7-6c16-4030-a86a-8a389aec740e admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:33.373965 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d7cb7-6c16-4030-a86a-8a389aec740e admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:33.374935 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20d7cb7-6c16-4030-a86a-8a389aec740e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:33.379438 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20d7cb7-6c16-4030-a86a-8a389aec740e admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:33.496140 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 863/1734] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:43:33 2022] POST /identity/v3/users => generated 302 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:43:33.500900 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f6ba0b-882f-4747-8460-c8a0bdfd3cd8 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:33.515301 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f6ba0b-882f-4747-8460-c8a0bdfd3cd8 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:33.533874 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433a985c-f27c-4fd5-94f7-9848ae367b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:33.534575 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a985c-f27c-4fd5-94f7-9848ae367b3d admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:33.534860 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a985c-f27c-4fd5-94f7-9848ae367b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:33.535138 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a985c-f27c-4fd5-94f7-9848ae367b3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:33.535925 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433a985c-f27c-4fd5-94f7-9848ae367b3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:33.544088 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433a985c-f27c-4fd5-94f7-9848ae367b3d admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:33.572633 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d7cb7-6c16-4030-a86a-8a389aec740e admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:33.573338 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 872/1735] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:43:33 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:43:33.589393 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d7cb7-6c16-4030-a86a-8a389aec740e admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:33.608292 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dc9fa9-ce6b-4ff8-9072-cee12ffcc1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:33.609101 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc9fa9-ce6b-4ff8-9072-cee12ffcc1db admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:33.609548 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc9fa9-ce6b-4ff8-9072-cee12ffcc1db admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:33.614967 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc9fa9-ce6b-4ff8-9072-cee12ffcc1db admin admin] PATH_INFO: `/v3/projects/8dced273d1d2416683e6fa8bd40bd66a/users/9cd09aaaeadd4594b7079c1f7af0c474/roles/702e5e78b5d744529384b96a390ae92f` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:33.672666 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dc9fa9-ce6b-4ff8-9072-cee12ffcc1db admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dced273d1d2416683e6fa8bd40bd66a, user_id=9cd09aaaeadd4594b7079c1f7af0c474, role_id=702e5e78b5d744529384b96a390ae92f)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:33.675429 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dc9fa9-ce6b-4ff8-9072-cee12ffcc1db admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:33.732936 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac508dbd-3663-4e97-84d5-d31ac793c82a None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:33.733965 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac508dbd-3663-4e97-84d5-d31ac793c82a None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:33.740601 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac508dbd-3663-4e97-84d5-d31ac793c82a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:33.778299 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 864/1736] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:43:33 2022] PUT /identity/v3/projects/8dced273d1d2416683e6fa8bd40bd66a/users/9cd09aaaeadd4594b7079c1f7af0c474/roles/702e5e78b5d744529384b96a390ae92f => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:43:33.782469 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dc9fa9-ce6b-4ff8-9072-cee12ffcc1db admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:33.817028 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-ac508dbd-3663-4e97-84d5-d31ac793c82a None None] MFA Rules not processed for user `f8c213711e794a1ba47ecf46ecb57769`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:33.821916 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-ac508dbd-3663-4e97-84d5-d31ac793c82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:33.921779 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dc9fa9-ce6b-4ff8-9072-cee12ffcc1db admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:33.931907 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e90e1-9f11-4cab-a957-52a4eaded1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:33.932618 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e90e1-9f11-4cab-a957-52a4eaded1d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:33.933634 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e90e1-9f11-4cab-a957-52a4eaded1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:33.934373 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e90e1-9f11-4cab-a957-52a4eaded1d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:33.936480 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03e90e1-9f11-4cab-a957-52a4eaded1d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:33.940890 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03e90e1-9f11-4cab-a957-52a4eaded1d0 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:33.949367 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 873/1737] 10.222.0.60 () {58 vars in 1015 bytes} [Mon Apr 11 16:43:33 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:33.965016 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 865/1738] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:43:33 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 16:43:33.980721 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac508dbd-3663-4e97-84d5-d31ac793c82a None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:34.009630 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e90e1-9f11-4cab-a957-52a4eaded1d0 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:34.011572 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a03e90e1-9f11-4cab-a957-52a4eaded1d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:34.015052 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac508dbd-3663-4e97-84d5-d31ac793c82a None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:34.027964 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232f4673-f5b1-4548-ba39-f5a0318823b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:34.028894 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f4673-f5b1-4548-ba39-f5a0318823b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:34.029174 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f4673-f5b1-4548-ba39-f5a0318823b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:34.029458 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f4673-f5b1-4548-ba39-f5a0318823b8 admin admin] PATH_INFO: `/v3/projects/8dced273d1d2416683e6fa8bd40bd66a/users/9cd09aaaeadd4594b7079c1f7af0c474/roles/702e5e78b5d744529384b96a390ae92f` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:34.031745 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e90e1-9f11-4cab-a957-52a4eaded1d0 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:34.037696 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232f4673-f5b1-4548-ba39-f5a0318823b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dced273d1d2416683e6fa8bd40bd66a, user_id=9cd09aaaeadd4594b7079c1f7af0c474, role_id=702e5e78b5d744529384b96a390ae92f)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:34.037696 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232f4673-f5b1-4548-ba39-f5a0318823b8 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:34.037949 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8495a5-3829-42c6-9be4-562deff87c67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:34.039775 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8495a5-3829-42c6-9be4-562deff87c67 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:34.040166 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8495a5-3829-42c6-9be4-562deff87c67 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:34.040541 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8495a5-3829-42c6-9be4-562deff87c67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:34.077619 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8495a5-3829-42c6-9be4-562deff87c67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:34.078043 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 874/1739] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:43:33 2022] PUT /identity/v3/projects/8dced273d1d2416683e6fa8bd40bd66a/users/9cd09aaaeadd4594b7079c1f7af0c474/roles/702e5e78b5d744529384b96a390ae92f => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:43:34.090242 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f877c7ef-383e-4df0-b257-195945aeaa96 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:34.093912 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f877c7ef-383e-4df0-b257-195945aeaa96 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:34.093912 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f877c7ef-383e-4df0-b257-195945aeaa96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:34.094112 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8495a5-3829-42c6-9be4-562deff87c67 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:34.105031 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 866/1740] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:43:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 16:43:34.131617 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-f877c7ef-383e-4df0-b257-195945aeaa96 None None] MFA Rules not processed for user `9cd09aaaeadd4594b7079c1f7af0c474`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:34.133219 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-f877c7ef-383e-4df0-b257-195945aeaa96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:34.292682 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 875/1741] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:43:34 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:34.356020 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8495a5-3829-42c6-9be4-562deff87c67 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:34.436891 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8495a5-3829-42c6-9be4-562deff87c67 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:34.453710 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c46331-669b-4b69-bcbb-b1d7f38890db None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:34.454248 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c46331-669b-4b69-bcbb-b1d7f38890db None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:34.454697 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c46331-669b-4b69-bcbb-b1d7f38890db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:34.486895 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-e6c46331-669b-4b69-bcbb-b1d7f38890db None None] MFA Rules not processed for user `de39f6406f414bc68ee956c7639dab5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:34.488421 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-e6c46331-669b-4b69-bcbb-b1d7f38890db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:34.563578 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a45800-3647-4355-b027-248b1ee56f28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '950b5b5f690d41509ead753065a0b793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:34.564341 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a45800-3647-4355-b027-248b1ee56f28 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:34.564693 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a45800-3647-4355-b027-248b1ee56f28 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:34.565047 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a45800-3647-4355-b027-248b1ee56f28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:34.584545 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a45800-3647-4355-b027-248b1ee56f28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:34.589750 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a45800-3647-4355-b027-248b1ee56f28 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:34.597142 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 876/1742] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:43:34 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:43:34.610417 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 867/1743] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:43:34 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:43:34.714320 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c46331-669b-4b69-bcbb-b1d7f38890db None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:34.725626 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c46331-669b-4b69-bcbb-b1d7f38890db None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:34.730136 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9dd2e4-ab55-4e94-8fdd-ac3ec8da09a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '950b5b5f690d41509ead753065a0b793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:34.731073 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9dd2e4-ab55-4e94-8fdd-ac3ec8da09a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:34.731654 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9dd2e4-ab55-4e94-8fdd-ac3ec8da09a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:34.732233 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9dd2e4-ab55-4e94-8fdd-ac3ec8da09a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:34.853440 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9dd2e4-ab55-4e94-8fdd-ac3ec8da09a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:34.855450 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9dd2e4-ab55-4e94-8fdd-ac3ec8da09a8 service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:34.867505 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 877/1744] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:43:34 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:43:35.753792 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd4408-6475-4946-a40f-0619df5de35a None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:35.754394 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd4408-6475-4946-a40f-0619df5de35a None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:35.754596 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd4408-6475-4946-a40f-0619df5de35a None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:35.757224 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 868/1745] 10.222.0.43 () {54 vars in 921 bytes} [Mon Apr 11 16:43:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:43:35.801147 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78759f8-9b82-4929-985b-2fe23d2ed595 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:35.801578 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78759f8-9b82-4929-985b-2fe23d2ed595 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:35.804372 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78759f8-9b82-4929-985b-2fe23d2ed595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:35.893905 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-a78759f8-9b82-4929-985b-2fe23d2ed595 None None] MFA Rules not processed for user `1be2652c984a4283aeee0b937f0555e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:35.895168 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-a78759f8-9b82-4929-985b-2fe23d2ed595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:36.084057 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 878/1746] 10.222.0.43 () {58 vars in 1018 bytes} [Mon Apr 11 16:43:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:36.090306 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabd4408-6475-4946-a40f-0619df5de35a None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:36.092572 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-cabd4408-6475-4946-a40f-0619df5de35a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:36.110794 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabd4408-6475-4946-a40f-0619df5de35a None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:36.117265 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc9c57d-3b10-467a-94c8-4656ff9f89f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1be2652c984a4283aeee0b937f0555e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:36.118114 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9c57d-3b10-467a-94c8-4656ff9f89f5 service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:36.124310 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9c57d-3b10-467a-94c8-4656ff9f89f5 service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:36.124310 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9c57d-3b10-467a-94c8-4656ff9f89f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:36.129428 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc9c57d-3b10-467a-94c8-4656ff9f89f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:36.131929 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc9c57d-3b10-467a-94c8-4656ff9f89f5 service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:36.142279 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 869/1747] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:43:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:43:39.743275 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78759f8-9b82-4929-985b-2fe23d2ed595 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:39.852461 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78759f8-9b82-4929-985b-2fe23d2ed595 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:39.859225 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626f9b52-54c8-4444-a654-90cd883d60ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:39.860818 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f9b52-54c8-4444-a654-90cd883d60ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:39.861145 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f9b52-54c8-4444-a654-90cd883d60ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:39.861438 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f9b52-54c8-4444-a654-90cd883d60ff admin admin] PATH_INFO: `/v3/users/1f352deb2dde4cdca55f3e78f4fcffc5` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:39.864084 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626f9b52-54c8-4444-a654-90cd883d60ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f352deb2dde4cdca55f3e78f4fcffc5)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:39.867713 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626f9b52-54c8-4444-a654-90cd883d60ff admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:40.215609 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-626f9b52-54c8-4444-a654-90cd883d60ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f352deb2dde4cdca55f3e78f4fcffc5'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:40.304970 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-626f9b52-54c8-4444-a654-90cd883d60ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f352deb2dde4cdca55f3e78f4fcffc5'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:40.331715 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-626f9b52-54c8-4444-a654-90cd883d60ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f352deb2dde4cdca55f3e78f4fcffc5'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:40.333971 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-626f9b52-54c8-4444-a654-90cd883d60ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f352deb2dde4cdca55f3e78f4fcffc5'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:40.353697 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-626f9b52-54c8-4444-a654-90cd883d60ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f352deb2dde4cdca55f3e78f4fcffc5'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:40.366932 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 879/1748] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:43:39 2022] DELETE /identity/v3/users/1f352deb2dde4cdca55f3e78f4fcffc5 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:43:40.368820 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a415645-bf26-4eff-8e09-234dd9ac6f59 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:40.369313 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a415645-bf26-4eff-8e09-234dd9ac6f59 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:40.369504 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a415645-bf26-4eff-8e09-234dd9ac6f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:40.393860 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-9a415645-bf26-4eff-8e09-234dd9ac6f59 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:40.396816 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-9a415645-bf26-4eff-8e09-234dd9ac6f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:40.536316 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 870/1749] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:43:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:40.547336 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626f9b52-54c8-4444-a654-90cd883d60ff admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:40.553451 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-626f9b52-54c8-4444-a654-90cd883d60ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:40.637763 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626f9b52-54c8-4444-a654-90cd883d60ff admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:40.641857 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a2d51b-fdc8-47a7-bb78-6ac10072f41e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:40.642517 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a2d51b-fdc8-47a7-bb78-6ac10072f41e service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:40.642807 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a2d51b-fdc8-47a7-bb78-6ac10072f41e service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:40.643134 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a2d51b-fdc8-47a7-bb78-6ac10072f41e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:40.671849 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a2d51b-fdc8-47a7-bb78-6ac10072f41e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:40.671849 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a2d51b-fdc8-47a7-bb78-6ac10072f41e service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:40.690297 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 880/1750] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:43:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:43:41.207613 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a415645-bf26-4eff-8e09-234dd9ac6f59 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:41.209291 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-9a415645-bf26-4eff-8e09-234dd9ac6f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:41.236473 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a415645-bf26-4eff-8e09-234dd9ac6f59 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:41.253963 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433546a7-1048-4167-b7a4-bde14267257b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:41.256507 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433546a7-1048-4167-b7a4-bde14267257b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:41.259011 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433546a7-1048-4167-b7a4-bde14267257b admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:41.259011 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433546a7-1048-4167-b7a4-bde14267257b admin admin] PATH_INFO: `/v3/users/5faca05f433a4397a1176d35f2528b1b` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:41.259011 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433546a7-1048-4167-b7a4-bde14267257b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5faca05f433a4397a1176d35f2528b1b)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:41.261613 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433546a7-1048-4167-b7a4-bde14267257b admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:41.351337 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a2d51b-fdc8-47a7-bb78-6ac10072f41e service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:41.354139 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-55a2d51b-fdc8-47a7-bb78-6ac10072f41e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:41.371850 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a2d51b-fdc8-47a7-bb78-6ac10072f41e service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:41.378372 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79cf810-8a04-4a0e-96d4-985cfb531dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:41.380070 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79cf810-8a04-4a0e-96d4-985cfb531dc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:41.381832 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79cf810-8a04-4a0e-96d4-985cfb531dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:41.382303 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79cf810-8a04-4a0e-96d4-985cfb531dc4 admin admin] PATH_INFO: `/v3/projects/009f7e32cda84a8aac19fa63f3f6bcb3` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:41.384736 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79cf810-8a04-4a0e-96d4-985cfb531dc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=009f7e32cda84a8aac19fa63f3f6bcb3)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:41.387284 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79cf810-8a04-4a0e-96d4-985cfb531dc4 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:41.572133 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-433546a7-1048-4167-b7a4-bde14267257b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5faca05f433a4397a1176d35f2528b1b'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:41.572743 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-433546a7-1048-4167-b7a4-bde14267257b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5faca05f433a4397a1176d35f2528b1b'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:41.625149 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a79cf810-8a04-4a0e-96d4-985cfb531dc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '009f7e32cda84a8aac19fa63f3f6bcb3', 'request_id': 'req-a79cf810-8a04-4a0e-96d4-985cfb531dc4'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:41.663492 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-433546a7-1048-4167-b7a4-bde14267257b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5faca05f433a4397a1176d35f2528b1b'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:41.672879 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-433546a7-1048-4167-b7a4-bde14267257b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5faca05f433a4397a1176d35f2528b1b'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:41.705214 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-433546a7-1048-4167-b7a4-bde14267257b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5faca05f433a4397a1176d35f2528b1b'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:41.718180 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 871/1751] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:43:41 2022] DELETE /identity/v3/users/5faca05f433a4397a1176d35f2528b1b => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:43:41.720762 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942e79c-479c-4a42-b61a-d7ce59b25e26 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:41.721501 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942e79c-479c-4a42-b61a-d7ce59b25e26 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:41.721975 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942e79c-479c-4a42-b61a-d7ce59b25e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:41.747776 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-9942e79c-479c-4a42-b61a-d7ce59b25e26 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:41.749557 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-9942e79c-479c-4a42-b61a-d7ce59b25e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:41.767360 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a79cf810-8a04-4a0e-96d4-985cfb531dc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '009f7e32cda84a8aac19fa63f3f6bcb3', 'request_id': 'req-a79cf810-8a04-4a0e-96d4-985cfb531dc4'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:41.777661 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a79cf810-8a04-4a0e-96d4-985cfb531dc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '009f7e32cda84a8aac19fa63f3f6bcb3', 'request_id': 'req-a79cf810-8a04-4a0e-96d4-985cfb531dc4'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:41.803907 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a79cf810-8a04-4a0e-96d4-985cfb531dc4 admin admin] The token cache is being invalidate because project 009f7e32cda84a8aac19fa63f3f6bcb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:43:41.804208 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a79cf810-8a04-4a0e-96d4-985cfb531dc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:41.805208 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a79cf810-8a04-4a0e-96d4-985cfb531dc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:41.809630 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 881/1752] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:43:41 2022] DELETE /identity/v3/projects/009f7e32cda84a8aac19fa63f3f6bcb3 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:43:41.816399 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79cf810-8a04-4a0e-96d4-985cfb531dc4 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:41.816399 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-a79cf810-8a04-4a0e-96d4-985cfb531dc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:41.867589 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 872/1753] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:43:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:41.877483 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9942e79c-479c-4a42-b61a-d7ce59b25e26 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:41.879060 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-9942e79c-479c-4a42-b61a-d7ce59b25e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:41.949808 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79cf810-8a04-4a0e-96d4-985cfb531dc4 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:41.973674 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6e6d46-3a0c-475a-b2b9-6c2761e8b754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:41.974942 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e6d46-3a0c-475a-b2b9-6c2761e8b754 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:41.974942 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e6d46-3a0c-475a-b2b9-6c2761e8b754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:41.976706 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e6d46-3a0c-475a-b2b9-6c2761e8b754 admin admin] PATH_INFO: `/v3/users/5c063f45295c430084c2e81c337d0b9c` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:41.976996 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6e6d46-3a0c-475a-b2b9-6c2761e8b754 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c063f45295c430084c2e81c337d0b9c)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:41.979179 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6e6d46-3a0c-475a-b2b9-6c2761e8b754 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:41.992922 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9942e79c-479c-4a42-b61a-d7ce59b25e26 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:41.997336 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71efc2c-4506-4c0d-aaa0-226ee5d22baf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:41.998115 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71efc2c-4506-4c0d-aaa0-226ee5d22baf service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:41.998598 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71efc2c-4506-4c0d-aaa0-226ee5d22baf service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:41.998945 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71efc2c-4506-4c0d-aaa0-226ee5d22baf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:42.019363 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71efc2c-4506-4c0d-aaa0-226ee5d22baf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:42.022847 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71efc2c-4506-4c0d-aaa0-226ee5d22baf service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:42.042187 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 873/1754] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:43:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 16:43:42.043507 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71efc2c-4506-4c0d-aaa0-226ee5d22baf service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:42.044946 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e71efc2c-4506-4c0d-aaa0-226ee5d22baf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:42.062302 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71efc2c-4506-4c0d-aaa0-226ee5d22baf service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:42.070894 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d58281-855b-4eda-a03d-b390f03e0a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:42.072549 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d58281-855b-4eda-a03d-b390f03e0a67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:42.072982 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d58281-855b-4eda-a03d-b390f03e0a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:42.073449 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d58281-855b-4eda-a03d-b390f03e0a67 admin admin] PATH_INFO: `/v3/users/444003e9036a46b1ab0d76f853341b51` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:42.075807 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d58281-855b-4eda-a03d-b390f03e0a67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=444003e9036a46b1ab0d76f853341b51)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:42.079888 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d58281-855b-4eda-a03d-b390f03e0a67 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:42.299160 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-bd6e6d46-3a0c-475a-b2b9-6c2761e8b754 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c063f45295c430084c2e81c337d0b9c'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:42.413618 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c2d58281-855b-4eda-a03d-b390f03e0a67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '444003e9036a46b1ab0d76f853341b51'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:42.414796 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c2d58281-855b-4eda-a03d-b390f03e0a67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '444003e9036a46b1ab0d76f853341b51'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:42.428544 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-bd6e6d46-3a0c-475a-b2b9-6c2761e8b754 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c063f45295c430084c2e81c337d0b9c'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:42.456312 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-bd6e6d46-3a0c-475a-b2b9-6c2761e8b754 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c063f45295c430084c2e81c337d0b9c'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:42.457416 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-bd6e6d46-3a0c-475a-b2b9-6c2761e8b754 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c063f45295c430084c2e81c337d0b9c'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:42.497964 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-bd6e6d46-3a0c-475a-b2b9-6c2761e8b754 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c063f45295c430084c2e81c337d0b9c'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:42.498939 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c2d58281-855b-4eda-a03d-b390f03e0a67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '444003e9036a46b1ab0d76f853341b51'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:42.509898 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c2d58281-855b-4eda-a03d-b390f03e0a67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '444003e9036a46b1ab0d76f853341b51'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:42.513193 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 882/1755] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:43:41 2022] DELETE /identity/v3/users/5c063f45295c430084c2e81c337d0b9c => generated 0 bytes in 700 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:43:42.528471 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c2d58281-855b-4eda-a03d-b390f03e0a67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '444003e9036a46b1ab0d76f853341b51'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:42.536107 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 874/1756] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:43:42 2022] DELETE /identity/v3/users/444003e9036a46b1ab0d76f853341b51 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:43:42.546732 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3318b90a-c580-4809-9730-b2b5e5157e88 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:42.547426 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3318b90a-c580-4809-9730-b2b5e5157e88 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:42.547883 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3318b90a-c580-4809-9730-b2b5e5157e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:42.569262 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-3318b90a-c580-4809-9730-b2b5e5157e88 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:42.571312 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-3318b90a-c580-4809-9730-b2b5e5157e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:42.710764 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 883/1757] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:43:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:42.724994 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d58281-855b-4eda-a03d-b390f03e0a67 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:42.733742 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-c2d58281-855b-4eda-a03d-b390f03e0a67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:42.739841 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3318b90a-c580-4809-9730-b2b5e5157e88 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:42.743675 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-3318b90a-c580-4809-9730-b2b5e5157e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:42.779653 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d58281-855b-4eda-a03d-b390f03e0a67 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:42.797562 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1328bb3c-2c3e-4d0b-8e37-6aab39cf5899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:42.799183 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1328bb3c-2c3e-4d0b-8e37-6aab39cf5899 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:42.799389 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1328bb3c-2c3e-4d0b-8e37-6aab39cf5899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:42.799777 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1328bb3c-2c3e-4d0b-8e37-6aab39cf5899 admin admin] PATH_INFO: `/v3/projects/b0ae846deca14483a59001ea907dd4ff` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:42.801209 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1328bb3c-2c3e-4d0b-8e37-6aab39cf5899 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0ae846deca14483a59001ea907dd4ff)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:42.813340 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1328bb3c-2c3e-4d0b-8e37-6aab39cf5899 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:42.861998 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3318b90a-c580-4809-9730-b2b5e5157e88 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:42.867686 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5725761f-dc05-45af-8793-3f372b5c7597 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:42.868641 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725761f-dc05-45af-8793-3f372b5c7597 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:42.868831 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725761f-dc05-45af-8793-3f372b5c7597 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:42.869152 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725761f-dc05-45af-8793-3f372b5c7597 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:42.881652 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5725761f-dc05-45af-8793-3f372b5c7597 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:42.883187 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5725761f-dc05-45af-8793-3f372b5c7597 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:42.915434 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 884/1758] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:43:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 16:43:43.048356 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1328bb3c-2c3e-4d0b-8e37-6aab39cf5899 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0ae846deca14483a59001ea907dd4ff', 'request_id': 'req-1328bb3c-2c3e-4d0b-8e37-6aab39cf5899'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:43.056961 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1328bb3c-2c3e-4d0b-8e37-6aab39cf5899 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0ae846deca14483a59001ea907dd4ff', 'request_id': 'req-1328bb3c-2c3e-4d0b-8e37-6aab39cf5899'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:43.168438 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1328bb3c-2c3e-4d0b-8e37-6aab39cf5899 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0ae846deca14483a59001ea907dd4ff', 'request_id': 'req-1328bb3c-2c3e-4d0b-8e37-6aab39cf5899'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:43.182993 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1328bb3c-2c3e-4d0b-8e37-6aab39cf5899 admin admin] The token cache is being invalidate because project b0ae846deca14483a59001ea907dd4ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:43:43.183645 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1328bb3c-2c3e-4d0b-8e37-6aab39cf5899 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:43.183960 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1328bb3c-2c3e-4d0b-8e37-6aab39cf5899 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:43.185556 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 875/1759] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:43:42 2022] DELETE /identity/v3/projects/b0ae846deca14483a59001ea907dd4ff => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:43:43.191892 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc525b00-c9a6-4ca0-86cf-599c54ed73e3 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:43.192188 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc525b00-c9a6-4ca0-86cf-599c54ed73e3 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:43.192601 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc525b00-c9a6-4ca0-86cf-599c54ed73e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:43.219312 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-cc525b00-c9a6-4ca0-86cf-599c54ed73e3 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:43.221271 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-cc525b00-c9a6-4ca0-86cf-599c54ed73e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:43.284406 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1328bb3c-2c3e-4d0b-8e37-6aab39cf5899 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:43.286586 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-1328bb3c-2c3e-4d0b-8e37-6aab39cf5899 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:43.359675 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 885/1760] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:43:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:43.370689 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57887c04-b4a8-42b6-8ac5-6e210724f07e None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:43.371433 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57887c04-b4a8-42b6-8ac5-6e210724f07e None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:43.372090 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57887c04-b4a8-42b6-8ac5-6e210724f07e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:43.413242 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-57887c04-b4a8-42b6-8ac5-6e210724f07e None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:43.416278 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-57887c04-b4a8-42b6-8ac5-6e210724f07e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:43.416683 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1328bb3c-2c3e-4d0b-8e37-6aab39cf5899 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:43.426396 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e149951c-1715-48a5-8d04-65494a884707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:43.428218 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e149951c-1715-48a5-8d04-65494a884707 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:43.428648 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e149951c-1715-48a5-8d04-65494a884707 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:43.429479 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e149951c-1715-48a5-8d04-65494a884707 admin admin] PATH_INFO: `/v3/projects/716f89e307d5424d9c8da74ca6a588c5` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:43.431676 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e149951c-1715-48a5-8d04-65494a884707 admin admin] RBAC: Authorizing `identity:delete_project(project_id=716f89e307d5424d9c8da74ca6a588c5)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:43.433996 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e149951c-1715-48a5-8d04-65494a884707 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:43.484441 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 886/1761] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:43:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:43:43.490775 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57887c04-b4a8-42b6-8ac5-6e210724f07e None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:43.525586 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57887c04-b4a8-42b6-8ac5-6e210724f07e None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:43.535437 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab60f6e2-33d3-4370-912e-4fc155cc5a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:43.537920 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab60f6e2-33d3-4370-912e-4fc155cc5a05 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:43.537920 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab60f6e2-33d3-4370-912e-4fc155cc5a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:43.537920 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab60f6e2-33d3-4370-912e-4fc155cc5a05 admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:43.540935 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab60f6e2-33d3-4370-912e-4fc155cc5a05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:43:43.541673 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab60f6e2-33d3-4370-912e-4fc155cc5a05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:43.546184 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab60f6e2-33d3-4370-912e-4fc155cc5a05 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:43.570448 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e149951c-1715-48a5-8d04-65494a884707 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '716f89e307d5424d9c8da74ca6a588c5', 'request_id': 'req-e149951c-1715-48a5-8d04-65494a884707'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:43.576493 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 887/1762] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Apr 11 16:43:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:43:43.581081 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab60f6e2-33d3-4370-912e-4fc155cc5a05 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:43.595934 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e149951c-1715-48a5-8d04-65494a884707 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '716f89e307d5424d9c8da74ca6a588c5', 'request_id': 'req-e149951c-1715-48a5-8d04-65494a884707'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:43.604317 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab60f6e2-33d3-4370-912e-4fc155cc5a05 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:43.713849 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e149951c-1715-48a5-8d04-65494a884707 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '716f89e307d5424d9c8da74ca6a588c5', 'request_id': 'req-e149951c-1715-48a5-8d04-65494a884707'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:43.731297 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e149951c-1715-48a5-8d04-65494a884707 admin admin] The token cache is being invalidate because project 716f89e307d5424d9c8da74ca6a588c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:43:43.732114 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e149951c-1715-48a5-8d04-65494a884707 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:43.732510 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e149951c-1715-48a5-8d04-65494a884707 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:43.754505 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 876/1763] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:43:43 2022] DELETE /identity/v3/projects/716f89e307d5424d9c8da74ca6a588c5 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:43:43.760114 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f899461-d2a0-438e-bf45-66c77400ae3a None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:43.760694 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821ea2ee-a5fb-48b9-9f15-1143d4f77359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:43.761588 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ea2ee-a5fb-48b9-9f15-1143d4f77359 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:43.761815 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ea2ee-a5fb-48b9-9f15-1143d4f77359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:43.762129 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ea2ee-a5fb-48b9-9f15-1143d4f77359 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:43.762652 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f899461-d2a0-438e-bf45-66c77400ae3a None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:43.763000 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821ea2ee-a5fb-48b9-9f15-1143d4f77359 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:43.763442 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f899461-d2a0-438e-bf45-66c77400ae3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:43.765358 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821ea2ee-a5fb-48b9-9f15-1143d4f77359 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:43.821399 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-0f899461-d2a0-438e-bf45-66c77400ae3a None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:43.822650 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0f899461-d2a0-438e-bf45-66c77400ae3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:43.882908 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 877/1764] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:43:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:43.882908 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f899461-d2a0-438e-bf45-66c77400ae3a None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:43.882908 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0f899461-d2a0-438e-bf45-66c77400ae3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:43.884421 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f899461-d2a0-438e-bf45-66c77400ae3a None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:43.890101 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a44423-7a87-49be-9481-ff2d109d9a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:43.890511 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a44423-7a87-49be-9481-ff2d109d9a0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:43.890782 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a44423-7a87-49be-9481-ff2d109d9a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:43.891098 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a44423-7a87-49be-9481-ff2d109d9a0f admin admin] PATH_INFO: `/v3/projects/1c4fdfc7ca2b4364a9e5c1e3ac30fa87` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:43.892308 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a44423-7a87-49be-9481-ff2d109d9a0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c4fdfc7ca2b4364a9e5c1e3ac30fa87)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:43.894224 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a44423-7a87-49be-9481-ff2d109d9a0f admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:44.190175 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 888/1765] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:43:43 2022] POST /identity/v3/projects => generated 387 bytes in 607 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:43:44.190175 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5037cb63-057d-4647-9c75-8e5e10f3e01b None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:44.190175 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5037cb63-057d-4647-9c75-8e5e10f3e01b None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:44.190175 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5037cb63-057d-4647-9c75-8e5e10f3e01b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:44.209197 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-5037cb63-057d-4647-9c75-8e5e10f3e01b None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:44.210600 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-5037cb63-057d-4647-9c75-8e5e10f3e01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:44.263731 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f1a44423-7a87-49be-9481-ff2d109d9a0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c4fdfc7ca2b4364a9e5c1e3ac30fa87', 'request_id': 'req-f1a44423-7a87-49be-9481-ff2d109d9a0f'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:44.269607 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f1a44423-7a87-49be-9481-ff2d109d9a0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c4fdfc7ca2b4364a9e5c1e3ac30fa87', 'request_id': 'req-f1a44423-7a87-49be-9481-ff2d109d9a0f'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:44.275944 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 889/1766] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:43:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:44.276845 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5037cb63-057d-4647-9c75-8e5e10f3e01b None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:44.278235 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-5037cb63-057d-4647-9c75-8e5e10f3e01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:44.290662 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5037cb63-057d-4647-9c75-8e5e10f3e01b None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:44.353742 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526cf9d5-61ce-415d-bd63-f9f0ecfd8f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:44.354441 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526cf9d5-61ce-415d-bd63-f9f0ecfd8f4a admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:44.354810 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526cf9d5-61ce-415d-bd63-f9f0ecfd8f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:44.355074 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526cf9d5-61ce-415d-bd63-f9f0ecfd8f4a admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:44.355816 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526cf9d5-61ce-415d-bd63-f9f0ecfd8f4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:44.357823 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526cf9d5-61ce-415d-bd63-f9f0ecfd8f4a admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:44.401364 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f1a44423-7a87-49be-9481-ff2d109d9a0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c4fdfc7ca2b4364a9e5c1e3ac30fa87', 'request_id': 'req-f1a44423-7a87-49be-9481-ff2d109d9a0f'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:44.416422 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f1a44423-7a87-49be-9481-ff2d109d9a0f admin admin] The token cache is being invalidate because project 1c4fdfc7ca2b4364a9e5c1e3ac30fa87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:43:44.419128 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f1a44423-7a87-49be-9481-ff2d109d9a0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:44.419128 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f1a44423-7a87-49be-9481-ff2d109d9a0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:44.419128 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 878/1767] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:43:43 2022] DELETE /identity/v3/projects/1c4fdfc7ca2b4364a9e5c1e3ac30fa87 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:43:44.419905 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a44423-7a87-49be-9481-ff2d109d9a0f admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:44.421243 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-f1a44423-7a87-49be-9481-ff2d109d9a0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:44.435110 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a44423-7a87-49be-9481-ff2d109d9a0f admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:44.441076 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6787f3c3-912a-40a9-90ac-2f2b05f5f2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:44.441593 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6787f3c3-912a-40a9-90ac-2f2b05f5f2b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:44.441879 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6787f3c3-912a-40a9-90ac-2f2b05f5f2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:44.442157 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6787f3c3-912a-40a9-90ac-2f2b05f5f2b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:44.443024 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6787f3c3-912a-40a9-90ac-2f2b05f5f2b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:43:44.443344 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6787f3c3-912a-40a9-90ac-2f2b05f5f2b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:44.445001 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6787f3c3-912a-40a9-90ac-2f2b05f5f2b0 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:44.457220 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 879/1768] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Apr 11 16:43:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:43:44.458163 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6787f3c3-912a-40a9-90ac-2f2b05f5f2b0 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:44.460554 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-6787f3c3-912a-40a9-90ac-2f2b05f5f2b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:44.474468 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6787f3c3-912a-40a9-90ac-2f2b05f5f2b0 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:44.481977 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e82bd4-90ae-48ad-a917-5b676896b263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:44.482774 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e82bd4-90ae-48ad-a917-5b676896b263 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:44.483248 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e82bd4-90ae-48ad-a917-5b676896b263 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:44.483748 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e82bd4-90ae-48ad-a917-5b676896b263 admin admin] PATH_INFO: `/v3/users/1de9e52bf388443fb632f3459575e71d` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:44.485926 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e82bd4-90ae-48ad-a917-5b676896b263 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1de9e52bf388443fb632f3459575e71d)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:44.489322 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e82bd4-90ae-48ad-a917-5b676896b263 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:44.495105 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 890/1769] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:43:44 2022] POST /identity/v3/users => generated 294 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:43:44.495105 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526cf9d5-61ce-415d-bd63-f9f0ecfd8f4a admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:44.511279 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526cf9d5-61ce-415d-bd63-f9f0ecfd8f4a admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:44.517666 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f2b1f9-c896-4fcf-94be-cbcec7308faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:44.518799 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2b1f9-c896-4fcf-94be-cbcec7308faa admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:44.519303 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2b1f9-c896-4fcf-94be-cbcec7308faa admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:44.519939 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2b1f9-c896-4fcf-94be-cbcec7308faa admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:44.521691 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f2b1f9-c896-4fcf-94be-cbcec7308faa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:44.525832 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f2b1f9-c896-4fcf-94be-cbcec7308faa admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:44.703670 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 891/1770] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:43:44 2022] POST /identity/v3/projects => generated 367 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:43:44.710483 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f2b1f9-c896-4fcf-94be-cbcec7308faa admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:44.710483 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-47f2b1f9-c896-4fcf-94be-cbcec7308faa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:44.749114 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-32e82bd4-90ae-48ad-a917-5b676896b263 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1de9e52bf388443fb632f3459575e71d'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:44.750286 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-32e82bd4-90ae-48ad-a917-5b676896b263 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1de9e52bf388443fb632f3459575e71d'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:44.786819 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f2b1f9-c896-4fcf-94be-cbcec7308faa admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:44.792255 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bb4c4f-e941-46c8-8586-e7c8016a7f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:44.792940 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb4c4f-e941-46c8-8586-e7c8016a7f6d admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:44.793223 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb4c4f-e941-46c8-8586-e7c8016a7f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:44.793497 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb4c4f-e941-46c8-8586-e7c8016a7f6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:44.794238 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bb4c4f-e941-46c8-8586-e7c8016a7f6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:44.796686 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bb4c4f-e941-46c8-8586-e7c8016a7f6d admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:44.814223 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 892/1771] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:43:44 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:43:44.814223 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bb4c4f-e941-46c8-8586-e7c8016a7f6d admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:44.825373 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bb4c4f-e941-46c8-8586-e7c8016a7f6d admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:44.835337 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320289c6-02dd-4190-87d3-00021fd0b60f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:44.836616 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320289c6-02dd-4190-87d3-00021fd0b60f admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:44.836945 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320289c6-02dd-4190-87d3-00021fd0b60f admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:44.837328 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320289c6-02dd-4190-87d3-00021fd0b60f admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:44.838154 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320289c6-02dd-4190-87d3-00021fd0b60f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:44.840188 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320289c6-02dd-4190-87d3-00021fd0b60f admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:44.852528 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-32e82bd4-90ae-48ad-a917-5b676896b263 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1de9e52bf388443fb632f3459575e71d'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:44.862732 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-32e82bd4-90ae-48ad-a917-5b676896b263 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1de9e52bf388443fb632f3459575e71d'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:44.877772 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-32e82bd4-90ae-48ad-a917-5b676896b263 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1de9e52bf388443fb632f3459575e71d'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:44.885508 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 880/1772] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:43:44 2022] DELETE /identity/v3/users/1de9e52bf388443fb632f3459575e71d => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:43:44.886347 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e82bd4-90ae-48ad-a917-5b676896b263 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:44.888381 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-32e82bd4-90ae-48ad-a917-5b676896b263 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:44.958088 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 893/1773] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:43:44 2022] POST /identity/v3/users => generated 284 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:43:44.959302 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320289c6-02dd-4190-87d3-00021fd0b60f admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:44.967312 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-320289c6-02dd-4190-87d3-00021fd0b60f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:44.994974 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e82bd4-90ae-48ad-a917-5b676896b263 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:44.997960 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320289c6-02dd-4190-87d3-00021fd0b60f admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:45.001477 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a3a231-5fb7-4ea6-bd96-2ae5aa52903e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:45.002953 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a3a231-5fb7-4ea6-bd96-2ae5aa52903e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:45.003769 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a3a231-5fb7-4ea6-bd96-2ae5aa52903e admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:45.004071 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a3a231-5fb7-4ea6-bd96-2ae5aa52903e admin admin] PATH_INFO: `/v3/users/e6efd863b2a54892987fdbac7127156b` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:45.005121 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9f4cd3-81b7-4908-8e4c-7038cf75c9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:45.006543 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f4cd3-81b7-4908-8e4c-7038cf75c9fe admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:45.006725 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a3a231-5fb7-4ea6-bd96-2ae5aa52903e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6efd863b2a54892987fdbac7127156b)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:45.008028 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f4cd3-81b7-4908-8e4c-7038cf75c9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:45.012253 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f4cd3-81b7-4908-8e4c-7038cf75c9fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:45.012387 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a3a231-5fb7-4ea6-bd96-2ae5aa52903e admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:45.012520 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9f4cd3-81b7-4908-8e4c-7038cf75c9fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:45.012520 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9f4cd3-81b7-4908-8e4c-7038cf75c9fe admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:45.030527 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 894/1774] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:43:44 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:43:45.031504 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9f4cd3-81b7-4908-8e4c-7038cf75c9fe admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:45.034565 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-de9f4cd3-81b7-4908-8e4c-7038cf75c9fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:45.065726 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9f4cd3-81b7-4908-8e4c-7038cf75c9fe admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:45.072139 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0a2951-960c-40ca-83b0-dfa7b697ea1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:45.072844 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a2951-960c-40ca-83b0-dfa7b697ea1b admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:45.073128 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a2951-960c-40ca-83b0-dfa7b697ea1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:45.073409 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a2951-960c-40ca-83b0-dfa7b697ea1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:45.074160 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0a2951-960c-40ca-83b0-dfa7b697ea1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:45.075858 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0a2951-960c-40ca-83b0-dfa7b697ea1b admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:45.091249 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 895/1775] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:43:45 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:43:45.092184 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0a2951-960c-40ca-83b0-dfa7b697ea1b admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:45.112531 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0a2951-960c-40ca-83b0-dfa7b697ea1b admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:45.120262 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b7e8b3-4674-4e2e-be67-b4bd6464e74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:45.121326 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7e8b3-4674-4e2e-be67-b4bd6464e74a admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:45.121715 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7e8b3-4674-4e2e-be67-b4bd6464e74a admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:45.122095 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7e8b3-4674-4e2e-be67-b4bd6464e74a admin admin] PATH_INFO: `/v3/projects/81c88b5742f84161a7cc6dd42888872e/users/2b19b4b5d8754ed0a6e941a216ba1b7d/roles/0d41da7bec094450b5bff4e4831be52c` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:45.153881 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b7e8b3-4674-4e2e-be67-b4bd6464e74a admin admin] RBAC: Authorizing `identity:create_grant(project_id=81c88b5742f84161a7cc6dd42888872e, user_id=2b19b4b5d8754ed0a6e941a216ba1b7d, role_id=0d41da7bec094450b5bff4e4831be52c)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:45.158200 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b7e8b3-4674-4e2e-be67-b4bd6464e74a admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:45.248922 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 896/1776] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:43:45 2022] PUT /identity/v3/projects/81c88b5742f84161a7cc6dd42888872e/users/2b19b4b5d8754ed0a6e941a216ba1b7d/roles/0d41da7bec094450b5bff4e4831be52c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:43:45.250169 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b7e8b3-4674-4e2e-be67-b4bd6464e74a admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:45.262062 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e5a3a231-5fb7-4ea6-bd96-2ae5aa52903e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6efd863b2a54892987fdbac7127156b'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:45.262783 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e5a3a231-5fb7-4ea6-bd96-2ae5aa52903e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6efd863b2a54892987fdbac7127156b'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:45.321182 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b7e8b3-4674-4e2e-be67-b4bd6464e74a admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:45.326845 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd7074-0028-449b-99a5-e1b9459bea95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:45.327563 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd7074-0028-449b-99a5-e1b9459bea95 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:45.328010 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd7074-0028-449b-99a5-e1b9459bea95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:45.328297 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd7074-0028-449b-99a5-e1b9459bea95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:45.329078 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fd7074-0028-449b-99a5-e1b9459bea95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:45.330999 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fd7074-0028-449b-99a5-e1b9459bea95 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:45.341161 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 897/1777] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:43:45 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:43:45.342463 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba1fbc-bd00-4cbd-8681-e5de85d3de6c None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:45.342750 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba1fbc-bd00-4cbd-8681-e5de85d3de6c None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:45.343034 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba1fbc-bd00-4cbd-8681-e5de85d3de6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:45.372276 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-4aba1fbc-bd00-4cbd-8681-e5de85d3de6c None None] MFA Rules not processed for user `2b19b4b5d8754ed0a6e941a216ba1b7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:45.379422 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e5a3a231-5fb7-4ea6-bd96-2ae5aa52903e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6efd863b2a54892987fdbac7127156b'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:45.379598 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-4aba1fbc-bd00-4cbd-8681-e5de85d3de6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:45.380469 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e5a3a231-5fb7-4ea6-bd96-2ae5aa52903e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6efd863b2a54892987fdbac7127156b'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:45.392444 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e5a3a231-5fb7-4ea6-bd96-2ae5aa52903e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6efd863b2a54892987fdbac7127156b'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:45.399005 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 881/1778] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:43:44 2022] DELETE /identity/v3/users/e6efd863b2a54892987fdbac7127156b => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:43:45.399944 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a3a231-5fb7-4ea6-bd96-2ae5aa52903e admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:45.401315 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e5a3a231-5fb7-4ea6-bd96-2ae5aa52903e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:45.438932 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 898/1779] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:43:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:45.440947 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a6b40-2958-4b4f-97c1-496288976619 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:45.441243 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a6b40-2958-4b4f-97c1-496288976619 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:45.441527 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a6b40-2958-4b4f-97c1-496288976619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:45.460965 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-338a6b40-2958-4b4f-97c1-496288976619 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:45.462336 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-338a6b40-2958-4b4f-97c1-496288976619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:45.467743 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a3a231-5fb7-4ea6-bd96-2ae5aa52903e admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:45.470373 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 899/1780] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:43:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:45.471232 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338a6b40-2958-4b4f-97c1-496288976619 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:45.475601 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-338a6b40-2958-4b4f-97c1-496288976619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:45.478210 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce901eb3-c169-4b5e-b0c9-3fd6a2716c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:45.479909 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce901eb3-c169-4b5e-b0c9-3fd6a2716c48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:45.480257 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce901eb3-c169-4b5e-b0c9-3fd6a2716c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:45.480539 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce901eb3-c169-4b5e-b0c9-3fd6a2716c48 admin admin] PATH_INFO: `/v3/projects/caa289e3bee245518b28888daa63b273/users/ceb3e65894e84db8bf10460ae56344d0/roles/0d41da7bec094450b5bff4e4831be52c` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:45.487974 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338a6b40-2958-4b4f-97c1-496288976619 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:45.493378 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6dc6cc-f36e-4c87-9d6c-607df810c587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:45.494046 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6dc6cc-f36e-4c87-9d6c-607df810c587 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:45.494460 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6dc6cc-f36e-4c87-9d6c-607df810c587 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:45.494741 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6dc6cc-f36e-4c87-9d6c-607df810c587 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:45.495439 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6dc6cc-f36e-4c87-9d6c-607df810c587 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:45.496429 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce901eb3-c169-4b5e-b0c9-3fd6a2716c48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=caa289e3bee245518b28888daa63b273, user_id=ceb3e65894e84db8bf10460ae56344d0, role_id=0d41da7bec094450b5bff4e4831be52c)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:45.497487 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6dc6cc-f36e-4c87-9d6c-607df810c587 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:45.499147 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce901eb3-c169-4b5e-b0c9-3fd6a2716c48 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:45.599975 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 882/1781] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:43:45 2022] PUT /identity/v3/projects/caa289e3bee245518b28888daa63b273/users/ceb3e65894e84db8bf10460ae56344d0/roles/0d41da7bec094450b5bff4e4831be52c => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:43:45.600965 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce901eb3-c169-4b5e-b0c9-3fd6a2716c48 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:45.602593 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ce901eb3-c169-4b5e-b0c9-3fd6a2716c48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:45.629192 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 900/1782] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:43:45 2022] POST /identity/v3/projects => generated 385 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:43:45.630381 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6dc6cc-f36e-4c87-9d6c-607df810c587 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:45.632063 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-ce6dc6cc-f36e-4c87-9d6c-607df810c587 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:45.658719 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce901eb3-c169-4b5e-b0c9-3fd6a2716c48 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:45.702286 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6dc6cc-f36e-4c87-9d6c-607df810c587 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:45.707035 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04653178-2542-44b3-aab3-f9976254fa39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:45.707937 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04653178-2542-44b3-aab3-f9976254fa39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:45.708755 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04653178-2542-44b3-aab3-f9976254fa39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:45.709071 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04653178-2542-44b3-aab3-f9976254fa39 admin admin] PATH_INFO: `/v3/projects/54462a63f693411ab2fb267f19762eeb` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:45.710696 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04653178-2542-44b3-aab3-f9976254fa39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54462a63f693411ab2fb267f19762eeb)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:45.712181 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04653178-2542-44b3-aab3-f9976254fa39 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:45.713167 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb39a3db-fa5a-4ccb-b4e4-32051bc57f77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:45.713821 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb39a3db-fa5a-4ccb-b4e4-32051bc57f77 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:45.714100 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb39a3db-fa5a-4ccb-b4e4-32051bc57f77 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:45.714375 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb39a3db-fa5a-4ccb-b4e4-32051bc57f77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:45.726897 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb39a3db-fa5a-4ccb-b4e4-32051bc57f77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:45.728482 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb39a3db-fa5a-4ccb-b4e4-32051bc57f77 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:45.738370 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 883/1783] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:43:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:43:45.739970 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b305f-f28d-4ec6-a9fc-3a157670178d None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:45.740260 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b305f-f28d-4ec6-a9fc-3a157670178d None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:45.740531 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b305f-f28d-4ec6-a9fc-3a157670178d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:45.766546 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-9b1b305f-f28d-4ec6-a9fc-3a157670178d None None] MFA Rules not processed for user `ceb3e65894e84db8bf10460ae56344d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:45.767790 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-9b1b305f-f28d-4ec6-a9fc-3a157670178d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:45.845519 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 884/1784] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:43:45 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:45.847365 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b305f-f28d-4ec6-a9fc-3a157670178d None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:45.848383 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-04653178-2542-44b3-aab3-f9976254fa39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54462a63f693411ab2fb267f19762eeb', 'request_id': 'req-04653178-2542-44b3-aab3-f9976254fa39'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:45.860127 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b305f-f28d-4ec6-a9fc-3a157670178d None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:45.919782 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9f9088-8995-47d9-ae27-762189022c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:45.920479 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f9088-8995-47d9-ae27-762189022c37 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:45.920763 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f9088-8995-47d9-ae27-762189022c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:45.921043 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f9088-8995-47d9-ae27-762189022c37 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:45.921745 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9f9088-8995-47d9-ae27-762189022c37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:45.923724 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9f9088-8995-47d9-ae27-762189022c37 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:45.961475 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-04653178-2542-44b3-aab3-f9976254fa39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54462a63f693411ab2fb267f19762eeb', 'request_id': 'req-04653178-2542-44b3-aab3-f9976254fa39'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:45.969777 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-04653178-2542-44b3-aab3-f9976254fa39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54462a63f693411ab2fb267f19762eeb', 'request_id': 'req-04653178-2542-44b3-aab3-f9976254fa39'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:45.982465 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-04653178-2542-44b3-aab3-f9976254fa39 admin admin] The token cache is being invalidate because project 54462a63f693411ab2fb267f19762eeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:43:45.982764 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-04653178-2542-44b3-aab3-f9976254fa39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:45.983484 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-04653178-2542-44b3-aab3-f9976254fa39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:45.986644 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 901/1785] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:43:45 2022] DELETE /identity/v3/projects/54462a63f693411ab2fb267f19762eeb => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:43:45.987495 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04653178-2542-44b3-aab3-f9976254fa39 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:45.989289 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-04653178-2542-44b3-aab3-f9976254fa39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:46.003769 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04653178-2542-44b3-aab3-f9976254fa39 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:46.009767 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b99625a-0fe8-4a86-94f4-60caa3857555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:46.010477 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99625a-0fe8-4a86-94f4-60caa3857555 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:46.010766 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99625a-0fe8-4a86-94f4-60caa3857555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:46.011047 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99625a-0fe8-4a86-94f4-60caa3857555 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:46.011879 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b99625a-0fe8-4a86-94f4-60caa3857555 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:46.013910 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b99625a-0fe8-4a86-94f4-60caa3857555 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:46.032641 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 885/1786] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:43:45 2022] POST /identity/v3/users => generated 299 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:43:46.037185 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0084fad1-cff9-4141-baa9-1b18c4a9e237 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:46.038459 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0084fad1-cff9-4141-baa9-1b18c4a9e237 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:46.038808 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0084fad1-cff9-4141-baa9-1b18c4a9e237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:46.059579 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-0084fad1-cff9-4141-baa9-1b18c4a9e237 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:46.060885 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0084fad1-cff9-4141-baa9-1b18c4a9e237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:46.069970 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 886/1787] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:43:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:46.070806 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0084fad1-cff9-4141-baa9-1b18c4a9e237 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:46.072169 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0084fad1-cff9-4141-baa9-1b18c4a9e237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:46.084086 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0084fad1-cff9-4141-baa9-1b18c4a9e237 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:46.088520 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b705618d-f6bc-4bcd-a8d0-34065531d479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:46.089206 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b705618d-f6bc-4bcd-a8d0-34065531d479 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:46.089483 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b705618d-f6bc-4bcd-a8d0-34065531d479 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:46.089765 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b705618d-f6bc-4bcd-a8d0-34065531d479 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:46.090550 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b705618d-f6bc-4bcd-a8d0-34065531d479 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:46.092193 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b705618d-f6bc-4bcd-a8d0-34065531d479 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:46.103888 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 887/1788] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:43:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:43:46.107664 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef44b30-bb89-4218-9164-9e47b6f4ecb7 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:46.107664 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef44b30-bb89-4218-9164-9e47b6f4ecb7 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:46.107664 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef44b30-bb89-4218-9164-9e47b6f4ecb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:46.125367 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-aef44b30-bb89-4218-9164-9e47b6f4ecb7 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:46.126581 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-aef44b30-bb89-4218-9164-9e47b6f4ecb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:46.137535 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 888/1789] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:43:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:46.138738 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef44b30-bb89-4218-9164-9e47b6f4ecb7 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:46.148638 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 902/1790] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:43:45 2022] POST /identity/v3/projects => generated 369 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:43:46.149619 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b99625a-0fe8-4a86-94f4-60caa3857555 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:46.159136 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef44b30-bb89-4218-9164-9e47b6f4ecb7 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:46.280377 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b99625a-0fe8-4a86-94f4-60caa3857555 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:46.289376 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dc27ec-a05c-417d-afcd-4ba31337dafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:46.290452 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc27ec-a05c-417d-afcd-4ba31337dafc admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:46.290898 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc27ec-a05c-417d-afcd-4ba31337dafc admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:46.291334 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc27ec-a05c-417d-afcd-4ba31337dafc admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:46.292256 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dc27ec-a05c-417d-afcd-4ba31337dafc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:43:46.293978 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92621f4a-e055-4079-bfe7-f91a4160c033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:46.294896 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92621f4a-e055-4079-bfe7-f91a4160c033 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:46.295184 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92621f4a-e055-4079-bfe7-f91a4160c033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:46.295463 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92621f4a-e055-4079-bfe7-f91a4160c033 admin admin] PATH_INFO: `/v3/projects/4c40321f3d61476ab75058707791d3b7/users/cc369daf5e97496681bc0bd9d8306854/roles/702e5e78b5d744529384b96a390ae92f` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:46.296447 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dc27ec-a05c-417d-afcd-4ba31337dafc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:46.300927 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dc27ec-a05c-417d-afcd-4ba31337dafc admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:46.320470 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 903/1791] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Apr 11 16:43:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:43:46.321139 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dc27ec-a05c-417d-afcd-4ba31337dafc admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:46.331785 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92621f4a-e055-4079-bfe7-f91a4160c033 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c40321f3d61476ab75058707791d3b7, user_id=cc369daf5e97496681bc0bd9d8306854, role_id=702e5e78b5d744529384b96a390ae92f)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:46.331785 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92621f4a-e055-4079-bfe7-f91a4160c033 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:46.335239 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dc27ec-a05c-417d-afcd-4ba31337dafc admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:46.340349 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1262970d-f0bc-4e49-8458-f81b94954518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:46.341036 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1262970d-f0bc-4e49-8458-f81b94954518 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:46.341326 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1262970d-f0bc-4e49-8458-f81b94954518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:46.341601 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1262970d-f0bc-4e49-8458-f81b94954518 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:46.342295 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1262970d-f0bc-4e49-8458-f81b94954518 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:46.344269 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1262970d-f0bc-4e49-8458-f81b94954518 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:46.464602 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 889/1792] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:43:46 2022] PUT /identity/v3/projects/4c40321f3d61476ab75058707791d3b7/users/cc369daf5e97496681bc0bd9d8306854/roles/702e5e78b5d744529384b96a390ae92f => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:43:46.476591 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92621f4a-e055-4079-bfe7-f91a4160c033 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:46.536541 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 904/1793] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:43:46 2022] POST /identity/v3/users => generated 291 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:43:46.539715 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1262970d-f0bc-4e49-8458-f81b94954518 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:46.542834 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-1262970d-f0bc-4e49-8458-f81b94954518 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:46.557200 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1262970d-f0bc-4e49-8458-f81b94954518 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:46.569994 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92621f4a-e055-4079-bfe7-f91a4160c033 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:46.576222 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19554283-47a0-45f8-b26d-c0ce8d8928a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:46.576914 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19554283-47a0-45f8-b26d-c0ce8d8928a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:46.577209 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19554283-47a0-45f8-b26d-c0ce8d8928a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:46.577498 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19554283-47a0-45f8-b26d-c0ce8d8928a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:46.578216 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19554283-47a0-45f8-b26d-c0ce8d8928a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:46.580180 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19554283-47a0-45f8-b26d-c0ce8d8928a6 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:46.650779 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1fbb8a-fe58-4d30-9f8a-bcc87d03aa6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:46.651803 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1fbb8a-fe58-4d30-9f8a-bcc87d03aa6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:46.652096 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1fbb8a-fe58-4d30-9f8a-bcc87d03aa6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:46.652378 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1fbb8a-fe58-4d30-9f8a-bcc87d03aa6e admin admin] PATH_INFO: `/v3/projects/6f5b08e3e1954623b1439ed641bdda5d` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:46.653835 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1fbb8a-fe58-4d30-9f8a-bcc87d03aa6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f5b08e3e1954623b1439ed641bdda5d)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:46.655922 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1fbb8a-fe58-4d30-9f8a-bcc87d03aa6e admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:46.728745 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 890/1794] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:43:46 2022] POST /identity/v3/projects => generated 365 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:43:46.730866 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19554283-47a0-45f8-b26d-c0ce8d8928a6 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:46.816351 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-ae1fbb8a-fe58-4d30-9f8a-bcc87d03aa6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f5b08e3e1954623b1439ed641bdda5d', 'request_id': 'req-ae1fbb8a-fe58-4d30-9f8a-bcc87d03aa6e'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:46.831720 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19554283-47a0-45f8-b26d-c0ce8d8928a6 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:46.893798 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-ae1fbb8a-fe58-4d30-9f8a-bcc87d03aa6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f5b08e3e1954623b1439ed641bdda5d', 'request_id': 'req-ae1fbb8a-fe58-4d30-9f8a-bcc87d03aa6e'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:46.902594 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-ae1fbb8a-fe58-4d30-9f8a-bcc87d03aa6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f5b08e3e1954623b1439ed641bdda5d', 'request_id': 'req-ae1fbb8a-fe58-4d30-9f8a-bcc87d03aa6e'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:46.913113 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac6ed25-b525-41f4-8502-7e794ba0d3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:46.914592 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac6ed25-b525-41f4-8502-7e794ba0d3e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:46.915665 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac6ed25-b525-41f4-8502-7e794ba0d3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:46.916497 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac6ed25-b525-41f4-8502-7e794ba0d3e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:46.917323 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-ae1fbb8a-fe58-4d30-9f8a-bcc87d03aa6e admin admin] The token cache is being invalidate because project 6f5b08e3e1954623b1439ed641bdda5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:43:46.917615 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-ae1fbb8a-fe58-4d30-9f8a-bcc87d03aa6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:46.917871 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac6ed25-b525-41f4-8502-7e794ba0d3e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:46.918307 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-ae1fbb8a-fe58-4d30-9f8a-bcc87d03aa6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:46.920014 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 905/1795] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:43:46 2022] DELETE /identity/v3/projects/6f5b08e3e1954623b1439ed641bdda5d => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:43:46.920803 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1fbb8a-fe58-4d30-9f8a-bcc87d03aa6e admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:46.922158 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-ae1fbb8a-fe58-4d30-9f8a-bcc87d03aa6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:46.922365 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac6ed25-b525-41f4-8502-7e794ba0d3e7 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:46.936445 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1fbb8a-fe58-4d30-9f8a-bcc87d03aa6e admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:46.939668 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 891/1796] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:43:46 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:43:46.941118 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac6ed25-b525-41f4-8502-7e794ba0d3e7 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:46.942003 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919b4ac6-1b5b-41fb-b230-c14be425d9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:46.943729 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0ac6ed25-b525-41f4-8502-7e794ba0d3e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:46.943872 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919b4ac6-1b5b-41fb-b230-c14be425d9f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:46.944085 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919b4ac6-1b5b-41fb-b230-c14be425d9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:46.944452 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919b4ac6-1b5b-41fb-b230-c14be425d9f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:46.945185 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919b4ac6-1b5b-41fb-b230-c14be425d9f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:46.947074 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919b4ac6-1b5b-41fb-b230-c14be425d9f1 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:46.958776 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac6ed25-b525-41f4-8502-7e794ba0d3e7 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:46.960511 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 906/1797] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:43:46 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:43:46.961454 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919b4ac6-1b5b-41fb-b230-c14be425d9f1 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:46.963156 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-919b4ac6-1b5b-41fb-b230-c14be425d9f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:46.968779 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bdcc42-21f9-4802-bb35-418caccf974f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:46.969597 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bdcc42-21f9-4802-bb35-418caccf974f admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:46.970071 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bdcc42-21f9-4802-bb35-418caccf974f admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:46.970358 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bdcc42-21f9-4802-bb35-418caccf974f admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:46.971295 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bdcc42-21f9-4802-bb35-418caccf974f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:46.973371 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bdcc42-21f9-4802-bb35-418caccf974f admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:46.978024 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919b4ac6-1b5b-41fb-b230-c14be425d9f1 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:46.983717 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bae6e66-a15f-4d4e-8099-a0a01749a429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:46.984615 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bae6e66-a15f-4d4e-8099-a0a01749a429 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:46.984904 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bae6e66-a15f-4d4e-8099-a0a01749a429 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:46.985187 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bae6e66-a15f-4d4e-8099-a0a01749a429 admin admin] PATH_INFO: `/v3/users/9cd09aaaeadd4594b7079c1f7af0c474` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:46.986446 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bae6e66-a15f-4d4e-8099-a0a01749a429 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cd09aaaeadd4594b7079c1f7af0c474)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:46.988423 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bae6e66-a15f-4d4e-8099-a0a01749a429 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:47.200836 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 892/1798] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:43:46 2022] POST /identity/v3/users => generated 283 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:43:47.202158 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bdcc42-21f9-4802-bb35-418caccf974f admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:47.204075 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-61bdcc42-21f9-4802-bb35-418caccf974f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:47.243792 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bdcc42-21f9-4802-bb35-418caccf974f admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:47.254182 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc2016-fe81-4478-b7b0-3424d2150b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:47.256566 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc2016-fe81-4478-b7b0-3424d2150b9f admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:47.257009 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc2016-fe81-4478-b7b0-3424d2150b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:47.261924 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc2016-fe81-4478-b7b0-3424d2150b9f admin admin] PATH_INFO: `/v3/projects/4c40321f3d61476ab75058707791d3b7/users/cc369daf5e97496681bc0bd9d8306854/roles/702e5e78b5d744529384b96a390ae92f` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:47.261924 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dc2016-fe81-4478-b7b0-3424d2150b9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c40321f3d61476ab75058707791d3b7, user_id=cc369daf5e97496681bc0bd9d8306854, role_id=702e5e78b5d744529384b96a390ae92f)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:47.262992 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dc2016-fe81-4478-b7b0-3424d2150b9f admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:47.283614 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 893/1799] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:43:47 2022] PUT /identity/v3/projects/4c40321f3d61476ab75058707791d3b7/users/cc369daf5e97496681bc0bd9d8306854/roles/702e5e78b5d744529384b96a390ae92f => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:43:47.283614 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc2016-fe81-4478-b7b0-3424d2150b9f admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:47.306910 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-0bae6e66-a15f-4d4e-8099-a0a01749a429 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cd09aaaeadd4594b7079c1f7af0c474'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:47.367926 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc2016-fe81-4478-b7b0-3424d2150b9f admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:47.373431 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe946a5-12a3-4fed-829e-1a512feb9586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:47.374339 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe946a5-12a3-4fed-829e-1a512feb9586 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:47.374619 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe946a5-12a3-4fed-829e-1a512feb9586 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:47.374932 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe946a5-12a3-4fed-829e-1a512feb9586 admin admin] PATH_INFO: `/v3/projects/08677a33da954866ad02d34b7fb3d10a/users/d4ab0b715fc24093844232ccbe67a955/roles/702e5e78b5d744529384b96a390ae92f` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:47.391583 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe946a5-12a3-4fed-829e-1a512feb9586 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08677a33da954866ad02d34b7fb3d10a, user_id=d4ab0b715fc24093844232ccbe67a955, role_id=702e5e78b5d744529384b96a390ae92f)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:47.393859 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-0bae6e66-a15f-4d4e-8099-a0a01749a429 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cd09aaaeadd4594b7079c1f7af0c474'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:47.394551 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe946a5-12a3-4fed-829e-1a512feb9586 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:47.405902 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-0bae6e66-a15f-4d4e-8099-a0a01749a429 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cd09aaaeadd4594b7079c1f7af0c474'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:47.406869 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-0bae6e66-a15f-4d4e-8099-a0a01749a429 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cd09aaaeadd4594b7079c1f7af0c474'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:47.419650 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-0bae6e66-a15f-4d4e-8099-a0a01749a429 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cd09aaaeadd4594b7079c1f7af0c474'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:47.429754 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 907/1800] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:43:46 2022] DELETE /identity/v3/users/9cd09aaaeadd4594b7079c1f7af0c474 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:43:47.431983 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bae6e66-a15f-4d4e-8099-a0a01749a429 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:47.435385 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-0bae6e66-a15f-4d4e-8099-a0a01749a429 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:47.495627 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 894/1801] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:43:47 2022] PUT /identity/v3/projects/08677a33da954866ad02d34b7fb3d10a/users/d4ab0b715fc24093844232ccbe67a955/roles/702e5e78b5d744529384b96a390ae92f => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:43:47.498574 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2277d7-0143-4397-a886-098e6942a358 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:47.503773 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2277d7-0143-4397-a886-098e6942a358 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:47.504169 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2277d7-0143-4397-a886-098e6942a358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:47.577738 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-1f2277d7-0143-4397-a886-098e6942a358 None None] MFA Rules not processed for user `cc369daf5e97496681bc0bd9d8306854`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:47.579004 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-1f2277d7-0143-4397-a886-098e6942a358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:47.597128 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bae6e66-a15f-4d4e-8099-a0a01749a429 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:47.709907 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 895/1802] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:43:47 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:47.714769 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809f0558-b0c5-44a6-8986-381a78016970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:47.714769 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f0558-b0c5-44a6-8986-381a78016970 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:47.714769 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f0558-b0c5-44a6-8986-381a78016970 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:47.714769 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f0558-b0c5-44a6-8986-381a78016970 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:47.715259 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809f0558-b0c5-44a6-8986-381a78016970 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:47.715341 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2277d7-0143-4397-a886-098e6942a358 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:47.715929 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809f0558-b0c5-44a6-8986-381a78016970 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:47.717828 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-1f2277d7-0143-4397-a886-098e6942a358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:47.733747 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 908/1803] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:43:47 2022] GET /identity/v3/roles => generated 1420 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:43:47.733747 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809f0558-b0c5-44a6-8986-381a78016970 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:47.734023 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2277d7-0143-4397-a886-098e6942a358 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:47.734410 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-809f0558-b0c5-44a6-8986-381a78016970 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:47.743890 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd628433-8fc1-4ba6-99ff-6ee546035054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:47.744825 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd628433-8fc1-4ba6-99ff-6ee546035054 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:47.745106 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd628433-8fc1-4ba6-99ff-6ee546035054 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:47.745453 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd628433-8fc1-4ba6-99ff-6ee546035054 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:47.746467 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd628433-8fc1-4ba6-99ff-6ee546035054 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:47.748294 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd628433-8fc1-4ba6-99ff-6ee546035054 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:47.761615 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 896/1804] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:43:47 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:43:47.762652 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd628433-8fc1-4ba6-99ff-6ee546035054 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:47.773430 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd628433-8fc1-4ba6-99ff-6ee546035054 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:47.778470 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d774a93-aaab-4cbb-87a4-f80d45270603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:47.779115 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d774a93-aaab-4cbb-87a4-f80d45270603 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:47.779401 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d774a93-aaab-4cbb-87a4-f80d45270603 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:47.779710 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d774a93-aaab-4cbb-87a4-f80d45270603 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:47.780447 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d774a93-aaab-4cbb-87a4-f80d45270603 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:47.782048 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d774a93-aaab-4cbb-87a4-f80d45270603 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:47.802522 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 897/1805] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:43:47 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:43:47.802522 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d774a93-aaab-4cbb-87a4-f80d45270603 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:47.819823 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d774a93-aaab-4cbb-87a4-f80d45270603 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:47.832806 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da82d1e5-4b1c-44f0-9c83-2bb9acd8f427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:47.833983 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da82d1e5-4b1c-44f0-9c83-2bb9acd8f427 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:47.834271 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da82d1e5-4b1c-44f0-9c83-2bb9acd8f427 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:47.834550 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da82d1e5-4b1c-44f0-9c83-2bb9acd8f427 admin admin] PATH_INFO: `/v3/projects/08677a33da954866ad02d34b7fb3d10a/users/d4ab0b715fc24093844232ccbe67a955/roles/702e5e78b5d744529384b96a390ae92f` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:47.841392 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809f0558-b0c5-44a6-8986-381a78016970 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:47.841830 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da82d1e5-4b1c-44f0-9c83-2bb9acd8f427 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08677a33da954866ad02d34b7fb3d10a, user_id=d4ab0b715fc24093844232ccbe67a955, role_id=702e5e78b5d744529384b96a390ae92f)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:47.844869 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da82d1e5-4b1c-44f0-9c83-2bb9acd8f427 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:47.847141 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d67842e-47f8-432f-a448-202b6e7359ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '950b5b5f690d41509ead753065a0b793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:47.850723 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67842e-47f8-432f-a448-202b6e7359ff service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:47.852714 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67842e-47f8-432f-a448-202b6e7359ff service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:47.853480 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67842e-47f8-432f-a448-202b6e7359ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:47.859138 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 898/1806] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:43:47 2022] PUT /identity/v3/projects/08677a33da954866ad02d34b7fb3d10a/users/d4ab0b715fc24093844232ccbe67a955/roles/702e5e78b5d744529384b96a390ae92f => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:43:47.860480 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da82d1e5-4b1c-44f0-9c83-2bb9acd8f427 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:47.875110 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d67842e-47f8-432f-a448-202b6e7359ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:47.876578 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d67842e-47f8-432f-a448-202b6e7359ff service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:47.897145 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 909/1807] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:43:47 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:43:47.900626 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ef844-688f-4e3e-96e3-0d8f1f8a5ed7 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:47.904793 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ef844-688f-4e3e-96e3-0d8f1f8a5ed7 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:47.904793 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ef844-688f-4e3e-96e3-0d8f1f8a5ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:47.946730 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-b61ef844-688f-4e3e-96e3-0d8f1f8a5ed7 None None] MFA Rules not processed for user `d4ab0b715fc24093844232ccbe67a955`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:47.950196 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-b61ef844-688f-4e3e-96e3-0d8f1f8a5ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:47.983452 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da82d1e5-4b1c-44f0-9c83-2bb9acd8f427 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:47.990126 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f499d633-c2e8-4e8b-becb-f0165b2bb997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:47.991752 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499d633-c2e8-4e8b-becb-f0165b2bb997 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:47.992042 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499d633-c2e8-4e8b-becb-f0165b2bb997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:47.992321 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499d633-c2e8-4e8b-becb-f0165b2bb997 admin admin] PATH_INFO: `/v3/projects/1cae5d9ac9f84945bed77e4ff2d64df9/users/22263fa3edfb4add868a68e25568ca2d/roles/0d41da7bec094450b5bff4e4831be52c` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:48.029484 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f499d633-c2e8-4e8b-becb-f0165b2bb997 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cae5d9ac9f84945bed77e4ff2d64df9, user_id=22263fa3edfb4add868a68e25568ca2d, role_id=0d41da7bec094450b5bff4e4831be52c)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:48.032171 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f499d633-c2e8-4e8b-becb-f0165b2bb997 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:48.041538 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 910/1808] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:43:47 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:48.043015 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ef844-688f-4e3e-96e3-0d8f1f8a5ed7 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:48.044882 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-b61ef844-688f-4e3e-96e3-0d8f1f8a5ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:48.069222 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ef844-688f-4e3e-96e3-0d8f1f8a5ed7 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:48.079731 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e003c2-9cbd-42db-aea7-577dca09af23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:48.079731 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e003c2-9cbd-42db-aea7-577dca09af23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:48.079731 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e003c2-9cbd-42db-aea7-577dca09af23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:48.079731 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e003c2-9cbd-42db-aea7-577dca09af23 admin admin] PATH_INFO: `/v3/users/2b19b4b5d8754ed0a6e941a216ba1b7d` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:48.080092 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e003c2-9cbd-42db-aea7-577dca09af23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b19b4b5d8754ed0a6e941a216ba1b7d)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:48.081890 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e003c2-9cbd-42db-aea7-577dca09af23 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:48.190626 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 899/1809] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:43:47 2022] PUT /identity/v3/projects/1cae5d9ac9f84945bed77e4ff2d64df9/users/22263fa3edfb4add868a68e25568ca2d/roles/0d41da7bec094450b5bff4e4831be52c => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:43:48.191945 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f499d633-c2e8-4e8b-becb-f0165b2bb997 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:48.194935 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-f499d633-c2e8-4e8b-becb-f0165b2bb997 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:48.264798 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f499d633-c2e8-4e8b-becb-f0165b2bb997 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:48.269196 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b3369c-7ee6-4acb-b01e-3d656cd5d7b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '950b5b5f690d41509ead753065a0b793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:48.270156 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b3369c-7ee6-4acb-b01e-3d656cd5d7b0 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:48.270419 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b3369c-7ee6-4acb-b01e-3d656cd5d7b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:48.270749 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b3369c-7ee6-4acb-b01e-3d656cd5d7b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:48.379004 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b3369c-7ee6-4acb-b01e-3d656cd5d7b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:48.381480 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b3369c-7ee6-4acb-b01e-3d656cd5d7b0 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:48.393569 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 900/1810] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:43:48 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:43:48.394223 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-d6e003c2-9cbd-42db-aea7-577dca09af23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b19b4b5d8754ed0a6e941a216ba1b7d'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:48.401322 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de411f-8cb0-418b-9446-558091adfe0a None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:48.401622 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de411f-8cb0-418b-9446-558091adfe0a None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:48.401995 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de411f-8cb0-418b-9446-558091adfe0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:48.450808 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-c4de411f-8cb0-418b-9446-558091adfe0a None None] MFA Rules not processed for user `22263fa3edfb4add868a68e25568ca2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:48.452534 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-c4de411f-8cb0-418b-9446-558091adfe0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:48.479387 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-d6e003c2-9cbd-42db-aea7-577dca09af23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b19b4b5d8754ed0a6e941a216ba1b7d'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:48.492081 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-d6e003c2-9cbd-42db-aea7-577dca09af23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b19b4b5d8754ed0a6e941a216ba1b7d'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:48.495066 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-d6e003c2-9cbd-42db-aea7-577dca09af23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b19b4b5d8754ed0a6e941a216ba1b7d'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:48.571559 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 901/1811] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:43:48 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:48.577027 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-d6e003c2-9cbd-42db-aea7-577dca09af23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b19b4b5d8754ed0a6e941a216ba1b7d'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:48.578044 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4de411f-8cb0-418b-9446-558091adfe0a None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:48.581335 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-c4de411f-8cb0-418b-9446-558091adfe0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:48.610728 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 911/1812] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:43:48 2022] DELETE /identity/v3/users/2b19b4b5d8754ed0a6e941a216ba1b7d => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:43:48.613567 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90c252-2e73-46f6-9901-5ec8fd8f48a7 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:48.616229 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90c252-2e73-46f6-9901-5ec8fd8f48a7 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:48.616867 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90c252-2e73-46f6-9901-5ec8fd8f48a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:48.663015 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-fd90c252-2e73-46f6-9901-5ec8fd8f48a7 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:48.669357 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-fd90c252-2e73-46f6-9901-5ec8fd8f48a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:48.689369 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4de411f-8cb0-418b-9446-558091adfe0a None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:48.795258 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 912/1813] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:43:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:48.799845 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58108be-6503-47a6-b982-41cc5c8a79f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:48.800689 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58108be-6503-47a6-b982-41cc5c8a79f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:48.800994 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58108be-6503-47a6-b982-41cc5c8a79f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:48.801336 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58108be-6503-47a6-b982-41cc5c8a79f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:48.802368 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58108be-6503-47a6-b982-41cc5c8a79f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:48.803887 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd90c252-2e73-46f6-9901-5ec8fd8f48a7 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:48.804384 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58108be-6503-47a6-b982-41cc5c8a79f0 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:48.807328 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-fd90c252-2e73-46f6-9901-5ec8fd8f48a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:48.897082 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd90c252-2e73-46f6-9901-5ec8fd8f48a7 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:48.901451 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbf51f9-0d5e-4d4d-b696-b2a7f4383ac6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:48.902223 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf51f9-0d5e-4d4d-b696-b2a7f4383ac6 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:48.903001 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf51f9-0d5e-4d4d-b696-b2a7f4383ac6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:48.904916 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf51f9-0d5e-4d4d-b696-b2a7f4383ac6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:48.930664 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbf51f9-0d5e-4d4d-b696-b2a7f4383ac6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:48.933356 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbf51f9-0d5e-4d4d-b696-b2a7f4383ac6 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:48.945370 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 913/1814] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:43:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 16:43:48.960509 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 902/1815] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:43:48 2022] POST /identity/v3/projects => generated 365 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:43:48.961085 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbf51f9-0d5e-4d4d-b696-b2a7f4383ac6 service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:48.969934 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbf51f9-0d5e-4d4d-b696-b2a7f4383ac6 service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:49.043233 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5371fa09-f1a7-496a-b5a0-88a445445602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:49.044070 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371fa09-f1a7-496a-b5a0-88a445445602 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:49.044324 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371fa09-f1a7-496a-b5a0-88a445445602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:49.044625 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371fa09-f1a7-496a-b5a0-88a445445602 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:49.046441 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5371fa09-f1a7-496a-b5a0-88a445445602 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:49.049636 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5371fa09-f1a7-496a-b5a0-88a445445602 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:49.960479 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 914/1816] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:43:48 2022] POST /identity/v3/users => generated 289 bytes in 1005 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:43:49.964537 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58108be-6503-47a6-b982-41cc5c8a79f0 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:49.976247 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58108be-6503-47a6-b982-41cc5c8a79f0 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:49.981199 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a7b608-e22c-453f-a26c-c2e38b35837d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:49.981796 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7b608-e22c-453f-a26c-c2e38b35837d admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:49.982096 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7b608-e22c-453f-a26c-c2e38b35837d admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:49.982408 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7b608-e22c-453f-a26c-c2e38b35837d admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:49.983165 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a7b608-e22c-453f-a26c-c2e38b35837d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:49.984908 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a7b608-e22c-453f-a26c-c2e38b35837d admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:49.999598 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 903/1817] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:43:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 16:43:50.003819 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5371fa09-f1a7-496a-b5a0-88a445445602 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:50.014622 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5371fa09-f1a7-496a-b5a0-88a445445602 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:50.019617 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f225bd4-4f44-4aa1-b427-75c95a3120e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:50.020511 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f225bd4-4f44-4aa1-b427-75c95a3120e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:50.021460 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f225bd4-4f44-4aa1-b427-75c95a3120e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:50.021740 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f225bd4-4f44-4aa1-b427-75c95a3120e6 admin admin] PATH_INFO: `/v3/projects/c870ea47d94149559bb29dc4fb8a59b0/users/4f63b45b50a841fda10408df1f813be6/roles/702e5e78b5d744529384b96a390ae92f` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:50.036603 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f225bd4-4f44-4aa1-b427-75c95a3120e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c870ea47d94149559bb29dc4fb8a59b0, user_id=4f63b45b50a841fda10408df1f813be6, role_id=702e5e78b5d744529384b96a390ae92f)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:50.039248 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f225bd4-4f44-4aa1-b427-75c95a3120e6 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:50.240127 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a7b608-e22c-453f-a26c-c2e38b35837d admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:50.247067 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b8a7b608-e22c-453f-a26c-c2e38b35837d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:50.257602 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 915/1818] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:43:50 2022] PUT /identity/v3/projects/c870ea47d94149559bb29dc4fb8a59b0/users/4f63b45b50a841fda10408df1f813be6/roles/702e5e78b5d744529384b96a390ae92f => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:43:50.258739 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f225bd4-4f44-4aa1-b427-75c95a3120e6 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:50.282322 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a7b608-e22c-453f-a26c-c2e38b35837d admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:50.401717 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92315cc-9dc0-45f4-94f8-406161e779af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:50.403452 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92315cc-9dc0-45f4-94f8-406161e779af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:50.403872 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92315cc-9dc0-45f4-94f8-406161e779af admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:50.404231 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92315cc-9dc0-45f4-94f8-406161e779af admin admin] PATH_INFO: `/v3/projects/8dced273d1d2416683e6fa8bd40bd66a` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:50.405794 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92315cc-9dc0-45f4-94f8-406161e779af admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dced273d1d2416683e6fa8bd40bd66a)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:50.408650 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92315cc-9dc0-45f4-94f8-406161e779af admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:50.412091 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f225bd4-4f44-4aa1-b427-75c95a3120e6 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:50.417628 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68f9b60-9c46-42ad-8423-c395dae106e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:50.418321 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f9b60-9c46-42ad-8423-c395dae106e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:50.422917 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f9b60-9c46-42ad-8423-c395dae106e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:50.422917 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f9b60-9c46-42ad-8423-c395dae106e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:50.422917 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68f9b60-9c46-42ad-8423-c395dae106e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:50.422917 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68f9b60-9c46-42ad-8423-c395dae106e2 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:50.440416 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 916/1819] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:43:50 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 16:43:50.441763 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68f9b60-9c46-42ad-8423-c395dae106e2 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:50.453062 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68f9b60-9c46-42ad-8423-c395dae106e2 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:50.462987 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b701eb-ba97-4a62-bdcf-787bcc1eb7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:50.463093 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b701eb-ba97-4a62-bdcf-787bcc1eb7b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:50.463355 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b701eb-ba97-4a62-bdcf-787bcc1eb7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:50.463664 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b701eb-ba97-4a62-bdcf-787bcc1eb7b5 admin admin] PATH_INFO: `/v3/projects/c870ea47d94149559bb29dc4fb8a59b0/users/4f63b45b50a841fda10408df1f813be6/roles/702e5e78b5d744529384b96a390ae92f` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:50.465945 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b701eb-ba97-4a62-bdcf-787bcc1eb7b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c870ea47d94149559bb29dc4fb8a59b0, user_id=4f63b45b50a841fda10408df1f813be6, role_id=702e5e78b5d744529384b96a390ae92f)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:50.470131 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b701eb-ba97-4a62-bdcf-787bcc1eb7b5 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:50.492561 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 917/1820] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:43:50 2022] PUT /identity/v3/projects/c870ea47d94149559bb29dc4fb8a59b0/users/4f63b45b50a841fda10408df1f813be6/roles/702e5e78b5d744529384b96a390ae92f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:43:50.504337 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb0b2e-7ff4-432d-a8ca-c2caeeea2561 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:50.504693 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb0b2e-7ff4-432d-a8ca-c2caeeea2561 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:50.505572 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb0b2e-7ff4-432d-a8ca-c2caeeea2561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:50.593477 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-b4eb0b2e-7ff4-432d-a8ca-c2caeeea2561 None None] MFA Rules not processed for user `4f63b45b50a841fda10408df1f813be6`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:50.594877 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-b4eb0b2e-7ff4-432d-a8ca-c2caeeea2561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:50.597521 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-b92315cc-9dc0-45f4-94f8-406161e779af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dced273d1d2416683e6fa8bd40bd66a', 'request_id': 'req-b92315cc-9dc0-45f4-94f8-406161e779af'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:50.606005 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-b92315cc-9dc0-45f4-94f8-406161e779af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dced273d1d2416683e6fa8bd40bd66a', 'request_id': 'req-b92315cc-9dc0-45f4-94f8-406161e779af'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:50.736980 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 918/1821] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:43:50 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:50.750368 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-b92315cc-9dc0-45f4-94f8-406161e779af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dced273d1d2416683e6fa8bd40bd66a', 'request_id': 'req-b92315cc-9dc0-45f4-94f8-406161e779af'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:50.765575 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eb0b2e-7ff4-432d-a8ca-c2caeeea2561 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:50.765575 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-b4eb0b2e-7ff4-432d-a8ca-c2caeeea2561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:50.782143 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-b92315cc-9dc0-45f4-94f8-406161e779af admin admin] The token cache is being invalidate because project 8dced273d1d2416683e6fa8bd40bd66a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:43:50.782445 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-b92315cc-9dc0-45f4-94f8-406161e779af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:50.788482 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-b92315cc-9dc0-45f4-94f8-406161e779af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:50.790970 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 904/1822] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:43:50 2022] DELETE /identity/v3/projects/8dced273d1d2416683e6fa8bd40bd66a => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:43:50.796019 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b470f0c-c440-4671-87d0-f77683cbeece None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:50.796929 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b470f0c-c440-4671-87d0-f77683cbeece None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:50.797221 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b470f0c-c440-4671-87d0-f77683cbeece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:50.842764 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-7b470f0c-c440-4671-87d0-f77683cbeece None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:50.848632 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eb0b2e-7ff4-432d-a8ca-c2caeeea2561 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:50.855351 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-7b470f0c-c440-4671-87d0-f77683cbeece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:50.863622 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66dd5ad-66da-42b6-bf52-90f9bd142975 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '950b5b5f690d41509ead753065a0b793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:50.863622 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66dd5ad-66da-42b6-bf52-90f9bd142975 service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:50.863622 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66dd5ad-66da-42b6-bf52-90f9bd142975 service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:50.864146 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66dd5ad-66da-42b6-bf52-90f9bd142975 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:50.870481 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-c66dd5ad-66da-42b6-bf52-90f9bd142975 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:50.908457 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66dd5ad-66da-42b6-bf52-90f9bd142975 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:50.910028 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66dd5ad-66da-42b6-bf52-90f9bd142975 service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:50.940135 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 919/1823] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:43:50 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:43:50.983904 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 905/1824] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:43:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:50.984416 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a93006-bc87-4288-902a-bbf0ce857188 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:50.984416 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a93006-bc87-4288-902a-bbf0ce857188 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:50.984416 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a93006-bc87-4288-902a-bbf0ce857188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:51.018975 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-b1a93006-bc87-4288-902a-bbf0ce857188 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:51.020642 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-b1a93006-bc87-4288-902a-bbf0ce857188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:51.031918 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 920/1825] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:43:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:51.034945 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b470f0c-c440-4671-87d0-f77683cbeece None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:51.048259 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b470f0c-c440-4671-87d0-f77683cbeece None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:51.060642 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0531b1a1-941b-4bb9-ad3d-502004ccb049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:51.061631 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531b1a1-941b-4bb9-ad3d-502004ccb049 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:51.061927 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531b1a1-941b-4bb9-ad3d-502004ccb049 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:51.062427 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531b1a1-941b-4bb9-ad3d-502004ccb049 admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:51.066631 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0531b1a1-941b-4bb9-ad3d-502004ccb049 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:43:51.067434 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0531b1a1-941b-4bb9-ad3d-502004ccb049 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:51.070767 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0531b1a1-941b-4bb9-ad3d-502004ccb049 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:51.093591 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a93006-bc87-4288-902a-bbf0ce857188 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:51.094839 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 906/1826] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Apr 11 16:43:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:43:51.112667 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a93006-bc87-4288-902a-bbf0ce857188 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:51.123671 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d176b-c433-466a-9c91-ca26a2649c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:51.126605 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d176b-c433-466a-9c91-ca26a2649c6d admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:51.126925 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d176b-c433-466a-9c91-ca26a2649c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:51.127212 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d176b-c433-466a-9c91-ca26a2649c6d admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:51.128004 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267d176b-c433-466a-9c91-ca26a2649c6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:51.134996 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267d176b-c433-466a-9c91-ca26a2649c6d admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:51.242494 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 921/1827] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:43:51 2022] POST /identity/v3/projects => generated 381 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:43:51.247386 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0531b1a1-941b-4bb9-ad3d-502004ccb049 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:51.266652 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0531b1a1-941b-4bb9-ad3d-502004ccb049 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:51.271311 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d176b-c433-466a-9c91-ca26a2649c6d admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:51.273479 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-267d176b-c433-466a-9c91-ca26a2649c6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:51.379166 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d176b-c433-466a-9c91-ca26a2649c6d admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:51.387804 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f192b71-5cf2-483b-95f3-562ee518aed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:51.389207 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f192b71-5cf2-483b-95f3-562ee518aed8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:51.389544 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f192b71-5cf2-483b-95f3-562ee518aed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:51.390040 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f192b71-5cf2-483b-95f3-562ee518aed8 admin admin] PATH_INFO: `/v3/projects/81c88b5742f84161a7cc6dd42888872e` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:51.391771 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f192b71-5cf2-483b-95f3-562ee518aed8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81c88b5742f84161a7cc6dd42888872e)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:51.401527 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f192b71-5cf2-483b-95f3-562ee518aed8 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:51.418861 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ed7f95-82dd-4c23-a8b6-04a98279ae77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:51.419662 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed7f95-82dd-4c23-a8b6-04a98279ae77 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:51.419956 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed7f95-82dd-4c23-a8b6-04a98279ae77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:51.420237 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed7f95-82dd-4c23-a8b6-04a98279ae77 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:51.420949 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ed7f95-82dd-4c23-a8b6-04a98279ae77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:51.422933 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ed7f95-82dd-4c23-a8b6-04a98279ae77 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:51.558874 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 907/1828] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:43:51 2022] POST /identity/v3/users => generated 291 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:43:51.560936 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a4043f-7409-4696-80e3-f9c75337f69c None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:51.561436 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a4043f-7409-4696-80e3-f9c75337f69c None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:51.561893 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a4043f-7409-4696-80e3-f9c75337f69c None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:51.563532 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 908/1829] 10.222.0.43 () {54 vars in 921 bytes} [Mon Apr 11 16:43:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:43:51.564522 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a4043f-7409-4696-80e3-f9c75337f69c None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:51.580260 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a4043f-7409-4696-80e3-f9c75337f69c None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:51.586412 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0a2f1e-5c60-42ac-b3aa-63021b9a0bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:51.587118 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a2f1e-5c60-42ac-b3aa-63021b9a0bf1 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:51.587405 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a2f1e-5c60-42ac-b3aa-63021b9a0bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:51.587726 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a2f1e-5c60-42ac-b3aa-63021b9a0bf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:51.588477 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0a2f1e-5c60-42ac-b3aa-63021b9a0bf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:51.590127 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0a2f1e-5c60-42ac-b3aa-63021b9a0bf1 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:51.603651 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 909/1830] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:43:51 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:43:51.605177 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c85cb8-e150-46af-8cdd-3aefa4e0aac2 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:51.605632 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c85cb8-e150-46af-8cdd-3aefa4e0aac2 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:51.606075 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c85cb8-e150-46af-8cdd-3aefa4e0aac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:51.635355 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-d4c85cb8-e150-46af-8cdd-3aefa4e0aac2 None None] MFA Rules not processed for user `1be2652c984a4283aeee0b937f0555e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:51.636763 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-d4c85cb8-e150-46af-8cdd-3aefa4e0aac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:51.676574 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-9f192b71-5cf2-483b-95f3-562ee518aed8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81c88b5742f84161a7cc6dd42888872e', 'request_id': 'req-9f192b71-5cf2-483b-95f3-562ee518aed8'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:51.779078 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 910/1831] 10.222.0.43 () {58 vars in 1018 bytes} [Mon Apr 11 16:43:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:51.779999 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c85cb8-e150-46af-8cdd-3aefa4e0aac2 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:51.812671 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-9f192b71-5cf2-483b-95f3-562ee518aed8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81c88b5742f84161a7cc6dd42888872e', 'request_id': 'req-9f192b71-5cf2-483b-95f3-562ee518aed8'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:51.830375 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-9f192b71-5cf2-483b-95f3-562ee518aed8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81c88b5742f84161a7cc6dd42888872e', 'request_id': 'req-9f192b71-5cf2-483b-95f3-562ee518aed8'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:51.853164 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-9f192b71-5cf2-483b-95f3-562ee518aed8 admin admin] The token cache is being invalidate because project 81c88b5742f84161a7cc6dd42888872e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:43:51.853586 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-9f192b71-5cf2-483b-95f3-562ee518aed8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:51.854549 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-9f192b71-5cf2-483b-95f3-562ee518aed8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:51.860115 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 922/1832] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:43:51 2022] DELETE /identity/v3/projects/81c88b5742f84161a7cc6dd42888872e => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:43:51.863037 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f192b71-5cf2-483b-95f3-562ee518aed8 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:51.867801 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-9f192b71-5cf2-483b-95f3-562ee518aed8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:51.899084 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c85cb8-e150-46af-8cdd-3aefa4e0aac2 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:51.910059 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa9c16-db74-4eda-a3b5-0e82952a7432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:51.910759 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa9c16-db74-4eda-a3b5-0e82952a7432 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:51.918903 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa9c16-db74-4eda-a3b5-0e82952a7432 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:51.919256 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa9c16-db74-4eda-a3b5-0e82952a7432 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:51.920076 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fa9c16-db74-4eda-a3b5-0e82952a7432 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:51.924587 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fa9c16-db74-4eda-a3b5-0e82952a7432 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:51.962860 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 911/1833] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:43:51 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:43:51.970398 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa9c16-db74-4eda-a3b5-0e82952a7432 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:51.973215 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e3fa9c16-db74-4eda-a3b5-0e82952a7432 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:51.988647 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa9c16-db74-4eda-a3b5-0e82952a7432 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:51.994654 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd05cc8-a82c-491b-8484-ec753d2ff627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:51.995810 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd05cc8-a82c-491b-8484-ec753d2ff627 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:51.996094 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd05cc8-a82c-491b-8484-ec753d2ff627 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:51.996373 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd05cc8-a82c-491b-8484-ec753d2ff627 admin admin] PATH_INFO: `/v3/projects/6c67c285c48d47aebc44b240cb892772/users/dc88705f8a1a4250b0fc33f75c48f015/roles/0d41da7bec094450b5bff4e4831be52c` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:52.001388 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f192b71-5cf2-483b-95f3-562ee518aed8 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:52.011971 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91631d6e-007a-4236-a5a7-fd68ea4f27d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:52.013095 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91631d6e-007a-4236-a5a7-fd68ea4f27d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:52.013665 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91631d6e-007a-4236-a5a7-fd68ea4f27d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:52.014093 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91631d6e-007a-4236-a5a7-fd68ea4f27d3 admin admin] PATH_INFO: `/v3/users/cc369daf5e97496681bc0bd9d8306854` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:52.015727 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91631d6e-007a-4236-a5a7-fd68ea4f27d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc369daf5e97496681bc0bd9d8306854)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:52.017912 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd05cc8-a82c-491b-8484-ec753d2ff627 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c67c285c48d47aebc44b240cb892772, user_id=dc88705f8a1a4250b0fc33f75c48f015, role_id=0d41da7bec094450b5bff4e4831be52c)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:52.018564 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91631d6e-007a-4236-a5a7-fd68ea4f27d3 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:52.020833 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd05cc8-a82c-491b-8484-ec753d2ff627 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:52.198146 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 912/1834] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:43:51 2022] PUT /identity/v3/projects/6c67c285c48d47aebc44b240cb892772/users/dc88705f8a1a4250b0fc33f75c48f015/roles/0d41da7bec094450b5bff4e4831be52c => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:43:52.209037 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd05cc8-a82c-491b-8484-ec753d2ff627 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:52.209733 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-edd05cc8-a82c-491b-8484-ec753d2ff627 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:52.314403 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd05cc8-a82c-491b-8484-ec753d2ff627 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:52.315645 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-91631d6e-007a-4236-a5a7-fd68ea4f27d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc369daf5e97496681bc0bd9d8306854'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:52.322561 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0dcc89-e858-4ed1-8a08-a6d40319f290 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1be2652c984a4283aeee0b937f0555e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:52.323261 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0dcc89-e858-4ed1-8a08-a6d40319f290 service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:52.323571 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0dcc89-e858-4ed1-8a08-a6d40319f290 service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:52.323856 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0dcc89-e858-4ed1-8a08-a6d40319f290 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:52.326223 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-3d0dcc89-e858-4ed1-8a08-a6d40319f290 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:52.342334 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0dcc89-e858-4ed1-8a08-a6d40319f290 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:52.344483 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0dcc89-e858-4ed1-8a08-a6d40319f290 service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:52.359419 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 913/1835] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:43:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:43:52.369319 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be16635e-db07-44c2-aba7-46ea6c75a790 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:52.369319 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be16635e-db07-44c2-aba7-46ea6c75a790 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:52.369319 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be16635e-db07-44c2-aba7-46ea6c75a790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:52.391486 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-be16635e-db07-44c2-aba7-46ea6c75a790 None None] MFA Rules not processed for user `dc88705f8a1a4250b0fc33f75c48f015`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:52.395365 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-91631d6e-007a-4236-a5a7-fd68ea4f27d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc369daf5e97496681bc0bd9d8306854'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:52.404888 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-91631d6e-007a-4236-a5a7-fd68ea4f27d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc369daf5e97496681bc0bd9d8306854'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:52.405664 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-91631d6e-007a-4236-a5a7-fd68ea4f27d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc369daf5e97496681bc0bd9d8306854'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:52.406282 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-be16635e-db07-44c2-aba7-46ea6c75a790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:52.425308 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-91631d6e-007a-4236-a5a7-fd68ea4f27d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc369daf5e97496681bc0bd9d8306854'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:52.435497 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 923/1836] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:43:51 2022] DELETE /identity/v3/users/cc369daf5e97496681bc0bd9d8306854 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:43:52.542561 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 914/1837] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:43:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:52.546724 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91631d6e-007a-4236-a5a7-fd68ea4f27d3 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:52.548557 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-91631d6e-007a-4236-a5a7-fd68ea4f27d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:52.751783 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91631d6e-007a-4236-a5a7-fd68ea4f27d3 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:52.759212 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca38978e-dad2-4e55-8990-af5d377ac6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:52.759943 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38978e-dad2-4e55-8990-af5d377ac6aa admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:52.760230 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38978e-dad2-4e55-8990-af5d377ac6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:52.760508 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38978e-dad2-4e55-8990-af5d377ac6aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:52.776049 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca38978e-dad2-4e55-8990-af5d377ac6aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:52.777980 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca38978e-dad2-4e55-8990-af5d377ac6aa admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:52.945343 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 924/1838] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:43:52 2022] POST /identity/v3/projects => generated 381 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:43:52.945860 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be16635e-db07-44c2-aba7-46ea6c75a790 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:53.037224 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be16635e-db07-44c2-aba7-46ea6c75a790 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:53.091946 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c95ee3c-35f7-4d2b-81ca-1fae31fb2e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:53.092546 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95ee3c-35f7-4d2b-81ca-1fae31fb2e10 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:53.092829 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95ee3c-35f7-4d2b-81ca-1fae31fb2e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:53.093105 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95ee3c-35f7-4d2b-81ca-1fae31fb2e10 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:53.093801 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c95ee3c-35f7-4d2b-81ca-1fae31fb2e10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:53.095739 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c95ee3c-35f7-4d2b-81ca-1fae31fb2e10 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:53.174122 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca38978e-dad2-4e55-8990-af5d377ac6aa admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:53.178684 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-ca38978e-dad2-4e55-8990-af5d377ac6aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:53.194327 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 915/1839] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:43:52 2022] POST /identity/v3/users => generated 297 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:43:53.198344 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c95ee3c-35f7-4d2b-81ca-1fae31fb2e10 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:53.205296 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca38978e-dad2-4e55-8990-af5d377ac6aa admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:53.211690 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5114391f-76c4-4e44-bf53-03e2d7d7970d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:53.213115 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5114391f-76c4-4e44-bf53-03e2d7d7970d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:53.213579 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5114391f-76c4-4e44-bf53-03e2d7d7970d admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:53.214032 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5114391f-76c4-4e44-bf53-03e2d7d7970d admin admin] PATH_INFO: `/v3/users/22263fa3edfb4add868a68e25568ca2d` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:53.215763 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c95ee3c-35f7-4d2b-81ca-1fae31fb2e10 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:53.216414 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5114391f-76c4-4e44-bf53-03e2d7d7970d admin admin] RBAC: Authorizing `identity:delete_user(user_id=22263fa3edfb4add868a68e25568ca2d)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:53.226744 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5114391f-76c4-4e44-bf53-03e2d7d7970d admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:53.231138 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1837c5ee-04c8-4226-a27d-4de77bbb8a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:53.231884 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1837c5ee-04c8-4226-a27d-4de77bbb8a8e admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:53.232173 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1837c5ee-04c8-4226-a27d-4de77bbb8a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:53.232459 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1837c5ee-04c8-4226-a27d-4de77bbb8a8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:53.233204 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1837c5ee-04c8-4226-a27d-4de77bbb8a8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:53.234963 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1837c5ee-04c8-4226-a27d-4de77bbb8a8e admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:53.247167 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 916/1840] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:43:53 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:43:53.252849 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1837c5ee-04c8-4226-a27d-4de77bbb8a8e admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:53.278104 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1837c5ee-04c8-4226-a27d-4de77bbb8a8e admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:53.290990 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6e6638-ffbe-42ae-9975-4977a63603f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:53.291992 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e6638-ffbe-42ae-9975-4977a63603f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:53.292285 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e6638-ffbe-42ae-9975-4977a63603f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:53.292621 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e6638-ffbe-42ae-9975-4977a63603f5 admin admin] PATH_INFO: `/v3/projects/58c50b82e7fa4d29a7c2c69895fdf842/users/5600470cf92c4d5287ee3a91bdb212ae/roles/702e5e78b5d744529384b96a390ae92f` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:53.313231 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6e6638-ffbe-42ae-9975-4977a63603f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58c50b82e7fa4d29a7c2c69895fdf842, user_id=5600470cf92c4d5287ee3a91bdb212ae, role_id=702e5e78b5d744529384b96a390ae92f)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:53.317020 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6e6638-ffbe-42ae-9975-4977a63603f5 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:53.450241 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 917/1841] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:43:53 2022] PUT /identity/v3/projects/58c50b82e7fa4d29a7c2c69895fdf842/users/5600470cf92c4d5287ee3a91bdb212ae/roles/702e5e78b5d744529384b96a390ae92f => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:43:53.455118 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6e6638-ffbe-42ae-9975-4977a63603f5 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:53.504211 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-5114391f-76c4-4e44-bf53-03e2d7d7970d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22263fa3edfb4add868a68e25568ca2d'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:53.595335 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-5114391f-76c4-4e44-bf53-03e2d7d7970d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22263fa3edfb4add868a68e25568ca2d'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:53.605856 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-5114391f-76c4-4e44-bf53-03e2d7d7970d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22263fa3edfb4add868a68e25568ca2d'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:53.607690 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-5114391f-76c4-4e44-bf53-03e2d7d7970d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22263fa3edfb4add868a68e25568ca2d'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:53.610542 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6e6638-ffbe-42ae-9975-4977a63603f5 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:53.615699 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736fca23-a446-41a2-8a16-6910c97905bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:53.616396 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736fca23-a446-41a2-8a16-6910c97905bf admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:53.616686 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736fca23-a446-41a2-8a16-6910c97905bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:53.617087 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736fca23-a446-41a2-8a16-6910c97905bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:53.617820 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736fca23-a446-41a2-8a16-6910c97905bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:53.619491 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736fca23-a446-41a2-8a16-6910c97905bf admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:53.631409 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 918/1842] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:43:53 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 16:43:53.636008 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736fca23-a446-41a2-8a16-6910c97905bf admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:53.637469 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-5114391f-76c4-4e44-bf53-03e2d7d7970d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22263fa3edfb4add868a68e25568ca2d'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:53.638259 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-736fca23-a446-41a2-8a16-6910c97905bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:53.651050 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 925/1843] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:43:53 2022] DELETE /identity/v3/users/22263fa3edfb4add868a68e25568ca2d => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:43:53.654357 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736fca23-a446-41a2-8a16-6910c97905bf admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:53.656885 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe619d-9bfe-4176-87f5-5bdb21ac6780 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:53.663139 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe619d-9bfe-4176-87f5-5bdb21ac6780 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:53.663428 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe619d-9bfe-4176-87f5-5bdb21ac6780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:53.707780 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-dcfe619d-9bfe-4176-87f5-5bdb21ac6780 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:53.711061 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-dcfe619d-9bfe-4176-87f5-5bdb21ac6780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:53.792022 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c66a5e6-8d5e-4433-bfcf-d34b18216152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:53.793329 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66a5e6-8d5e-4433-bfcf-d34b18216152 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:53.793872 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66a5e6-8d5e-4433-bfcf-d34b18216152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:53.794348 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66a5e6-8d5e-4433-bfcf-d34b18216152 admin admin] PATH_INFO: `/v3/projects/58c50b82e7fa4d29a7c2c69895fdf842/users/5600470cf92c4d5287ee3a91bdb212ae/roles/702e5e78b5d744529384b96a390ae92f` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:53.797874 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c66a5e6-8d5e-4433-bfcf-d34b18216152 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58c50b82e7fa4d29a7c2c69895fdf842, user_id=5600470cf92c4d5287ee3a91bdb212ae, role_id=702e5e78b5d744529384b96a390ae92f)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:53.801288 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c66a5e6-8d5e-4433-bfcf-d34b18216152 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:53.811329 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 926/1844] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:43:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:43:53.812393 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfe619d-9bfe-4176-87f5-5bdb21ac6780 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:53.815420 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-dcfe619d-9bfe-4176-87f5-5bdb21ac6780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:53.815576 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 919/1845] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:43:53 2022] PUT /identity/v3/projects/58c50b82e7fa4d29a7c2c69895fdf842/users/5600470cf92c4d5287ee3a91bdb212ae/roles/702e5e78b5d744529384b96a390ae92f => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:43:53.817623 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c66a5e6-8d5e-4433-bfcf-d34b18216152 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:53.819427 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-6c66a5e6-8d5e-4433-bfcf-d34b18216152 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:53.840305 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfe619d-9bfe-4176-87f5-5bdb21ac6780 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:53.908158 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c66a5e6-8d5e-4433-bfcf-d34b18216152 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:53.913838 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7c2922-874a-4156-82c1-8fc74bf84ed4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:53.914494 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c2922-874a-4156-82c1-8fc74bf84ed4 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:53.915540 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c2922-874a-4156-82c1-8fc74bf84ed4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:53.915540 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c2922-874a-4156-82c1-8fc74bf84ed4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:53.966525 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d959d9-b1be-46d3-8bf7-38f3ccfcb202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:53.968472 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d959d9-b1be-46d3-8bf7-38f3ccfcb202 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:53.968472 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d959d9-b1be-46d3-8bf7-38f3ccfcb202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:53.968472 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d959d9-b1be-46d3-8bf7-38f3ccfcb202 admin admin] PATH_INFO: `/v3/projects/4c40321f3d61476ab75058707791d3b7` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:53.970050 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d959d9-b1be-46d3-8bf7-38f3ccfcb202 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c40321f3d61476ab75058707791d3b7)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:53.973171 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d959d9-b1be-46d3-8bf7-38f3ccfcb202 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:54.018330 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7c2922-874a-4156-82c1-8fc74bf84ed4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:54.019949 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7c2922-874a-4156-82c1-8fc74bf84ed4 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:54.031071 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 920/1846] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:43:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:43:54.032170 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e310ae5-6bfd-4702-9b00-e685fa84315e None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:54.032466 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e310ae5-6bfd-4702-9b00-e685fa84315e None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:54.032816 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e310ae5-6bfd-4702-9b00-e685fa84315e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:54.067986 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-0e310ae5-6bfd-4702-9b00-e685fa84315e None None] MFA Rules not processed for user `5600470cf92c4d5287ee3a91bdb212ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:54.067986 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0e310ae5-6bfd-4702-9b00-e685fa84315e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:54.150364 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 921/1847] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:43:54 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:54.153083 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-95d959d9-b1be-46d3-8bf7-38f3ccfcb202 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c40321f3d61476ab75058707791d3b7', 'request_id': 'req-95d959d9-b1be-46d3-8bf7-38f3ccfcb202'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:54.164517 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e310ae5-6bfd-4702-9b00-e685fa84315e None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:54.166099 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0e310ae5-6bfd-4702-9b00-e685fa84315e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:54.222466 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e310ae5-6bfd-4702-9b00-e685fa84315e None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:54.276759 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a469239-9e94-4a0d-b032-42687521c7e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '950b5b5f690d41509ead753065a0b793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:54.277789 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a469239-9e94-4a0d-b032-42687521c7e4 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:54.278079 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a469239-9e94-4a0d-b032-42687521c7e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:54.278358 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a469239-9e94-4a0d-b032-42687521c7e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:54.320554 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-95d959d9-b1be-46d3-8bf7-38f3ccfcb202 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c40321f3d61476ab75058707791d3b7', 'request_id': 'req-95d959d9-b1be-46d3-8bf7-38f3ccfcb202'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:54.320554 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-95d959d9-b1be-46d3-8bf7-38f3ccfcb202 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c40321f3d61476ab75058707791d3b7', 'request_id': 'req-95d959d9-b1be-46d3-8bf7-38f3ccfcb202'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:54.334612 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-95d959d9-b1be-46d3-8bf7-38f3ccfcb202 admin admin] The token cache is being invalidate because project 4c40321f3d61476ab75058707791d3b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:43:54.335795 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-95d959d9-b1be-46d3-8bf7-38f3ccfcb202 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:54.336718 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-95d959d9-b1be-46d3-8bf7-38f3ccfcb202 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:54.339241 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 927/1848] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:43:53 2022] DELETE /identity/v3/projects/4c40321f3d61476ab75058707791d3b7 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:43:54.344566 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b27df5f-a1c3-49cb-836d-c40b8b23b8b4 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:54.345556 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b27df5f-a1c3-49cb-836d-c40b8b23b8b4 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:54.346043 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b27df5f-a1c3-49cb-836d-c40b8b23b8b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:54.372828 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a469239-9e94-4a0d-b032-42687521c7e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:54.372828 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a469239-9e94-4a0d-b032-42687521c7e4 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:54.373589 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-7b27df5f-a1c3-49cb-836d-c40b8b23b8b4 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:54.375903 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-7b27df5f-a1c3-49cb-836d-c40b8b23b8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:54.384099 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 922/1849] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:43:54 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 16:43:54.471606 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 928/1850] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:43:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:43:54.480656 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eaee86-f10f-4381-bb23-4e965f49fc7f None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:54.480865 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eaee86-f10f-4381-bb23-4e965f49fc7f None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:54.481141 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eaee86-f10f-4381-bb23-4e965f49fc7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:54.504666 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-12eaee86-f10f-4381-bb23-4e965f49fc7f None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:54.506370 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-12eaee86-f10f-4381-bb23-4e965f49fc7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:54.519690 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 923/1851] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:43:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:54.520584 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b27df5f-a1c3-49cb-836d-c40b8b23b8b4 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:54.535831 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b27df5f-a1c3-49cb-836d-c40b8b23b8b4 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:54.542850 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fc3d6b-a533-446a-acb1-7251cd858326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:54.544294 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc3d6b-a533-446a-acb1-7251cd858326 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:54.546556 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc3d6b-a533-446a-acb1-7251cd858326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:54.547121 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc3d6b-a533-446a-acb1-7251cd858326 admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:54.548199 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fc3d6b-a533-446a-acb1-7251cd858326 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:43:54.548724 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fc3d6b-a533-446a-acb1-7251cd858326 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:54.550907 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fc3d6b-a533-446a-acb1-7251cd858326 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:54.570035 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eaee86-f10f-4381-bb23-4e965f49fc7f None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:54.576719 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 929/1852] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Apr 11 16:43:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:43:54.580376 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eaee86-f10f-4381-bb23-4e965f49fc7f None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:54.591006 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280baffb-68b7-489f-97cc-bf228016a391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:54.592467 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280baffb-68b7-489f-97cc-bf228016a391 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:54.595730 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280baffb-68b7-489f-97cc-bf228016a391 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:54.595730 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280baffb-68b7-489f-97cc-bf228016a391 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:54.595730 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280baffb-68b7-489f-97cc-bf228016a391 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:54.596226 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280baffb-68b7-489f-97cc-bf228016a391 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:54.627480 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fc3d6b-a533-446a-acb1-7251cd858326 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:54.627480 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-c4fc3d6b-a533-446a-acb1-7251cd858326 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:54.645304 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fc3d6b-a533-446a-acb1-7251cd858326 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:54.650948 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7c4cf0-31ba-48e6-880a-600901ada087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:54.655606 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c4cf0-31ba-48e6-880a-600901ada087 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:54.655606 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c4cf0-31ba-48e6-880a-600901ada087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:54.655606 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c4cf0-31ba-48e6-880a-600901ada087 admin admin] PATH_INFO: `/v3/projects/1cae5d9ac9f84945bed77e4ff2d64df9` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:54.655606 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7c4cf0-31ba-48e6-880a-600901ada087 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cae5d9ac9f84945bed77e4ff2d64df9)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:54.656184 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7c4cf0-31ba-48e6-880a-600901ada087 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:54.752178 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 924/1853] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:43:54 2022] POST /identity/v3/projects => generated 379 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:43:54.756906 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280baffb-68b7-489f-97cc-bf228016a391 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:54.823894 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-3f7c4cf0-31ba-48e6-880a-600901ada087 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cae5d9ac9f84945bed77e4ff2d64df9', 'request_id': 'req-3f7c4cf0-31ba-48e6-880a-600901ada087'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:54.853011 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280baffb-68b7-489f-97cc-bf228016a391 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:54.925378 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d446ae59-cacc-47da-b7fa-248200aa30a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:54.926068 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446ae59-cacc-47da-b7fa-248200aa30a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:54.926364 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446ae59-cacc-47da-b7fa-248200aa30a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:54.926674 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446ae59-cacc-47da-b7fa-248200aa30a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:54.927541 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d446ae59-cacc-47da-b7fa-248200aa30a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:54.929679 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d446ae59-cacc-47da-b7fa-248200aa30a4 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:54.939206 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-3f7c4cf0-31ba-48e6-880a-600901ada087 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cae5d9ac9f84945bed77e4ff2d64df9', 'request_id': 'req-3f7c4cf0-31ba-48e6-880a-600901ada087'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:54.946152 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-3f7c4cf0-31ba-48e6-880a-600901ada087 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cae5d9ac9f84945bed77e4ff2d64df9', 'request_id': 'req-3f7c4cf0-31ba-48e6-880a-600901ada087'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:54.961322 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-3f7c4cf0-31ba-48e6-880a-600901ada087 admin admin] The token cache is being invalidate because project 1cae5d9ac9f84945bed77e4ff2d64df9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:43:54.961616 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-3f7c4cf0-31ba-48e6-880a-600901ada087 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:54.965112 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-3f7c4cf0-31ba-48e6-880a-600901ada087 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:54.967199 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 930/1854] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:43:54 2022] DELETE /identity/v3/projects/1cae5d9ac9f84945bed77e4ff2d64df9 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:43:54.967866 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7c4cf0-31ba-48e6-880a-600901ada087 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:54.969474 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-3f7c4cf0-31ba-48e6-880a-600901ada087 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:55.049945 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 925/1855] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:43:54 2022] POST /identity/v3/users => generated 290 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:43:55.049945 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d446ae59-cacc-47da-b7fa-248200aa30a4 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:55.056242 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-d446ae59-cacc-47da-b7fa-248200aa30a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:55.075256 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d446ae59-cacc-47da-b7fa-248200aa30a4 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:55.082383 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187543ed-10d2-459f-9d1f-b0b725dd6de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:55.084912 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187543ed-10d2-459f-9d1f-b0b725dd6de6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:55.086299 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187543ed-10d2-459f-9d1f-b0b725dd6de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:55.086773 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187543ed-10d2-459f-9d1f-b0b725dd6de6 admin admin] PATH_INFO: `/v3/users/4f63b45b50a841fda10408df1f813be6` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:55.088345 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187543ed-10d2-459f-9d1f-b0b725dd6de6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f63b45b50a841fda10408df1f813be6)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:55.092781 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7c4cf0-31ba-48e6-880a-600901ada087 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:55.093976 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187543ed-10d2-459f-9d1f-b0b725dd6de6 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:55.099776 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49341426-5d3e-46a1-8420-51e8247c1cc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '950b5b5f690d41509ead753065a0b793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:55.100656 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49341426-5d3e-46a1-8420-51e8247c1cc8 service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:55.101026 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49341426-5d3e-46a1-8420-51e8247c1cc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:55.102105 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49341426-5d3e-46a1-8420-51e8247c1cc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:55.104650 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-49341426-5d3e-46a1-8420-51e8247c1cc8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:55.190011 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49341426-5d3e-46a1-8420-51e8247c1cc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:55.191947 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49341426-5d3e-46a1-8420-51e8247c1cc8 service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:55.205930 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 931/1856] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:43:54 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:43:55.206896 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49341426-5d3e-46a1-8420-51e8247c1cc8 service cinder] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:55.209886 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-49341426-5d3e-46a1-8420-51e8247c1cc8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:55.236821 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49341426-5d3e-46a1-8420-51e8247c1cc8 service cinder] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:55.243358 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfb1d70-bec1-4def-8436-85c6b34b5624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:55.244308 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb1d70-bec1-4def-8436-85c6b34b5624 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:55.244795 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb1d70-bec1-4def-8436-85c6b34b5624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:55.245256 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb1d70-bec1-4def-8436-85c6b34b5624 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:55.249205 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfb1d70-bec1-4def-8436-85c6b34b5624 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:55.249205 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfb1d70-bec1-4def-8436-85c6b34b5624 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:55.267548 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 932/1857] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:43:55 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:43:55.269550 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfb1d70-bec1-4def-8436-85c6b34b5624 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:55.282345 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfb1d70-bec1-4def-8436-85c6b34b5624 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:55.292194 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95caf0e5-a730-4041-b6a3-e205caf154fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:55.293136 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95caf0e5-a730-4041-b6a3-e205caf154fe admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:55.293431 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95caf0e5-a730-4041-b6a3-e205caf154fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:55.295234 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95caf0e5-a730-4041-b6a3-e205caf154fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:55.295234 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95caf0e5-a730-4041-b6a3-e205caf154fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:55.296072 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95caf0e5-a730-4041-b6a3-e205caf154fe admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:55.317141 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 933/1858] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:43:55 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:43:55.321863 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95caf0e5-a730-4041-b6a3-e205caf154fe admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:55.333153 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95caf0e5-a730-4041-b6a3-e205caf154fe admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:55.338505 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4463830-7262-4721-a0a7-67eeb5411032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:55.339258 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4463830-7262-4721-a0a7-67eeb5411032 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:55.339699 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4463830-7262-4721-a0a7-67eeb5411032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:55.340419 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4463830-7262-4721-a0a7-67eeb5411032 admin admin] PATH_INFO: `/v3/projects/2a856c2cdc074d76b58244b124b29df6/users/5c67c991f38744578faedcf3a9badf4b/roles/0d41da7bec094450b5bff4e4831be52c` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:55.358801 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4463830-7262-4721-a0a7-67eeb5411032 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a856c2cdc074d76b58244b124b29df6, user_id=5c67c991f38744578faedcf3a9badf4b, role_id=0d41da7bec094450b5bff4e4831be52c)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:55.360730 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4463830-7262-4721-a0a7-67eeb5411032 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:55.369858 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-187543ed-10d2-459f-9d1f-b0b725dd6de6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f63b45b50a841fda10408df1f813be6'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:55.370533 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-187543ed-10d2-459f-9d1f-b0b725dd6de6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f63b45b50a841fda10408df1f813be6'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:55.462321 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-187543ed-10d2-459f-9d1f-b0b725dd6de6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f63b45b50a841fda10408df1f813be6'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:55.477535 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 934/1859] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:43:55 2022] PUT /identity/v3/projects/2a856c2cdc074d76b58244b124b29df6/users/5c67c991f38744578faedcf3a9badf4b/roles/0d41da7bec094450b5bff4e4831be52c => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:43:55.479167 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8641fd4-68e0-47d0-896c-ce3571156419 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:55.479167 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8641fd4-68e0-47d0-896c-ce3571156419 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:55.485875 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8641fd4-68e0-47d0-896c-ce3571156419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:55.491595 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-187543ed-10d2-459f-9d1f-b0b725dd6de6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f63b45b50a841fda10408df1f813be6'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:55.519997 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-f8641fd4-68e0-47d0-896c-ce3571156419 None None] MFA Rules not processed for user `5c67c991f38744578faedcf3a9badf4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:55.522668 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-f8641fd4-68e0-47d0-896c-ce3571156419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:55.525724 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-187543ed-10d2-459f-9d1f-b0b725dd6de6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f63b45b50a841fda10408df1f813be6'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:55.538262 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 926/1860] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:43:55 2022] DELETE /identity/v3/users/4f63b45b50a841fda10408df1f813be6 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:43:55.538990 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187543ed-10d2-459f-9d1f-b0b725dd6de6 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:55.548289 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-187543ed-10d2-459f-9d1f-b0b725dd6de6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:55.619043 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 935/1861] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:43:55 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:55.622643 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8641fd4-68e0-47d0-896c-ce3571156419 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:55.624083 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-f8641fd4-68e0-47d0-896c-ce3571156419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:55.652149 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187543ed-10d2-459f-9d1f-b0b725dd6de6 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:55.660691 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa281d-0f1c-4920-af09-fc7e78547409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:55.663927 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa281d-0f1c-4920-af09-fc7e78547409 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:55.664106 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa281d-0f1c-4920-af09-fc7e78547409 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:55.664394 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa281d-0f1c-4920-af09-fc7e78547409 admin admin] PATH_INFO: `/v3/users/ceb3e65894e84db8bf10460ae56344d0` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:55.665756 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafa281d-0f1c-4920-af09-fc7e78547409 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ceb3e65894e84db8bf10460ae56344d0)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:55.668416 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafa281d-0f1c-4920-af09-fc7e78547409 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:55.720978 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8641fd4-68e0-47d0-896c-ce3571156419 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:55.743016 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd7f72-3aee-4e4e-9719-dbcdd0e76dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:55.743707 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd7f72-3aee-4e4e-9719-dbcdd0e76dbd admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:55.743995 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd7f72-3aee-4e4e-9719-dbcdd0e76dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:55.744276 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd7f72-3aee-4e4e-9719-dbcdd0e76dbd admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:55.745651 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bd7f72-3aee-4e4e-9719-dbcdd0e76dbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:55.748387 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bd7f72-3aee-4e4e-9719-dbcdd0e76dbd admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:55.954363 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 936/1862] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:43:55 2022] POST /identity/v3/projects => generated 379 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:43:55.958311 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd7f72-3aee-4e4e-9719-dbcdd0e76dbd admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:55.962208 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-aafa281d-0f1c-4920-af09-fc7e78547409 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ceb3e65894e84db8bf10460ae56344d0'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:55.964911 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-aafa281d-0f1c-4920-af09-fc7e78547409 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ceb3e65894e84db8bf10460ae56344d0'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:56.034594 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd7f72-3aee-4e4e-9719-dbcdd0e76dbd admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:56.040724 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bc4794-8d5e-4d3b-9d21-54a20daaa5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:56.041665 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc4794-8d5e-4d3b-9d21-54a20daaa5b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:56.041956 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc4794-8d5e-4d3b-9d21-54a20daaa5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:56.042401 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc4794-8d5e-4d3b-9d21-54a20daaa5b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:56.043274 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bc4794-8d5e-4d3b-9d21-54a20daaa5b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:56.045303 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bc4794-8d5e-4d3b-9d21-54a20daaa5b9 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:56.095914 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-aafa281d-0f1c-4920-af09-fc7e78547409 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ceb3e65894e84db8bf10460ae56344d0'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:56.105449 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-aafa281d-0f1c-4920-af09-fc7e78547409 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ceb3e65894e84db8bf10460ae56344d0'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:56.118746 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-aafa281d-0f1c-4920-af09-fc7e78547409 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ceb3e65894e84db8bf10460ae56344d0'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:56.126335 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 927/1863] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:43:55 2022] DELETE /identity/v3/users/ceb3e65894e84db8bf10460ae56344d0 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:43:56.130811 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa281d-0f1c-4920-af09-fc7e78547409 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:56.133059 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-aafa281d-0f1c-4920-af09-fc7e78547409 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:56.171476 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 937/1864] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:43:55 2022] POST /identity/v3/users => generated 296 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:43:56.173480 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb9b6d7-21e3-4c60-b450-6a43bf1248ca None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:56.174201 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb9b6d7-21e3-4c60-b450-6a43bf1248ca None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:56.174711 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb9b6d7-21e3-4c60-b450-6a43bf1248ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:56.197010 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-ccb9b6d7-21e3-4c60-b450-6a43bf1248ca None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:56.197010 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-ccb9b6d7-21e3-4c60-b450-6a43bf1248ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:56.204314 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 938/1865] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:43:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:56.205276 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb9b6d7-21e3-4c60-b450-6a43bf1248ca None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:56.208002 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa281d-0f1c-4920-af09-fc7e78547409 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:56.213122 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2384863-6f76-4236-a4ab-0161d37af5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:56.213768 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-ccb9b6d7-21e3-4c60-b450-6a43bf1248ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:56.214176 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2384863-6f76-4236-a4ab-0161d37af5b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:56.214979 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2384863-6f76-4236-a4ab-0161d37af5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:56.215271 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2384863-6f76-4236-a4ab-0161d37af5b3 admin admin] PATH_INFO: `/v3/users/dc88705f8a1a4250b0fc33f75c48f015` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:56.216899 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2384863-6f76-4236-a4ab-0161d37af5b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc88705f8a1a4250b0fc33f75c48f015)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:56.218908 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2384863-6f76-4236-a4ab-0161d37af5b3 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:56.226379 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb9b6d7-21e3-4c60-b450-6a43bf1248ca None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:56.231033 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eb0a85-bd05-4c6e-9a71-fb032469fcaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:56.231735 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb0a85-bd05-4c6e-9a71-fb032469fcaf admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:56.232017 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb0a85-bd05-4c6e-9a71-fb032469fcaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:56.232292 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb0a85-bd05-4c6e-9a71-fb032469fcaf admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:56.233020 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eb0a85-bd05-4c6e-9a71-fb032469fcaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:56.234630 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eb0a85-bd05-4c6e-9a71-fb032469fcaf admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:56.245540 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 939/1866] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:43:56 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:43:56.246592 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eb0a85-bd05-4c6e-9a71-fb032469fcaf admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:56.248342 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-37eb0a85-bd05-4c6e-9a71-fb032469fcaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:56.319140 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eb0a85-bd05-4c6e-9a71-fb032469fcaf admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:56.322881 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1975afae-3b27-4c07-9491-fec3f3817536 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:56.323570 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1975afae-3b27-4c07-9491-fec3f3817536 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:56.323887 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1975afae-3b27-4c07-9491-fec3f3817536 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:56.324163 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1975afae-3b27-4c07-9491-fec3f3817536 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:56.338944 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1975afae-3b27-4c07-9491-fec3f3817536 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:56.340436 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1975afae-3b27-4c07-9491-fec3f3817536 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:56.354736 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 940/1867] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:43:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:43:56.356244 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1975afae-3b27-4c07-9491-fec3f3817536 service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:56.375238 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1975afae-3b27-4c07-9491-fec3f3817536 service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:56.376066 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d73e749-e15e-4b26-aa0e-3f2e43e7c870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:56.376970 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73e749-e15e-4b26-aa0e-3f2e43e7c870 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:56.377251 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73e749-e15e-4b26-aa0e-3f2e43e7c870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:56.378803 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73e749-e15e-4b26-aa0e-3f2e43e7c870 admin admin] PATH_INFO: `/v3/projects/3f4b6d7fda0746748b525bf401ed2e89/users/5e0f245b3a894fefa911bb63f94ac5b4/roles/702e5e78b5d744529384b96a390ae92f` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:56.393039 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d73e749-e15e-4b26-aa0e-3f2e43e7c870 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f4b6d7fda0746748b525bf401ed2e89, user_id=5e0f245b3a894fefa911bb63f94ac5b4, role_id=702e5e78b5d744529384b96a390ae92f)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:56.396630 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d73e749-e15e-4b26-aa0e-3f2e43e7c870 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:56.446699 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-d2384863-6f76-4236-a4ab-0161d37af5b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc88705f8a1a4250b0fc33f75c48f015'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:56.447508 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-d2384863-6f76-4236-a4ab-0161d37af5b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc88705f8a1a4250b0fc33f75c48f015'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:56.515637 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 941/1868] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:43:56 2022] PUT /identity/v3/projects/3f4b6d7fda0746748b525bf401ed2e89/users/5e0f245b3a894fefa911bb63f94ac5b4/roles/702e5e78b5d744529384b96a390ae92f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:43:56.516389 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d73e749-e15e-4b26-aa0e-3f2e43e7c870 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:56.518032 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-2d73e749-e15e-4b26-aa0e-3f2e43e7c870 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:56.547831 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-d2384863-6f76-4236-a4ab-0161d37af5b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc88705f8a1a4250b0fc33f75c48f015'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:56.558120 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-d2384863-6f76-4236-a4ab-0161d37af5b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc88705f8a1a4250b0fc33f75c48f015'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:56.577695 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-d2384863-6f76-4236-a4ab-0161d37af5b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc88705f8a1a4250b0fc33f75c48f015'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:56.587196 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 928/1869] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:43:56 2022] DELETE /identity/v3/users/dc88705f8a1a4250b0fc33f75c48f015 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:43:56.589054 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328431b-2259-40ff-8de7-bdd349725ee4 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:56.589344 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328431b-2259-40ff-8de7-bdd349725ee4 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:56.589629 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328431b-2259-40ff-8de7-bdd349725ee4 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:56.593327 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 929/1870] 10.222.0.43 () {54 vars in 921 bytes} [Mon Apr 11 16:43:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:43:56.594688 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b328431b-2259-40ff-8de7-bdd349725ee4 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:56.596563 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b328431b-2259-40ff-8de7-bdd349725ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:56.614922 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d73e749-e15e-4b26-aa0e-3f2e43e7c870 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:56.676000 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b328431b-2259-40ff-8de7-bdd349725ee4 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:56.681110 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed156b38-2e04-4442-826f-5817dcded7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:56.681791 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed156b38-2e04-4442-826f-5817dcded7b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:56.682070 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed156b38-2e04-4442-826f-5817dcded7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:56.682507 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed156b38-2e04-4442-826f-5817dcded7b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:56.683249 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed156b38-2e04-4442-826f-5817dcded7b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:56.684881 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed156b38-2e04-4442-826f-5817dcded7b0 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:56.688836 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5206d4c-f172-49b6-8cbd-0d09270df811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:56.689811 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5206d4c-f172-49b6-8cbd-0d09270df811 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:56.690173 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5206d4c-f172-49b6-8cbd-0d09270df811 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:56.690525 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5206d4c-f172-49b6-8cbd-0d09270df811 admin admin] PATH_INFO: `/v3/projects/c870ea47d94149559bb29dc4fb8a59b0` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:56.691905 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5206d4c-f172-49b6-8cbd-0d09270df811 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c870ea47d94149559bb29dc4fb8a59b0)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:56.695197 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5206d4c-f172-49b6-8cbd-0d09270df811 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:56.699353 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 930/1871] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:43:56 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:43:56.701605 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c43a6-b190-4eb2-9a42-eb1e808c9ae8 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:56.701906 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c43a6-b190-4eb2-9a42-eb1e808c9ae8 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:56.702195 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c43a6-b190-4eb2-9a42-eb1e808c9ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:56.723590 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-427c43a6-b190-4eb2-9a42-eb1e808c9ae8 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:56.725065 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-427c43a6-b190-4eb2-9a42-eb1e808c9ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:56.733996 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 931/1872] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:43:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:56.735671 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1116cd28-b1c5-4ce3-a863-e5d91a0fd9b5 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:56.735966 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1116cd28-b1c5-4ce3-a863-e5d91a0fd9b5 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:56.736245 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1116cd28-b1c5-4ce3-a863-e5d91a0fd9b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:56.756457 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-1116cd28-b1c5-4ce3-a863-e5d91a0fd9b5 None None] MFA Rules not processed for user `1be2652c984a4283aeee0b937f0555e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:56.757768 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-1116cd28-b1c5-4ce3-a863-e5d91a0fd9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:56.823559 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 932/1873] 10.222.0.43 () {58 vars in 1018 bytes} [Mon Apr 11 16:43:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:56.824384 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1116cd28-b1c5-4ce3-a863-e5d91a0fd9b5 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:56.835086 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1116cd28-b1c5-4ce3-a863-e5d91a0fd9b5 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:56.839784 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292f362b-c3cf-47ea-a5f6-33dde8e5d2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:56.840697 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f362b-c3cf-47ea-a5f6-33dde8e5d2a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:56.840985 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f362b-c3cf-47ea-a5f6-33dde8e5d2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:56.841264 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f362b-c3cf-47ea-a5f6-33dde8e5d2a6 admin admin] PATH_INFO: `/v3/projects/3f4b6d7fda0746748b525bf401ed2e89/users/5e0f245b3a894fefa911bb63f94ac5b4/roles/702e5e78b5d744529384b96a390ae92f` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:56.843279 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292f362b-c3cf-47ea-a5f6-33dde8e5d2a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f4b6d7fda0746748b525bf401ed2e89, user_id=5e0f245b3a894fefa911bb63f94ac5b4, role_id=702e5e78b5d744529384b96a390ae92f)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:56.845974 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292f362b-c3cf-47ea-a5f6-33dde8e5d2a6 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:56.857108 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 933/1874] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:43:56 2022] PUT /identity/v3/projects/3f4b6d7fda0746748b525bf401ed2e89/users/5e0f245b3a894fefa911bb63f94ac5b4/roles/702e5e78b5d744529384b96a390ae92f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:43:56.857494 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b5206d4c-f172-49b6-8cbd-0d09270df811 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c870ea47d94149559bb29dc4fb8a59b0', 'request_id': 'req-b5206d4c-f172-49b6-8cbd-0d09270df811'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:56.857936 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292f362b-c3cf-47ea-a5f6-33dde8e5d2a6 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:56.859736 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-292f362b-c3cf-47ea-a5f6-33dde8e5d2a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:56.920675 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292f362b-c3cf-47ea-a5f6-33dde8e5d2a6 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:56.924464 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0c14f9-2c0b-4f1f-80b7-5f5acca9c0ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:56.927175 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c14f9-2c0b-4f1f-80b7-5f5acca9c0ba service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:56.927175 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c14f9-2c0b-4f1f-80b7-5f5acca9c0ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:56.927175 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c14f9-2c0b-4f1f-80b7-5f5acca9c0ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:56.949314 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b5206d4c-f172-49b6-8cbd-0d09270df811 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c870ea47d94149559bb29dc4fb8a59b0', 'request_id': 'req-b5206d4c-f172-49b6-8cbd-0d09270df811'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:56.955950 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b5206d4c-f172-49b6-8cbd-0d09270df811 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c870ea47d94149559bb29dc4fb8a59b0', 'request_id': 'req-b5206d4c-f172-49b6-8cbd-0d09270df811'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:56.967908 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b5206d4c-f172-49b6-8cbd-0d09270df811 admin admin] The token cache is being invalidate because project c870ea47d94149559bb29dc4fb8a59b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:43:56.968204 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b5206d4c-f172-49b6-8cbd-0d09270df811 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:56.968895 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b5206d4c-f172-49b6-8cbd-0d09270df811 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:56.970736 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 942/1875] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:43:56 2022] DELETE /identity/v3/projects/c870ea47d94149559bb29dc4fb8a59b0 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:43:56.971938 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5206d4c-f172-49b6-8cbd-0d09270df811 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:56.974046 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-b5206d4c-f172-49b6-8cbd-0d09270df811 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:56.991909 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0c14f9-2c0b-4f1f-80b7-5f5acca9c0ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:56.993337 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0c14f9-2c0b-4f1f-80b7-5f5acca9c0ba service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:57.003082 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 934/1876] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:43:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:43:57.004494 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4791286-f977-4bab-8557-c396233d3a60 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:57.005337 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4791286-f977-4bab-8557-c396233d3a60 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:57.005615 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4791286-f977-4bab-8557-c396233d3a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:57.041411 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-b4791286-f977-4bab-8557-c396233d3a60 None None] MFA Rules not processed for user `5e0f245b3a894fefa911bb63f94ac5b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:57.043619 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b4791286-f977-4bab-8557-c396233d3a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:57.071095 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5206d4c-f172-49b6-8cbd-0d09270df811 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:57.141432 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 935/1877] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:43:57 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:57.142180 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4791286-f977-4bab-8557-c396233d3a60 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:57.143482 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b4791286-f977-4bab-8557-c396233d3a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:57.156014 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38218e2-a51e-47e9-b73d-9b300dca37c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1be2652c984a4283aeee0b937f0555e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:57.156728 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38218e2-a51e-47e9-b73d-9b300dca37c1 service nova] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:57.157689 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38218e2-a51e-47e9-b73d-9b300dca37c1 service nova] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:57.157689 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38218e2-a51e-47e9-b73d-9b300dca37c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:57.157854 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4791286-f977-4bab-8557-c396233d3a60 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:57.159416 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-d38218e2-a51e-47e9-b73d-9b300dca37c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:57.163588 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646bf868-44b4-4967-a4c2-2574135cf995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:57.164467 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646bf868-44b4-4967-a4c2-2574135cf995 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:57.164740 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646bf868-44b4-4967-a4c2-2574135cf995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:57.165009 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646bf868-44b4-4967-a4c2-2574135cf995 admin admin] PATH_INFO: `/v3/projects/caa289e3bee245518b28888daa63b273` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:57.166263 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646bf868-44b4-4967-a4c2-2574135cf995 admin admin] RBAC: Authorizing `identity:delete_project(project_id=caa289e3bee245518b28888daa63b273)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:57.168359 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646bf868-44b4-4967-a4c2-2574135cf995 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:57.171975 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38218e2-a51e-47e9-b73d-9b300dca37c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:57.173588 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38218e2-a51e-47e9-b73d-9b300dca37c1 service nova] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:57.186317 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 943/1878] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:43:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:43:57.187638 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe41f63-ccc3-4527-867f-d1c5e692b290 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:57.187932 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe41f63-ccc3-4527-867f-d1c5e692b290 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:57.188213 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe41f63-ccc3-4527-867f-d1c5e692b290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:57.227832 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-abe41f63-ccc3-4527-867f-d1c5e692b290 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:57.227832 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-abe41f63-ccc3-4527-867f-d1c5e692b290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:57.237850 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 944/1879] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:43:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:57.239764 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe41f63-ccc3-4527-867f-d1c5e692b290 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:57.241222 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-abe41f63-ccc3-4527-867f-d1c5e692b290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:57.305497 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-646bf868-44b4-4967-a4c2-2574135cf995 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'caa289e3bee245518b28888daa63b273', 'request_id': 'req-646bf868-44b4-4967-a4c2-2574135cf995'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:57.314229 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-646bf868-44b4-4967-a4c2-2574135cf995 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'caa289e3bee245518b28888daa63b273', 'request_id': 'req-646bf868-44b4-4967-a4c2-2574135cf995'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:57.314418 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe41f63-ccc3-4527-867f-d1c5e692b290 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:57.377351 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd0291a-1b24-4d6a-a73a-bca774f39074 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '950b5b5f690d41509ead753065a0b793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:57.378039 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0291a-1b24-4d6a-a73a-bca774f39074 service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:57.378310 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0291a-1b24-4d6a-a73a-bca774f39074 service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:57.378591 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0291a-1b24-4d6a-a73a-bca774f39074 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:57.439498 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-646bf868-44b4-4967-a4c2-2574135cf995 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'caa289e3bee245518b28888daa63b273', 'request_id': 'req-646bf868-44b4-4967-a4c2-2574135cf995'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:57.457619 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd0291a-1b24-4d6a-a73a-bca774f39074 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:57.459051 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-646bf868-44b4-4967-a4c2-2574135cf995 admin admin] The token cache is being invalidate because project caa289e3bee245518b28888daa63b273 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:43:57.459192 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd0291a-1b24-4d6a-a73a-bca774f39074 service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:57.459737 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-646bf868-44b4-4967-a4c2-2574135cf995 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:57.461563 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-646bf868-44b4-4967-a4c2-2574135cf995 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:57.466512 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 936/1880] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:43:57 2022] DELETE /identity/v3/projects/caa289e3bee245518b28888daa63b273 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:43:57.466512 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a8f56-ad4d-4525-970c-b3339e23853f None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:57.466512 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a8f56-ad4d-4525-970c-b3339e23853f None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:57.467202 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a8f56-ad4d-4525-970c-b3339e23853f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:57.475915 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 945/1881] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:43:57 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:43:57.480529 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd0291a-1b24-4d6a-a73a-bca774f39074 service cinder] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:57.510748 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-c06a8f56-ad4d-4525-970c-b3339e23853f None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:57.512000 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-c06a8f56-ad4d-4525-970c-b3339e23853f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:57.549730 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd0291a-1b24-4d6a-a73a-bca774f39074 service cinder] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:57.564905 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa85890-f4e0-464d-ac46-5f2a95638080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:57.565818 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa85890-f4e0-464d-ac46-5f2a95638080 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:57.566418 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa85890-f4e0-464d-ac46-5f2a95638080 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:57.566418 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa85890-f4e0-464d-ac46-5f2a95638080 admin admin] PATH_INFO: `/v3/users/d4ab0b715fc24093844232ccbe67a955` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:57.568548 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa85890-f4e0-464d-ac46-5f2a95638080 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4ab0b715fc24093844232ccbe67a955)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:57.571576 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa85890-f4e0-464d-ac46-5f2a95638080 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:57.593267 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 937/1882] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:43:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:57.598464 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06a8f56-ad4d-4525-970c-b3339e23853f None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:57.612124 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06a8f56-ad4d-4525-970c-b3339e23853f None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:57.616424 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781cbbed-b42e-47b0-8e7b-1d59fdc48714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:57.617193 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781cbbed-b42e-47b0-8e7b-1d59fdc48714 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:57.617501 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781cbbed-b42e-47b0-8e7b-1d59fdc48714 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:57.617780 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781cbbed-b42e-47b0-8e7b-1d59fdc48714 admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:57.618524 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781cbbed-b42e-47b0-8e7b-1d59fdc48714 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:43:57.618837 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781cbbed-b42e-47b0-8e7b-1d59fdc48714 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:57.620511 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781cbbed-b42e-47b0-8e7b-1d59fdc48714 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:57.633295 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 938/1883] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Apr 11 16:43:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:43:57.634330 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781cbbed-b42e-47b0-8e7b-1d59fdc48714 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:57.636115 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-781cbbed-b42e-47b0-8e7b-1d59fdc48714 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:57.649219 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781cbbed-b42e-47b0-8e7b-1d59fdc48714 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:57.653908 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74893396-8f4f-4416-a84f-324992093806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:57.662111 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74893396-8f4f-4416-a84f-324992093806 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:57.662111 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74893396-8f4f-4416-a84f-324992093806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:57.662111 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74893396-8f4f-4416-a84f-324992093806 admin admin] PATH_INFO: `/v3/projects/6c67c285c48d47aebc44b240cb892772` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:57.662111 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74893396-8f4f-4416-a84f-324992093806 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c67c285c48d47aebc44b240cb892772)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:57.662111 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74893396-8f4f-4416-a84f-324992093806 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:57.831420 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-eaa85890-f4e0-464d-ac46-5f2a95638080 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4ab0b715fc24093844232ccbe67a955'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:57.836761 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-74893396-8f4f-4416-a84f-324992093806 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c67c285c48d47aebc44b240cb892772', 'request_id': 'req-74893396-8f4f-4416-a84f-324992093806'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:57.842537 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-74893396-8f4f-4416-a84f-324992093806 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c67c285c48d47aebc44b240cb892772', 'request_id': 'req-74893396-8f4f-4416-a84f-324992093806'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:57.930340 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-eaa85890-f4e0-464d-ac46-5f2a95638080 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4ab0b715fc24093844232ccbe67a955'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:57.939245 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-eaa85890-f4e0-464d-ac46-5f2a95638080 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4ab0b715fc24093844232ccbe67a955'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:57.939961 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-eaa85890-f4e0-464d-ac46-5f2a95638080 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4ab0b715fc24093844232ccbe67a955'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:57.952485 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-eaa85890-f4e0-464d-ac46-5f2a95638080 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4ab0b715fc24093844232ccbe67a955'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:57.958986 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 946/1884] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:43:57 2022] DELETE /identity/v3/users/d4ab0b715fc24093844232ccbe67a955 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:43:57.960439 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa85890-f4e0-464d-ac46-5f2a95638080 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:57.962088 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-eaa85890-f4e0-464d-ac46-5f2a95638080 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:58.045965 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa85890-f4e0-464d-ac46-5f2a95638080 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:58.053066 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f9ef35-95e8-431a-9c53-f02090f5302a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:58.053850 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9ef35-95e8-431a-9c53-f02090f5302a admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:58.054215 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9ef35-95e8-431a-9c53-f02090f5302a admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:58.054568 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9ef35-95e8-431a-9c53-f02090f5302a admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:58.056239 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f9ef35-95e8-431a-9c53-f02090f5302a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:58.058325 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f9ef35-95e8-431a-9c53-f02090f5302a admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:58.086487 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-74893396-8f4f-4416-a84f-324992093806 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c67c285c48d47aebc44b240cb892772', 'request_id': 'req-74893396-8f4f-4416-a84f-324992093806'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:58.102333 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-74893396-8f4f-4416-a84f-324992093806 admin admin] The token cache is being invalidate because project 6c67c285c48d47aebc44b240cb892772 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:43:58.103001 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-74893396-8f4f-4416-a84f-324992093806 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:58.103950 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-74893396-8f4f-4416-a84f-324992093806 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:58.106080 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 939/1885] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:43:57 2022] DELETE /identity/v3/projects/6c67c285c48d47aebc44b240cb892772 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:43:58.111085 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74893396-8f4f-4416-a84f-324992093806 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:58.116806 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-74893396-8f4f-4416-a84f-324992093806 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:58.200005 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74893396-8f4f-4416-a84f-324992093806 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:58.206355 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 947/1886] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:43:57 2022] POST /identity/v3/projects => generated 367 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:43:58.207011 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f9ef35-95e8-431a-9c53-f02090f5302a admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:58.231857 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-37f9ef35-95e8-431a-9c53-f02090f5302a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:58.269172 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa68fbb0-6058-41c7-a467-d155858876f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:58.270066 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa68fbb0-6058-41c7-a467-d155858876f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:58.271053 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa68fbb0-6058-41c7-a467-d155858876f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:58.271269 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa68fbb0-6058-41c7-a467-d155858876f7 admin admin] PATH_INFO: `/v3/users/5600470cf92c4d5287ee3a91bdb212ae` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:58.272598 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa68fbb0-6058-41c7-a467-d155858876f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5600470cf92c4d5287ee3a91bdb212ae)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:58.274832 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa68fbb0-6058-41c7-a467-d155858876f7 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:58.367342 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f9ef35-95e8-431a-9c53-f02090f5302a admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:58.372510 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fede3f-d40d-4191-8aa0-3fbf356aadc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:58.373783 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fede3f-d40d-4191-8aa0-3fbf356aadc8 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:58.373783 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fede3f-d40d-4191-8aa0-3fbf356aadc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:58.374275 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fede3f-d40d-4191-8aa0-3fbf356aadc8 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:58.374794 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fede3f-d40d-4191-8aa0-3fbf356aadc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:58.376865 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fede3f-d40d-4191-8aa0-3fbf356aadc8 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:58.534038 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 948/1887] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:43:58 2022] POST /identity/v3/users => generated 284 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:43:58.538661 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fede3f-d40d-4191-8aa0-3fbf356aadc8 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:58.547960 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-aa68fbb0-6058-41c7-a467-d155858876f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5600470cf92c4d5287ee3a91bdb212ae'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:58.548909 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-aa68fbb0-6058-41c7-a467-d155858876f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5600470cf92c4d5287ee3a91bdb212ae'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:58.550698 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fede3f-d40d-4191-8aa0-3fbf356aadc8 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:58.560189 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548292cc-52a2-4abf-8f6f-9bf6165d39b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:58.561460 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548292cc-52a2-4abf-8f6f-9bf6165d39b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:58.561759 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548292cc-52a2-4abf-8f6f-9bf6165d39b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:58.562042 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548292cc-52a2-4abf-8f6f-9bf6165d39b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:58.562792 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548292cc-52a2-4abf-8f6f-9bf6165d39b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:58.566007 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548292cc-52a2-4abf-8f6f-9bf6165d39b4 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:58.588098 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 949/1888] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:43:58 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:43:58.590271 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548292cc-52a2-4abf-8f6f-9bf6165d39b4 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:58.602666 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548292cc-52a2-4abf-8f6f-9bf6165d39b4 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:58.611099 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4399ccb4-ebb1-469d-aec2-3f6da34bfbda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:58.611827 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399ccb4-ebb1-469d-aec2-3f6da34bfbda admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:58.612150 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399ccb4-ebb1-469d-aec2-3f6da34bfbda admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:58.612575 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399ccb4-ebb1-469d-aec2-3f6da34bfbda admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:58.613807 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4399ccb4-ebb1-469d-aec2-3f6da34bfbda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:58.616455 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4399ccb4-ebb1-469d-aec2-3f6da34bfbda admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:58.639808 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 950/1889] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:43:58 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:43:58.645025 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4399ccb4-ebb1-469d-aec2-3f6da34bfbda admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:58.654886 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4399ccb4-ebb1-469d-aec2-3f6da34bfbda admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:58.662812 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a70f2ef-7a7e-4f58-8375-c72dd52ef339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:58.667775 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70f2ef-7a7e-4f58-8375-c72dd52ef339 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:58.668158 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70f2ef-7a7e-4f58-8375-c72dd52ef339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:58.668449 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70f2ef-7a7e-4f58-8375-c72dd52ef339 admin admin] PATH_INFO: `/v3/projects/e88d3e45d46d4e7f83d952dade8044e0/users/d42f484f79ba42e7b20b20ea061b4d61/roles/0d41da7bec094450b5bff4e4831be52c` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:58.689547 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a70f2ef-7a7e-4f58-8375-c72dd52ef339 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e88d3e45d46d4e7f83d952dade8044e0, user_id=d42f484f79ba42e7b20b20ea061b4d61, role_id=0d41da7bec094450b5bff4e4831be52c)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:58.692906 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a70f2ef-7a7e-4f58-8375-c72dd52ef339 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:58.713990 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-aa68fbb0-6058-41c7-a467-d155858876f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5600470cf92c4d5287ee3a91bdb212ae'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:58.733518 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-aa68fbb0-6058-41c7-a467-d155858876f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5600470cf92c4d5287ee3a91bdb212ae'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:58.758474 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-aa68fbb0-6058-41c7-a467-d155858876f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5600470cf92c4d5287ee3a91bdb212ae'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:58.769503 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 940/1890] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:43:58 2022] DELETE /identity/v3/users/5600470cf92c4d5287ee3a91bdb212ae => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:43:58.831092 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 951/1891] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:43:58 2022] PUT /identity/v3/projects/e88d3e45d46d4e7f83d952dade8044e0/users/d42f484f79ba42e7b20b20ea061b4d61/roles/0d41da7bec094450b5bff4e4831be52c => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:43:58.834037 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6703164-8978-4235-8d2e-38710e6ae9e8 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:58.834469 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6703164-8978-4235-8d2e-38710e6ae9e8 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:58.834758 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6703164-8978-4235-8d2e-38710e6ae9e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:58.857454 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a70f2ef-7a7e-4f58-8375-c72dd52ef339 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:58.859227 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-0a70f2ef-7a7e-4f58-8375-c72dd52ef339 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:58.882295 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-b6703164-8978-4235-8d2e-38710e6ae9e8 None None] MFA Rules not processed for user `d42f484f79ba42e7b20b20ea061b4d61`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:58.883980 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b6703164-8978-4235-8d2e-38710e6ae9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:59.007740 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a70f2ef-7a7e-4f58-8375-c72dd52ef339 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:59.013112 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76abb8e7-bcc1-4737-b95f-beaabb93faaf tempest-VolumeQuotaClassesTest-767438940 tempest-VolumeQuotaClassesTest-767438940-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0f245b3a894fefa911bb63f94ac5b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f4b6d7fda0746748b525bf401ed2e89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:59.013938 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76abb8e7-bcc1-4737-b95f-beaabb93faaf tempest-VolumeQuotaClassesTest-767438940 tempest-VolumeQuotaClassesTest-767438940-project-admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:59.014313 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76abb8e7-bcc1-4737-b95f-beaabb93faaf tempest-VolumeQuotaClassesTest-767438940 tempest-VolumeQuotaClassesTest-767438940-project-admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:59.014769 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76abb8e7-bcc1-4737-b95f-beaabb93faaf tempest-VolumeQuotaClassesTest-767438940 tempest-VolumeQuotaClassesTest-767438940-project-admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:59.015728 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76abb8e7-bcc1-4737-b95f-beaabb93faaf tempest-VolumeQuotaClassesTest-767438940 tempest-VolumeQuotaClassesTest-767438940-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:43:59.016121 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76abb8e7-bcc1-4737-b95f-beaabb93faaf tempest-VolumeQuotaClassesTest-767438940 tempest-VolumeQuotaClassesTest-767438940-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:59.018043 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76abb8e7-bcc1-4737-b95f-beaabb93faaf tempest-VolumeQuotaClassesTest-767438940 tempest-VolumeQuotaClassesTest-767438940-project-admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:59.041771 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 952/1892] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Apr 11 16:43:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:43:59.042944 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76abb8e7-bcc1-4737-b95f-beaabb93faaf tempest-VolumeQuotaClassesTest-767438940 tempest-VolumeQuotaClassesTest-767438940-project-admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:59.050550 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 941/1893] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:43:58 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:59.054662 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6703164-8978-4235-8d2e-38710e6ae9e8 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:59.056795 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b6703164-8978-4235-8d2e-38710e6ae9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:59.056920 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76abb8e7-bcc1-4737-b95f-beaabb93faaf tempest-VolumeQuotaClassesTest-767438940 tempest-VolumeQuotaClassesTest-767438940-project-admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:59.066226 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021b5fbe-1d68-4d10-a3c1-f8daa61185bf tempest-VolumeQuotaClassesTest-767438940 tempest-VolumeQuotaClassesTest-767438940-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0f245b3a894fefa911bb63f94ac5b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f4b6d7fda0746748b525bf401ed2e89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:59.067277 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b5fbe-1d68-4d10-a3c1-f8daa61185bf tempest-VolumeQuotaClassesTest-767438940 tempest-VolumeQuotaClassesTest-767438940-project-admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:59.069317 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b5fbe-1d68-4d10-a3c1-f8daa61185bf tempest-VolumeQuotaClassesTest-767438940 tempest-VolumeQuotaClassesTest-767438940-project-admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:59.069639 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b5fbe-1d68-4d10-a3c1-f8daa61185bf tempest-VolumeQuotaClassesTest-767438940 tempest-VolumeQuotaClassesTest-767438940-project-admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:59.071551 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021b5fbe-1d68-4d10-a3c1-f8daa61185bf tempest-VolumeQuotaClassesTest-767438940 tempest-VolumeQuotaClassesTest-767438940-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:59.075043 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021b5fbe-1d68-4d10-a3c1-f8daa61185bf tempest-VolumeQuotaClassesTest-767438940 tempest-VolumeQuotaClassesTest-767438940-project-admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:59.156938 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6703164-8978-4235-8d2e-38710e6ae9e8 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:59.165172 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40671d64-835f-4a11-a328-60e1fea5a159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:59.166019 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40671d64-835f-4a11-a328-60e1fea5a159 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:59.166877 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40671d64-835f-4a11-a328-60e1fea5a159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:59.166877 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40671d64-835f-4a11-a328-60e1fea5a159 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:59.167721 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40671d64-835f-4a11-a328-60e1fea5a159 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:59.170193 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40671d64-835f-4a11-a328-60e1fea5a159 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:59.300171 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 953/1894] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:43:59 2022] POST /identity/v3/projects => generated 353 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:43:59.300632 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 942/1895] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:43:59 2022] POST /identity/v3/projects => generated 369 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:43:59.305050 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021b5fbe-1d68-4d10-a3c1-f8daa61185bf tempest-VolumeQuotaClassesTest-767438940 tempest-VolumeQuotaClassesTest-767438940-project-admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:59.305554 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40671d64-835f-4a11-a328-60e1fea5a159 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:59.377164 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021b5fbe-1d68-4d10-a3c1-f8daa61185bf tempest-VolumeQuotaClassesTest-767438940 tempest-VolumeQuotaClassesTest-767438940-project-admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:59.404383 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40671d64-835f-4a11-a328-60e1fea5a159 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:59.411469 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f641e0-2f19-4d35-b321-6a76528c8e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:59.412795 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f641e0-2f19-4d35-b321-6a76528c8e92 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:59.412795 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f641e0-2f19-4d35-b321-6a76528c8e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:59.413100 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f641e0-2f19-4d35-b321-6a76528c8e92 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:59.413798 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f641e0-2f19-4d35-b321-6a76528c8e92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:59.415900 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f641e0-2f19-4d35-b321-6a76528c8e92 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:59.455741 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e94c4a-b2e5-4d05-a706-fae5cb99300d tempest-VolumeQuotaClassesTest-767438940 tempest-VolumeQuotaClassesTest-767438940-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0f245b3a894fefa911bb63f94ac5b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f4b6d7fda0746748b525bf401ed2e89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:59.456661 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e94c4a-b2e5-4d05-a706-fae5cb99300d tempest-VolumeQuotaClassesTest-767438940 tempest-VolumeQuotaClassesTest-767438940-project-admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:59.457134 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e94c4a-b2e5-4d05-a706-fae5cb99300d tempest-VolumeQuotaClassesTest-767438940 tempest-VolumeQuotaClassesTest-767438940-project-admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:59.457405 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e94c4a-b2e5-4d05-a706-fae5cb99300d tempest-VolumeQuotaClassesTest-767438940 tempest-VolumeQuotaClassesTest-767438940-project-admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:59.458755 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e94c4a-b2e5-4d05-a706-fae5cb99300d tempest-VolumeQuotaClassesTest-767438940 tempest-VolumeQuotaClassesTest-767438940-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:43:59.459073 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e94c4a-b2e5-4d05-a706-fae5cb99300d tempest-VolumeQuotaClassesTest-767438940 tempest-VolumeQuotaClassesTest-767438940-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:59.460750 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e94c4a-b2e5-4d05-a706-fae5cb99300d tempest-VolumeQuotaClassesTest-767438940 tempest-VolumeQuotaClassesTest-767438940-project-admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:59.474151 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 954/1896] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Apr 11 16:43:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:43:59.475247 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e94c4a-b2e5-4d05-a706-fae5cb99300d tempest-VolumeQuotaClassesTest-767438940 tempest-VolumeQuotaClassesTest-767438940-project-admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:59.476961 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-00e94c4a-b2e5-4d05-a706-fae5cb99300d tempest-VolumeQuotaClassesTest-767438940 tempest-VolumeQuotaClassesTest-767438940-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:59.491484 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e94c4a-b2e5-4d05-a706-fae5cb99300d tempest-VolumeQuotaClassesTest-767438940 tempest-VolumeQuotaClassesTest-767438940-project-admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:59.496771 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15088e8e-e670-45b5-a55c-0faf077f9cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:59.497649 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15088e8e-e670-45b5-a55c-0faf077f9cf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:59.497938 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15088e8e-e670-45b5-a55c-0faf077f9cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:59.498221 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15088e8e-e670-45b5-a55c-0faf077f9cf3 admin admin] PATH_INFO: `/v3/projects/08677a33da954866ad02d34b7fb3d10a` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:59.499973 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15088e8e-e670-45b5-a55c-0faf077f9cf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08677a33da954866ad02d34b7fb3d10a)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:59.501916 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15088e8e-e670-45b5-a55c-0faf077f9cf3 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:59.606867 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 943/1897] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:43:59 2022] POST /identity/v3/users => generated 291 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:43:59.607831 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f641e0-2f19-4d35-b321-6a76528c8e92 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:59.619023 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f641e0-2f19-4d35-b321-6a76528c8e92 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:59.623629 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c224f3d-7dcd-40e8-bd35-fc025f1c2b8b tempest-VolumeQuotaClassesTest-767438940 tempest-VolumeQuotaClassesTest-767438940-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0f245b3a894fefa911bb63f94ac5b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f4b6d7fda0746748b525bf401ed2e89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:59.624483 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c224f3d-7dcd-40e8-bd35-fc025f1c2b8b tempest-VolumeQuotaClassesTest-767438940 tempest-VolumeQuotaClassesTest-767438940-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:59.624772 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c224f3d-7dcd-40e8-bd35-fc025f1c2b8b tempest-VolumeQuotaClassesTest-767438940 tempest-VolumeQuotaClassesTest-767438940-project-admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:59.625049 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c224f3d-7dcd-40e8-bd35-fc025f1c2b8b tempest-VolumeQuotaClassesTest-767438940 tempest-VolumeQuotaClassesTest-767438940-project-admin] PATH_INFO: `/v3/projects/1769e9915c38423b8bf08396952cedae` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:59.626218 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c224f3d-7dcd-40e8-bd35-fc025f1c2b8b tempest-VolumeQuotaClassesTest-767438940 tempest-VolumeQuotaClassesTest-767438940-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1769e9915c38423b8bf08396952cedae)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:59.628223 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c224f3d-7dcd-40e8-bd35-fc025f1c2b8b tempest-VolumeQuotaClassesTest-767438940 tempest-VolumeQuotaClassesTest-767438940-project-admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:59.761842 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-15088e8e-e670-45b5-a55c-0faf077f9cf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08677a33da954866ad02d34b7fb3d10a', 'request_id': 'req-15088e8e-e670-45b5-a55c-0faf077f9cf3'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:59.842089 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-7c224f3d-7dcd-40e8-bd35-fc025f1c2b8b tempest-VolumeQuotaClassesTest-767438940 tempest-VolumeQuotaClassesTest-767438940-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1769e9915c38423b8bf08396952cedae', 'request_id': 'req-7c224f3d-7dcd-40e8-bd35-fc025f1c2b8b'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:59.847628 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-7c224f3d-7dcd-40e8-bd35-fc025f1c2b8b tempest-VolumeQuotaClassesTest-767438940 tempest-VolumeQuotaClassesTest-767438940-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1769e9915c38423b8bf08396952cedae', 'request_id': 'req-7c224f3d-7dcd-40e8-bd35-fc025f1c2b8b'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:59.909459 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-15088e8e-e670-45b5-a55c-0faf077f9cf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08677a33da954866ad02d34b7fb3d10a', 'request_id': 'req-15088e8e-e670-45b5-a55c-0faf077f9cf3'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:59.916410 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-15088e8e-e670-45b5-a55c-0faf077f9cf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08677a33da954866ad02d34b7fb3d10a', 'request_id': 'req-15088e8e-e670-45b5-a55c-0faf077f9cf3'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:59.928276 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-15088e8e-e670-45b5-a55c-0faf077f9cf3 admin admin] The token cache is being invalidate because project 08677a33da954866ad02d34b7fb3d10a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:43:59.928569 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-15088e8e-e670-45b5-a55c-0faf077f9cf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:59.929228 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-15088e8e-e670-45b5-a55c-0faf077f9cf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:43:59.931121 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 955/1898] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:43:59 2022] DELETE /identity/v3/projects/08677a33da954866ad02d34b7fb3d10a => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:43:59.932036 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15088e8e-e670-45b5-a55c-0faf077f9cf3 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:59.936199 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-15088e8e-e670-45b5-a55c-0faf077f9cf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:00.004333 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-7c224f3d-7dcd-40e8-bd35-fc025f1c2b8b tempest-VolumeQuotaClassesTest-767438940 tempest-VolumeQuotaClassesTest-767438940-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1769e9915c38423b8bf08396952cedae', 'request_id': 'req-7c224f3d-7dcd-40e8-bd35-fc025f1c2b8b'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:00.032669 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-7c224f3d-7dcd-40e8-bd35-fc025f1c2b8b tempest-VolumeQuotaClassesTest-767438940 tempest-VolumeQuotaClassesTest-767438940-project-admin] The token cache is being invalidate because project 1769e9915c38423b8bf08396952cedae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:44:00.033500 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-7c224f3d-7dcd-40e8-bd35-fc025f1c2b8b tempest-VolumeQuotaClassesTest-767438940 tempest-VolumeQuotaClassesTest-767438940-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:00.034749 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-7c224f3d-7dcd-40e8-bd35-fc025f1c2b8b tempest-VolumeQuotaClassesTest-767438940 tempest-VolumeQuotaClassesTest-767438940-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:00.044882 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 944/1899] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:43:59 2022] DELETE /identity/v3/projects/1769e9915c38423b8bf08396952cedae => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:44:00.046238 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c224f3d-7dcd-40e8-bd35-fc025f1c2b8b tempest-VolumeQuotaClassesTest-767438940 tempest-VolumeQuotaClassesTest-767438940-project-admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:00.050350 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-7c224f3d-7dcd-40e8-bd35-fc025f1c2b8b tempest-VolumeQuotaClassesTest-767438940 tempest-VolumeQuotaClassesTest-767438940-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:00.062660 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15088e8e-e670-45b5-a55c-0faf077f9cf3 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:00.183054 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c224f3d-7dcd-40e8-bd35-fc025f1c2b8b tempest-VolumeQuotaClassesTest-767438940 tempest-VolumeQuotaClassesTest-767438940-project-admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:00.186703 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef365df3-2adc-40be-ae6c-5918da69a335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:00.187761 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef365df3-2adc-40be-ae6c-5918da69a335 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:00.188310 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef365df3-2adc-40be-ae6c-5918da69a335 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:00.188760 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef365df3-2adc-40be-ae6c-5918da69a335 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:00.189072 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2ab319-19ff-4888-82af-b2faf8c1ab5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:00.189988 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ab319-19ff-4888-82af-b2faf8c1ab5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:00.190239 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ab319-19ff-4888-82af-b2faf8c1ab5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:00.190508 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef365df3-2adc-40be-ae6c-5918da69a335 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:00.190645 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ab319-19ff-4888-82af-b2faf8c1ab5b admin admin] PATH_INFO: `/v3/projects/58c50b82e7fa4d29a7c2c69895fdf842` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:00.192875 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2ab319-19ff-4888-82af-b2faf8c1ab5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=58c50b82e7fa4d29a7c2c69895fdf842)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:00.193645 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef365df3-2adc-40be-ae6c-5918da69a335 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:00.194576 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2ab319-19ff-4888-82af-b2faf8c1ab5b admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:00.209834 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 956/1900] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:43:59 2022] GET /identity/v3/roles => generated 1420 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:44:00.212103 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e106b7a-2065-44bf-8415-0a939593f835 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:00.212749 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e106b7a-2065-44bf-8415-0a939593f835 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:00.215908 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e106b7a-2065-44bf-8415-0a939593f835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:00.282854 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-3e106b7a-2065-44bf-8415-0a939593f835 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:00.284967 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-3e106b7a-2065-44bf-8415-0a939593f835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:00.304470 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 957/1901] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:44:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:44:00.304470 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e106b7a-2065-44bf-8415-0a939593f835 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:00.312092 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-3e106b7a-2065-44bf-8415-0a939593f835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:00.327264 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e106b7a-2065-44bf-8415-0a939593f835 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:00.332548 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd46404-47aa-4514-9957-6060541f9006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:00.333910 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd46404-47aa-4514-9957-6060541f9006 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:00.334281 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd46404-47aa-4514-9957-6060541f9006 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:00.334978 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd46404-47aa-4514-9957-6060541f9006 admin admin] PATH_INFO: `/v3/projects/adfd1d3fee394d3ca6d9c39166657ddc/users/47c257bcdb874d36963fbe076582087f/roles/702e5e78b5d744529384b96a390ae92f` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:00.352657 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd46404-47aa-4514-9957-6060541f9006 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adfd1d3fee394d3ca6d9c39166657ddc, user_id=47c257bcdb874d36963fbe076582087f, role_id=702e5e78b5d744529384b96a390ae92f)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:00.355808 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd46404-47aa-4514-9957-6060541f9006 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:00.513615 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 958/1902] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:44:00 2022] PUT /identity/v3/projects/adfd1d3fee394d3ca6d9c39166657ddc/users/47c257bcdb874d36963fbe076582087f/roles/702e5e78b5d744529384b96a390ae92f => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:44:00.514581 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1bc44-8042-41d4-b3ec-c2bd71e16af0 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:00.514937 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1bc44-8042-41d4-b3ec-c2bd71e16af0 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:00.519667 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1bc44-8042-41d4-b3ec-c2bd71e16af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:00.531565 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-5f2ab319-19ff-4888-82af-b2faf8c1ab5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58c50b82e7fa4d29a7c2c69895fdf842', 'request_id': 'req-5f2ab319-19ff-4888-82af-b2faf8c1ab5b'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:00.539657 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-5f2ab319-19ff-4888-82af-b2faf8c1ab5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58c50b82e7fa4d29a7c2c69895fdf842', 'request_id': 'req-5f2ab319-19ff-4888-82af-b2faf8c1ab5b'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:00.543358 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-e1e1bc44-8042-41d4-b3ec-c2bd71e16af0 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:00.544768 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-e1e1bc44-8042-41d4-b3ec-c2bd71e16af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:00.609351 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 959/1903] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:44:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:44:00.610575 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1bc44-8042-41d4-b3ec-c2bd71e16af0 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:00.621196 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1bc44-8042-41d4-b3ec-c2bd71e16af0 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:00.626504 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91687bd-31f0-4cb5-adb8-ad72e7004a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:00.627199 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91687bd-31f0-4cb5-adb8-ad72e7004a23 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:00.627491 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91687bd-31f0-4cb5-adb8-ad72e7004a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:00.627812 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91687bd-31f0-4cb5-adb8-ad72e7004a23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:00.628563 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91687bd-31f0-4cb5-adb8-ad72e7004a23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:00.631605 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91687bd-31f0-4cb5-adb8-ad72e7004a23 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:00.641908 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 960/1904] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:44:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:44:00.642767 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91687bd-31f0-4cb5-adb8-ad72e7004a23 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:00.654925 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91687bd-31f0-4cb5-adb8-ad72e7004a23 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:00.660063 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5b2b96-1a83-4157-93a1-4966ce4c103b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:00.660927 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b2b96-1a83-4157-93a1-4966ce4c103b admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:00.661237 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b2b96-1a83-4157-93a1-4966ce4c103b admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:00.661551 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b2b96-1a83-4157-93a1-4966ce4c103b admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:00.662404 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5b2b96-1a83-4157-93a1-4966ce4c103b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:44:00.663197 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5b2b96-1a83-4157-93a1-4966ce4c103b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:00.665445 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5b2b96-1a83-4157-93a1-4966ce4c103b admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:00.680032 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 961/1905] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Apr 11 16:44:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:44:00.681577 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5b2b96-1a83-4157-93a1-4966ce4c103b admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:00.682600 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-5f2ab319-19ff-4888-82af-b2faf8c1ab5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58c50b82e7fa4d29a7c2c69895fdf842', 'request_id': 'req-5f2ab319-19ff-4888-82af-b2faf8c1ab5b'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:00.694194 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5b2b96-1a83-4157-93a1-4966ce4c103b admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:00.697381 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-5f2ab319-19ff-4888-82af-b2faf8c1ab5b admin admin] The token cache is being invalidate because project 58c50b82e7fa4d29a7c2c69895fdf842 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:44:00.697685 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-5f2ab319-19ff-4888-82af-b2faf8c1ab5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:00.698366 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-5f2ab319-19ff-4888-82af-b2faf8c1ab5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:00.700090 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac15ac5-c4ad-465b-be44-9c5e661f6f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:00.700220 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 945/1906] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:44:00 2022] DELETE /identity/v3/projects/58c50b82e7fa4d29a7c2c69895fdf842 => generated 0 bytes in 655 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:44:00.700930 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2ab319-19ff-4888-82af-b2faf8c1ab5b admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:00.701050 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac15ac5-c4ad-465b-be44-9c5e661f6f37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:00.701309 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac15ac5-c4ad-465b-be44-9c5e661f6f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:00.701588 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac15ac5-c4ad-465b-be44-9c5e661f6f37 admin admin] PATH_INFO: `/v3/projects/adfd1d3fee394d3ca6d9c39166657ddc/users/47c257bcdb874d36963fbe076582087f/roles/702e5e78b5d744529384b96a390ae92f` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:00.703742 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac15ac5-c4ad-465b-be44-9c5e661f6f37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adfd1d3fee394d3ca6d9c39166657ddc, user_id=47c257bcdb874d36963fbe076582087f, role_id=702e5e78b5d744529384b96a390ae92f)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:00.704968 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-5f2ab319-19ff-4888-82af-b2faf8c1ab5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:00.706638 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac15ac5-c4ad-465b-be44-9c5e661f6f37 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:00.717628 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2ab319-19ff-4888-82af-b2faf8c1ab5b admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:00.718078 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 962/1907] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:44:00 2022] PUT /identity/v3/projects/adfd1d3fee394d3ca6d9c39166657ddc/users/47c257bcdb874d36963fbe076582087f/roles/702e5e78b5d744529384b96a390ae92f => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:44:00.719433 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb581e7-7508-444b-94f5-cdec483a19f4 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:00.719736 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb581e7-7508-444b-94f5-cdec483a19f4 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:00.720057 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb581e7-7508-444b-94f5-cdec483a19f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:00.742272 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-acb581e7-7508-444b-94f5-cdec483a19f4 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:00.743543 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-acb581e7-7508-444b-94f5-cdec483a19f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:00.786246 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53801f8-4c9a-4e7a-80ad-981f20a21c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:00.787054 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53801f8-4c9a-4e7a-80ad-981f20a21c6e admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:00.787341 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53801f8-4c9a-4e7a-80ad-981f20a21c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:00.787654 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53801f8-4c9a-4e7a-80ad-981f20a21c6e admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:00.788363 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53801f8-4c9a-4e7a-80ad-981f20a21c6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:00.790282 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53801f8-4c9a-4e7a-80ad-981f20a21c6e admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:00.808727 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 963/1908] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:44:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:44:00.810063 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab92a302-81a9-4578-9a96-78dddce0e2f4 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:00.810359 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab92a302-81a9-4578-9a96-78dddce0e2f4 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:00.810641 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab92a302-81a9-4578-9a96-78dddce0e2f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:00.840236 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-ab92a302-81a9-4578-9a96-78dddce0e2f4 None None] MFA Rules not processed for user `47c257bcdb874d36963fbe076582087f`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:00.841470 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-ab92a302-81a9-4578-9a96-78dddce0e2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:00.924350 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 964/1909] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:44:00 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:44:00.926028 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 946/1910] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:44:00 2022] POST /identity/v3/projects => generated 381 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:44:00.927384 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8268e65-64b9-481f-98d4-df43527286c2 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:00.929558 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8268e65-64b9-481f-98d4-df43527286c2 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:00.931004 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8268e65-64b9-481f-98d4-df43527286c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:00.932145 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53801f8-4c9a-4e7a-80ad-981f20a21c6e admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:00.968648 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-b8268e65-64b9-481f-98d4-df43527286c2 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:00.969915 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-b8268e65-64b9-481f-98d4-df43527286c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:01.017927 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53801f8-4c9a-4e7a-80ad-981f20a21c6e admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:01.024483 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35498dd4-7519-4c67-9bb3-6777be86d317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:01.025201 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35498dd4-7519-4c67-9bb3-6777be86d317 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:01.025473 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35498dd4-7519-4c67-9bb3-6777be86d317 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:01.025776 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35498dd4-7519-4c67-9bb3-6777be86d317 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:01.026520 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35498dd4-7519-4c67-9bb3-6777be86d317 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:01.028555 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35498dd4-7519-4c67-9bb3-6777be86d317 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:01.052232 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 965/1911] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:44:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:44:01.053369 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8268e65-64b9-481f-98d4-df43527286c2 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:01.054764 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-b8268e65-64b9-481f-98d4-df43527286c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:01.126013 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8268e65-64b9-481f-98d4-df43527286c2 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:01.130588 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b5f5ff-fb29-4756-b726-6851b70aff89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '950b5b5f690d41509ead753065a0b793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:01.131660 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5f5ff-fb29-4756-b726-6851b70aff89 service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:01.131660 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5f5ff-fb29-4756-b726-6851b70aff89 service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:01.131971 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5f5ff-fb29-4756-b726-6851b70aff89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:01.141714 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 947/1912] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:44:00 2022] POST /identity/v3/users => generated 291 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:44:01.142813 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35498dd4-7519-4c67-9bb3-6777be86d317 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:01.158539 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35498dd4-7519-4c67-9bb3-6777be86d317 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:01.165288 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f1b853-3e12-4aa3-8bdc-07dcb76dc963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:01.166115 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1b853-3e12-4aa3-8bdc-07dcb76dc963 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:01.166478 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1b853-3e12-4aa3-8bdc-07dcb76dc963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:01.166836 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1b853-3e12-4aa3-8bdc-07dcb76dc963 admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:01.167708 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f1b853-3e12-4aa3-8bdc-07dcb76dc963 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:44:01.168092 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f1b853-3e12-4aa3-8bdc-07dcb76dc963 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:01.169932 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f1b853-3e12-4aa3-8bdc-07dcb76dc963 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:01.186531 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 948/1913] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Apr 11 16:44:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:44:01.187428 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f1b853-3e12-4aa3-8bdc-07dcb76dc963 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:01.189368 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-68f1b853-3e12-4aa3-8bdc-07dcb76dc963 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:01.205119 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f1b853-3e12-4aa3-8bdc-07dcb76dc963 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:01.211282 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2337ee6-7e2b-4732-9608-b6ece3204e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:01.212473 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2337ee6-7e2b-4732-9608-b6ece3204e3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:01.212762 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2337ee6-7e2b-4732-9608-b6ece3204e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:01.213076 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2337ee6-7e2b-4732-9608-b6ece3204e3b admin admin] PATH_INFO: `/v3/users/5c67c991f38744578faedcf3a9badf4b` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:01.214412 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2337ee6-7e2b-4732-9608-b6ece3204e3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c67c991f38744578faedcf3a9badf4b)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:01.216419 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2337ee6-7e2b-4732-9608-b6ece3204e3b admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:01.218996 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b5f5ff-fb29-4756-b726-6851b70aff89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:01.220768 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b5f5ff-fb29-4756-b726-6851b70aff89 service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:01.233413 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 966/1914] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:44:01 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:44:01.234472 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b5f5ff-fb29-4756-b726-6851b70aff89 service cinder] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:01.246865 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b5f5ff-fb29-4756-b726-6851b70aff89 service cinder] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:01.251841 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4382ec0e-468e-4dd3-acde-8c9ed7debdd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:01.252529 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4382ec0e-468e-4dd3-acde-8c9ed7debdd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:01.252818 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4382ec0e-468e-4dd3-acde-8c9ed7debdd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:01.253098 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4382ec0e-468e-4dd3-acde-8c9ed7debdd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:01.290473 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4382ec0e-468e-4dd3-acde-8c9ed7debdd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:01.290473 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4382ec0e-468e-4dd3-acde-8c9ed7debdd9 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:01.290473 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 967/1915] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:44:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:44:01.290473 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4382ec0e-468e-4dd3-acde-8c9ed7debdd9 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:01.290473 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4382ec0e-468e-4dd3-acde-8c9ed7debdd9 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:01.290975 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6834fb83-05c4-4272-b776-a1c7a33297a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:01.290975 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6834fb83-05c4-4272-b776-a1c7a33297a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:01.290975 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6834fb83-05c4-4272-b776-a1c7a33297a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:01.290975 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6834fb83-05c4-4272-b776-a1c7a33297a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:01.291274 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6834fb83-05c4-4272-b776-a1c7a33297a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:01.291274 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6834fb83-05c4-4272-b776-a1c7a33297a0 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:01.513342 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 968/1916] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:44:01 2022] POST /identity/v3/projects => generated 383 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:44:01.513342 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6834fb83-05c4-4272-b776-a1c7a33297a0 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:01.594547 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6834fb83-05c4-4272-b776-a1c7a33297a0 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:01.601495 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e5cda-b74a-4786-b2eb-b37a5407171b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:01.602230 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e5cda-b74a-4786-b2eb-b37a5407171b admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:01.602513 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e5cda-b74a-4786-b2eb-b37a5407171b admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:01.602790 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e5cda-b74a-4786-b2eb-b37a5407171b admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:01.603556 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72e5cda-b74a-4786-b2eb-b37a5407171b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:01.605194 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72e5cda-b74a-4786-b2eb-b37a5407171b admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:01.608465 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-b2337ee6-7e2b-4732-9608-b6ece3204e3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c67c991f38744578faedcf3a9badf4b'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:01.613838 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-b2337ee6-7e2b-4732-9608-b6ece3204e3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c67c991f38744578faedcf3a9badf4b'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:01.618872 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 969/1917] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:44:01 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:44:01.619747 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e5cda-b74a-4786-b2eb-b37a5407171b admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:01.635336 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e5cda-b74a-4786-b2eb-b37a5407171b admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:01.650978 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eee026-9b30-47e3-87d6-bfac27174632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:01.652013 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eee026-9b30-47e3-87d6-bfac27174632 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:01.652013 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eee026-9b30-47e3-87d6-bfac27174632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:01.652355 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eee026-9b30-47e3-87d6-bfac27174632 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:01.653066 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eee026-9b30-47e3-87d6-bfac27174632 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:01.655108 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eee026-9b30-47e3-87d6-bfac27174632 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:01.701818 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-b2337ee6-7e2b-4732-9608-b6ece3204e3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c67c991f38744578faedcf3a9badf4b'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:01.712891 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-b2337ee6-7e2b-4732-9608-b6ece3204e3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c67c991f38744578faedcf3a9badf4b'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:01.727463 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-b2337ee6-7e2b-4732-9608-b6ece3204e3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c67c991f38744578faedcf3a9badf4b'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:01.733908 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 949/1918] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:44:01 2022] DELETE /identity/v3/users/5c67c991f38744578faedcf3a9badf4b => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:44:01.734858 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2337ee6-7e2b-4732-9608-b6ece3204e3b admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:01.736329 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b2337ee6-7e2b-4732-9608-b6ece3204e3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:01.770957 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 970/1919] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:44:01 2022] POST /identity/v3/users => generated 292 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:44:01.771985 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eee026-9b30-47e3-87d6-bfac27174632 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:01.775329 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-25eee026-9b30-47e3-87d6-bfac27174632 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:01.788429 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eee026-9b30-47e3-87d6-bfac27174632 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:01.800830 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2337ee6-7e2b-4732-9608-b6ece3204e3b admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:01.805477 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b1a97d-2dde-4b6f-9881-d84053774971 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '950b5b5f690d41509ead753065a0b793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:01.806417 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1a97d-2dde-4b6f-9881-d84053774971 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:01.806715 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1a97d-2dde-4b6f-9881-d84053774971 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:01.806983 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1a97d-2dde-4b6f-9881-d84053774971 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:01.809072 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-f6b1a97d-2dde-4b6f-9881-d84053774971 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:01.859254 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc05a0ea-df10-4447-a65c-6ab8d6a17907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:01.860260 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc05a0ea-df10-4447-a65c-6ab8d6a17907 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:01.860543 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc05a0ea-df10-4447-a65c-6ab8d6a17907 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:01.860835 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc05a0ea-df10-4447-a65c-6ab8d6a17907 admin admin] PATH_INFO: `/v3/projects/803cefce21c643cdb275ca86e038f711/users/9478fa4325f54970b958def735151551/roles/0d41da7bec094450b5bff4e4831be52c` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:01.876720 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc05a0ea-df10-4447-a65c-6ab8d6a17907 admin admin] RBAC: Authorizing `identity:create_grant(project_id=803cefce21c643cdb275ca86e038f711, user_id=9478fa4325f54970b958def735151551, role_id=0d41da7bec094450b5bff4e4831be52c)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:01.879106 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b1a97d-2dde-4b6f-9881-d84053774971 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:01.879405 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc05a0ea-df10-4447-a65c-6ab8d6a17907 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:01.882024 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b1a97d-2dde-4b6f-9881-d84053774971 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:01.892706 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 950/1920] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:44:01 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:44:01.894095 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43e76d-2c83-40c5-99fb-7649d58b1aeb None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:01.894389 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43e76d-2c83-40c5-99fb-7649d58b1aeb None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:01.894665 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43e76d-2c83-40c5-99fb-7649d58b1aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:01.917238 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-5f43e76d-2c83-40c5-99fb-7649d58b1aeb None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:01.917238 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-5f43e76d-2c83-40c5-99fb-7649d58b1aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:01.925894 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 951/1921] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:44:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:44:01.927872 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f43e76d-2c83-40c5-99fb-7649d58b1aeb None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:01.929658 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-5f43e76d-2c83-40c5-99fb-7649d58b1aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:01.944969 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f43e76d-2c83-40c5-99fb-7649d58b1aeb None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:01.950832 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d00b4-79d1-4b38-854c-d0d575b5b690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:01.951657 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d00b4-79d1-4b38-854c-d0d575b5b690 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:01.952088 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d00b4-79d1-4b38-854c-d0d575b5b690 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:01.952370 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d00b4-79d1-4b38-854c-d0d575b5b690 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:01.953421 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2d00b4-79d1-4b38-854c-d0d575b5b690 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:01.955409 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2d00b4-79d1-4b38-854c-d0d575b5b690 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:01.968575 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 952/1922] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:44:01 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:44:01.969381 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d00b4-79d1-4b38-854c-d0d575b5b690 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:01.972166 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-9f2d00b4-79d1-4b38-854c-d0d575b5b690 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:01.984343 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 971/1923] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:44:01 2022] PUT /identity/v3/projects/803cefce21c643cdb275ca86e038f711/users/9478fa4325f54970b958def735151551/roles/0d41da7bec094450b5bff4e4831be52c => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:44:01.985728 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc05a0ea-df10-4447-a65c-6ab8d6a17907 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:02.062662 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d00b4-79d1-4b38-854c-d0d575b5b690 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:02.099143 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc05a0ea-df10-4447-a65c-6ab8d6a17907 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:02.106207 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22c4f3f-9997-44a3-a828-80f17fcca83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:02.107273 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c4f3f-9997-44a3-a828-80f17fcca83f admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:02.107761 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c4f3f-9997-44a3-a828-80f17fcca83f admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:02.108273 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c4f3f-9997-44a3-a828-80f17fcca83f admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:02.109487 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22c4f3f-9997-44a3-a828-80f17fcca83f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:02.112269 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22c4f3f-9997-44a3-a828-80f17fcca83f admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:02.130799 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7efef2-6f10-4b57-953b-d62fcb54b1c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:02.132050 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7efef2-6f10-4b57-953b-d62fcb54b1c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:02.132411 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7efef2-6f10-4b57-953b-d62fcb54b1c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:02.133764 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7efef2-6f10-4b57-953b-d62fcb54b1c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:02.135164 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 972/1924] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:44:01 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:44:02.137699 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d0d54e-0185-461c-8ac3-1605dbd30dd9 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:02.138136 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d0d54e-0185-461c-8ac3-1605dbd30dd9 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:02.138506 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d0d54e-0185-461c-8ac3-1605dbd30dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:02.150196 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7efef2-6f10-4b57-953b-d62fcb54b1c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:02.153073 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7efef2-6f10-4b57-953b-d62fcb54b1c3 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:02.172984 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 953/1925] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:44:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:44:02.174241 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7efef2-6f10-4b57-953b-d62fcb54b1c3 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:02.190141 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7efef2-6f10-4b57-953b-d62fcb54b1c3 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:02.199471 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7909d98a-4d3f-447c-a309-c0f238c702b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:02.200585 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7909d98a-4d3f-447c-a309-c0f238c702b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:02.200962 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7909d98a-4d3f-447c-a309-c0f238c702b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:02.201368 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7909d98a-4d3f-447c-a309-c0f238c702b7 admin admin] PATH_INFO: `/v3/projects/0dba6d63c69d4a22b9182986c924db59/users/23b089f5a1704180809febf9b361a75e/roles/0d41da7bec094450b5bff4e4831be52c` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:02.206705 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-35d0d54e-0185-461c-8ac3-1605dbd30dd9 None None] MFA Rules not processed for user `9478fa4325f54970b958def735151551`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:02.209368 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-35d0d54e-0185-461c-8ac3-1605dbd30dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:02.231385 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7909d98a-4d3f-447c-a309-c0f238c702b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dba6d63c69d4a22b9182986c924db59, user_id=23b089f5a1704180809febf9b361a75e, role_id=0d41da7bec094450b5bff4e4831be52c)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:02.234413 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7909d98a-4d3f-447c-a309-c0f238c702b7 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:02.334553 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 973/1926] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:44:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:44:02.339109 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d0d54e-0185-461c-8ac3-1605dbd30dd9 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:02.366636 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d0d54e-0185-461c-8ac3-1605dbd30dd9 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:02.373766 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d49c3d1-71a6-4935-91d6-d4a584b4b536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:02.374634 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49c3d1-71a6-4935-91d6-d4a584b4b536 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:02.375137 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49c3d1-71a6-4935-91d6-d4a584b4b536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:02.375325 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49c3d1-71a6-4935-91d6-d4a584b4b536 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:02.376174 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d49c3d1-71a6-4935-91d6-d4a584b4b536 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:02.378534 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d49c3d1-71a6-4935-91d6-d4a584b4b536 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:02.418547 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 954/1927] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:44:02 2022] PUT /identity/v3/projects/0dba6d63c69d4a22b9182986c924db59/users/23b089f5a1704180809febf9b361a75e/roles/0d41da7bec094450b5bff4e4831be52c => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:44:02.429896 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6edf31b-2ceb-4ff2-8446-f6cc7fb1defb None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:02.430181 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6edf31b-2ceb-4ff2-8446-f6cc7fb1defb None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:02.430469 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6edf31b-2ceb-4ff2-8446-f6cc7fb1defb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:02.467156 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-e6edf31b-2ceb-4ff2-8446-f6cc7fb1defb None None] MFA Rules not processed for user `23b089f5a1704180809febf9b361a75e`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:02.469172 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e6edf31b-2ceb-4ff2-8446-f6cc7fb1defb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:02.513968 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 974/1928] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:44:02 2022] POST /identity/v3/projects => generated 379 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:44:02.526935 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d49c3d1-71a6-4935-91d6-d4a584b4b536 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:02.563675 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 955/1929] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:44:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:44:02.575891 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6edf31b-2ceb-4ff2-8446-f6cc7fb1defb None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:02.577770 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e6edf31b-2ceb-4ff2-8446-f6cc7fb1defb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:02.626966 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d49c3d1-71a6-4935-91d6-d4a584b4b536 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:02.633537 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aac6105-3e99-4ca4-b44f-d7d6e206f4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:02.634759 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac6105-3e99-4ca4-b44f-d7d6e206f4ff admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:02.634759 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac6105-3e99-4ca4-b44f-d7d6e206f4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:02.635012 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac6105-3e99-4ca4-b44f-d7d6e206f4ff admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:02.635795 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aac6105-3e99-4ca4-b44f-d7d6e206f4ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:02.637824 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aac6105-3e99-4ca4-b44f-d7d6e206f4ff admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:02.667548 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6edf31b-2ceb-4ff2-8446-f6cc7fb1defb None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:02.743870 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 975/1930] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:44:02 2022] POST /identity/v3/users => generated 296 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:44:02.744808 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1012377c-7df1-4ba5-95e2-31a0433d4c94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '950b5b5f690d41509ead753065a0b793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:02.745557 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012377c-7df1-4ba5-95e2-31a0433d4c94 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:02.745949 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012377c-7df1-4ba5-95e2-31a0433d4c94 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:02.746323 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012377c-7df1-4ba5-95e2-31a0433d4c94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:02.748249 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aac6105-3e99-4ca4-b44f-d7d6e206f4ff admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:02.763722 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aac6105-3e99-4ca4-b44f-d7d6e206f4ff admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:02.771984 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0281f1-d183-4a22-b095-7481ad0035c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:02.773152 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0281f1-d183-4a22-b095-7481ad0035c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:02.773602 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0281f1-d183-4a22-b095-7481ad0035c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:02.774081 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0281f1-d183-4a22-b095-7481ad0035c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:02.775464 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0281f1-d183-4a22-b095-7481ad0035c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:02.788775 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0281f1-d183-4a22-b095-7481ad0035c9 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:02.803997 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 976/1931] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:44:02 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 16:44:02.808220 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0281f1-d183-4a22-b095-7481ad0035c9 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:02.824143 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0281f1-d183-4a22-b095-7481ad0035c9 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:02.830487 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91d694-71c0-40aa-90d3-844dd6e7d6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:02.831409 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91d694-71c0-40aa-90d3-844dd6e7d6cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:02.831732 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91d694-71c0-40aa-90d3-844dd6e7d6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:02.832020 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91d694-71c0-40aa-90d3-844dd6e7d6cc admin admin] PATH_INFO: `/v3/projects/59222c07aeb34cd18e016e8ed7a69c5c/users/d93eb33fa0964416aa17d5280a6883d7/roles/702e5e78b5d744529384b96a390ae92f` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:02.861895 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1012377c-7df1-4ba5-95e2-31a0433d4c94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:02.862625 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e91d694-71c0-40aa-90d3-844dd6e7d6cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=59222c07aeb34cd18e016e8ed7a69c5c, user_id=d93eb33fa0964416aa17d5280a6883d7, role_id=702e5e78b5d744529384b96a390ae92f)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:02.864112 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1012377c-7df1-4ba5-95e2-31a0433d4c94 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:02.866204 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e91d694-71c0-40aa-90d3-844dd6e7d6cc admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:02.874306 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 956/1932] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:44:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 16:44:02.894188 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1012377c-7df1-4ba5-95e2-31a0433d4c94 service cinder] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:02.906404 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1012377c-7df1-4ba5-95e2-31a0433d4c94 service cinder] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:02.913387 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d74f5d1-1c22-4121-93f7-53622060ddbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:02.914371 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74f5d1-1c22-4121-93f7-53622060ddbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:02.914691 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74f5d1-1c22-4121-93f7-53622060ddbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:02.914953 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74f5d1-1c22-4121-93f7-53622060ddbf admin admin] PATH_INFO: `/v3/users/23b089f5a1704180809febf9b361a75e` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:02.916261 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d74f5d1-1c22-4121-93f7-53622060ddbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=23b089f5a1704180809febf9b361a75e)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:02.919266 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d74f5d1-1c22-4121-93f7-53622060ddbf admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:03.230523 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 977/1933] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:44:02 2022] PUT /identity/v3/projects/59222c07aeb34cd18e016e8ed7a69c5c/users/d93eb33fa0964416aa17d5280a6883d7/roles/702e5e78b5d744529384b96a390ae92f => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:44:03.234237 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91d694-71c0-40aa-90d3-844dd6e7d6cc admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:03.235966 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-8e91d694-71c0-40aa-90d3-844dd6e7d6cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:03.303914 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91d694-71c0-40aa-90d3-844dd6e7d6cc admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:03.308904 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11572fb-d891-4c82-b060-4359eb722b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:03.309776 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11572fb-d891-4c82-b060-4359eb722b00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:03.310062 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11572fb-d891-4c82-b060-4359eb722b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:03.310341 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11572fb-d891-4c82-b060-4359eb722b00 admin admin] PATH_INFO: `/v3/projects/2a856c2cdc074d76b58244b124b29df6` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:03.311877 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11572fb-d891-4c82-b060-4359eb722b00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a856c2cdc074d76b58244b124b29df6)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:03.313479 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11572fb-d891-4c82-b060-4359eb722b00 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:03.420775 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-7d74f5d1-1c22-4121-93f7-53622060ddbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23b089f5a1704180809febf9b361a75e'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:03.421443 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-7d74f5d1-1c22-4121-93f7-53622060ddbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23b089f5a1704180809febf9b361a75e'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:03.566635 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-7d74f5d1-1c22-4121-93f7-53622060ddbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23b089f5a1704180809febf9b361a75e'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:03.577146 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-7d74f5d1-1c22-4121-93f7-53622060ddbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23b089f5a1704180809febf9b361a75e'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:03.591071 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a11572fb-d891-4c82-b060-4359eb722b00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a856c2cdc074d76b58244b124b29df6', 'request_id': 'req-a11572fb-d891-4c82-b060-4359eb722b00'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:03.592568 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-7d74f5d1-1c22-4121-93f7-53622060ddbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23b089f5a1704180809febf9b361a75e'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:03.600397 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 957/1934] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:44:02 2022] DELETE /identity/v3/users/23b089f5a1704180809febf9b361a75e => generated 0 bytes in 707 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:44:03.601693 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d74f5d1-1c22-4121-93f7-53622060ddbf admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:03.603771 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-7d74f5d1-1c22-4121-93f7-53622060ddbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:03.658306 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a11572fb-d891-4c82-b060-4359eb722b00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a856c2cdc074d76b58244b124b29df6', 'request_id': 'req-a11572fb-d891-4c82-b060-4359eb722b00'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:03.664543 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a11572fb-d891-4c82-b060-4359eb722b00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a856c2cdc074d76b58244b124b29df6', 'request_id': 'req-a11572fb-d891-4c82-b060-4359eb722b00'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:03.669876 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d74f5d1-1c22-4121-93f7-53622060ddbf admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:03.674631 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d6bb1a-a78d-4499-9b77-adef0ec85234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:03.675315 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6bb1a-a78d-4499-9b77-adef0ec85234 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:03.675643 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6bb1a-a78d-4499-9b77-adef0ec85234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:03.675920 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6bb1a-a78d-4499-9b77-adef0ec85234 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:03.676654 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d6bb1a-a78d-4499-9b77-adef0ec85234 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:03.677268 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a11572fb-d891-4c82-b060-4359eb722b00 admin admin] The token cache is being invalidate because project 2a856c2cdc074d76b58244b124b29df6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:44:03.677572 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a11572fb-d891-4c82-b060-4359eb722b00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:03.678257 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a11572fb-d891-4c82-b060-4359eb722b00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:03.679177 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d6bb1a-a78d-4499-9b77-adef0ec85234 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:03.682868 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 978/1935] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:44:03 2022] DELETE /identity/v3/projects/2a856c2cdc074d76b58244b124b29df6 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:44:03.682868 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c51057-fc78-4b48-b179-53c655442623 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:03.682868 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c51057-fc78-4b48-b179-53c655442623 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:03.682868 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c51057-fc78-4b48-b179-53c655442623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:03.696644 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 958/1936] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:44:03 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:44:03.696644 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d6bb1a-a78d-4499-9b77-adef0ec85234 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:03.696644 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-f4d6bb1a-a78d-4499-9b77-adef0ec85234 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:03.701751 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-e8c51057-fc78-4b48-b179-53c655442623 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:03.702988 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-e8c51057-fc78-4b48-b179-53c655442623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:03.708807 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d6bb1a-a78d-4499-9b77-adef0ec85234 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:03.711195 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 979/1937] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:44:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:44:03.711855 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c51057-fc78-4b48-b179-53c655442623 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:03.713165 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-e8c51057-fc78-4b48-b179-53c655442623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:03.714504 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db1bf1f-339a-42ac-9620-b032a8131934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:03.715595 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db1bf1f-339a-42ac-9620-b032a8131934 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:03.716086 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db1bf1f-339a-42ac-9620-b032a8131934 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:03.716686 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db1bf1f-339a-42ac-9620-b032a8131934 admin admin] PATH_INFO: `/v3/users/5e0f245b3a894fefa911bb63f94ac5b4` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:03.718285 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db1bf1f-339a-42ac-9620-b032a8131934 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e0f245b3a894fefa911bb63f94ac5b4)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:03.720707 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db1bf1f-339a-42ac-9620-b032a8131934 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:03.729890 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c51057-fc78-4b48-b179-53c655442623 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:03.734930 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8859bf-7b9a-441d-b77b-7481e57253e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:03.735859 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8859bf-7b9a-441d-b77b-7481e57253e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:03.736159 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8859bf-7b9a-441d-b77b-7481e57253e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:03.741628 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8859bf-7b9a-441d-b77b-7481e57253e3 admin admin] PATH_INFO: `/v3/projects/59222c07aeb34cd18e016e8ed7a69c5c/users/d93eb33fa0964416aa17d5280a6883d7/roles/702e5e78b5d744529384b96a390ae92f` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:03.741628 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8859bf-7b9a-441d-b77b-7481e57253e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59222c07aeb34cd18e016e8ed7a69c5c, user_id=d93eb33fa0964416aa17d5280a6883d7, role_id=702e5e78b5d744529384b96a390ae92f)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:03.741871 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8859bf-7b9a-441d-b77b-7481e57253e3 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:03.754164 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 980/1938] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:44:03 2022] PUT /identity/v3/projects/59222c07aeb34cd18e016e8ed7a69c5c/users/d93eb33fa0964416aa17d5280a6883d7/roles/702e5e78b5d744529384b96a390ae92f => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:44:03.755292 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8859bf-7b9a-441d-b77b-7481e57253e3 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:03.757110 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-4d8859bf-7b9a-441d-b77b-7481e57253e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:03.820322 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8859bf-7b9a-441d-b77b-7481e57253e3 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:03.824619 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf5c49a-e491-4d40-8545-a920c60559e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:03.825367 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf5c49a-e491-4d40-8545-a920c60559e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:03.825752 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf5c49a-e491-4d40-8545-a920c60559e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:03.826030 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf5c49a-e491-4d40-8545-a920c60559e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:03.892227 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf5c49a-e491-4d40-8545-a920c60559e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:03.893677 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf5c49a-e491-4d40-8545-a920c60559e5 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:03.904452 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 981/1939] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:44:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:44:03.905754 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab238b4-ce9b-45ae-8a97-56abcdaf077d None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:03.906174 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab238b4-ce9b-45ae-8a97-56abcdaf077d None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:03.906457 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab238b4-ce9b-45ae-8a97-56abcdaf077d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:03.933748 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-bab238b4-ce9b-45ae-8a97-56abcdaf077d None None] MFA Rules not processed for user `d93eb33fa0964416aa17d5280a6883d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:03.934983 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-bab238b4-ce9b-45ae-8a97-56abcdaf077d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:04.023644 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 982/1940] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:44:03 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:44:04.024203 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-7db1bf1f-339a-42ac-9620-b032a8131934 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e0f245b3a894fefa911bb63f94ac5b4'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:04.037238 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-7db1bf1f-339a-42ac-9620-b032a8131934 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e0f245b3a894fefa911bb63f94ac5b4'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:04.038003 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab238b4-ce9b-45ae-8a97-56abcdaf077d None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:04.044073 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-bab238b4-ce9b-45ae-8a97-56abcdaf077d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:04.121628 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab238b4-ce9b-45ae-8a97-56abcdaf077d None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:04.132012 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a470b-aa8a-45d8-aaf6-852ed878870c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '950b5b5f690d41509ead753065a0b793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:04.132701 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a470b-aa8a-45d8-aaf6-852ed878870c service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:04.132991 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a470b-aa8a-45d8-aaf6-852ed878870c service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:04.133273 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a470b-aa8a-45d8-aaf6-852ed878870c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:04.134967 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-7db1bf1f-339a-42ac-9620-b032a8131934 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e0f245b3a894fefa911bb63f94ac5b4'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:04.146255 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97a470b-aa8a-45d8-aaf6-852ed878870c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:04.148062 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97a470b-aa8a-45d8-aaf6-852ed878870c service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:04.164117 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-7db1bf1f-339a-42ac-9620-b032a8131934 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e0f245b3a894fefa911bb63f94ac5b4'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:04.175255 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 983/1941] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:44:04 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:44:04.214697 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-7db1bf1f-339a-42ac-9620-b032a8131934 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e0f245b3a894fefa911bb63f94ac5b4'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:04.223377 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 959/1942] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:44:03 2022] DELETE /identity/v3/users/5e0f245b3a894fefa911bb63f94ac5b4 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:44:04.636784 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a470b-aa8a-45d8-aaf6-852ed878870c service cinder] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:04.638261 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-c97a470b-aa8a-45d8-aaf6-852ed878870c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:04.669497 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a470b-aa8a-45d8-aaf6-852ed878870c service cinder] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:04.780790 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f286ce-4fdb-4a84-bd82-de4f5a9bfde5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:04.781866 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f286ce-4fdb-4a84-bd82-de4f5a9bfde5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:04.782156 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f286ce-4fdb-4a84-bd82-de4f5a9bfde5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:04.783282 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f286ce-4fdb-4a84-bd82-de4f5a9bfde5 admin admin] PATH_INFO: `/v3/projects/0dba6d63c69d4a22b9182986c924db59` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:04.784783 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f286ce-4fdb-4a84-bd82-de4f5a9bfde5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dba6d63c69d4a22b9182986c924db59)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:04.787300 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f286ce-4fdb-4a84-bd82-de4f5a9bfde5 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:04.965015 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db1bf1f-339a-42ac-9620-b032a8131934 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:04.966463 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-7db1bf1f-339a-42ac-9620-b032a8131934 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:04.982554 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db1bf1f-339a-42ac-9620-b032a8131934 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:04.987344 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35deb162-290d-4a5c-a4ad-b1d1631aec7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:04.988220 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35deb162-290d-4a5c-a4ad-b1d1631aec7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:04.988499 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35deb162-290d-4a5c-a4ad-b1d1631aec7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:04.988771 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35deb162-290d-4a5c-a4ad-b1d1631aec7b admin admin] PATH_INFO: `/v3/users/9478fa4325f54970b958def735151551` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:04.990265 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35deb162-290d-4a5c-a4ad-b1d1631aec7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9478fa4325f54970b958def735151551)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:04.992232 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35deb162-290d-4a5c-a4ad-b1d1631aec7b admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:05.031502 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f4f286ce-4fdb-4a84-bd82-de4f5a9bfde5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dba6d63c69d4a22b9182986c924db59', 'request_id': 'req-f4f286ce-4fdb-4a84-bd82-de4f5a9bfde5'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:05.199156 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f4f286ce-4fdb-4a84-bd82-de4f5a9bfde5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dba6d63c69d4a22b9182986c924db59', 'request_id': 'req-f4f286ce-4fdb-4a84-bd82-de4f5a9bfde5'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:05.206572 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f4f286ce-4fdb-4a84-bd82-de4f5a9bfde5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dba6d63c69d4a22b9182986c924db59', 'request_id': 'req-f4f286ce-4fdb-4a84-bd82-de4f5a9bfde5'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:05.219934 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f4f286ce-4fdb-4a84-bd82-de4f5a9bfde5 admin admin] The token cache is being invalidate because project 0dba6d63c69d4a22b9182986c924db59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:44:05.220413 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f4f286ce-4fdb-4a84-bd82-de4f5a9bfde5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:05.221170 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f4f286ce-4fdb-4a84-bd82-de4f5a9bfde5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:05.223125 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 984/1943] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:44:04 2022] DELETE /identity/v3/projects/0dba6d63c69d4a22b9182986c924db59 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:44:05.224790 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f286ce-4fdb-4a84-bd82-de4f5a9bfde5 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:05.227928 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-f4f286ce-4fdb-4a84-bd82-de4f5a9bfde5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:05.297475 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f286ce-4fdb-4a84-bd82-de4f5a9bfde5 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:05.302193 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c54948b-bcab-44ec-a262-e30460f26621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:05.303064 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c54948b-bcab-44ec-a262-e30460f26621 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:05.303348 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c54948b-bcab-44ec-a262-e30460f26621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:05.303653 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c54948b-bcab-44ec-a262-e30460f26621 admin admin] PATH_INFO: `/v3/projects/3f4b6d7fda0746748b525bf401ed2e89` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:05.304854 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c54948b-bcab-44ec-a262-e30460f26621 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f4b6d7fda0746748b525bf401ed2e89)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:05.307014 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c54948b-bcab-44ec-a262-e30460f26621 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:05.410816 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-35deb162-290d-4a5c-a4ad-b1d1631aec7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9478fa4325f54970b958def735151551'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:05.411588 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-35deb162-290d-4a5c-a4ad-b1d1631aec7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9478fa4325f54970b958def735151551'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:05.528754 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-5c54948b-bcab-44ec-a262-e30460f26621 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f4b6d7fda0746748b525bf401ed2e89', 'request_id': 'req-5c54948b-bcab-44ec-a262-e30460f26621'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:05.530735 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-35deb162-290d-4a5c-a4ad-b1d1631aec7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9478fa4325f54970b958def735151551'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:05.538995 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-35deb162-290d-4a5c-a4ad-b1d1631aec7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9478fa4325f54970b958def735151551'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:05.551650 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-35deb162-290d-4a5c-a4ad-b1d1631aec7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9478fa4325f54970b958def735151551'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:05.558654 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 960/1944] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:44:04 2022] DELETE /identity/v3/users/9478fa4325f54970b958def735151551 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:44:05.560035 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e379c38-45e4-4a1f-9ab1-9f4dbf3945b7 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:05.560330 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e379c38-45e4-4a1f-9ab1-9f4dbf3945b7 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:05.560655 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e379c38-45e4-4a1f-9ab1-9f4dbf3945b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:05.580027 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-4e379c38-45e4-4a1f-9ab1-9f4dbf3945b7 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:05.581244 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-4e379c38-45e4-4a1f-9ab1-9f4dbf3945b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:05.629528 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-5c54948b-bcab-44ec-a262-e30460f26621 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f4b6d7fda0746748b525bf401ed2e89', 'request_id': 'req-5c54948b-bcab-44ec-a262-e30460f26621'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:05.636795 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-5c54948b-bcab-44ec-a262-e30460f26621 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f4b6d7fda0746748b525bf401ed2e89', 'request_id': 'req-5c54948b-bcab-44ec-a262-e30460f26621'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:05.651452 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 961/1945] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:44:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:44:05.651452 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36920755-1632-4565-806b-31aba7c1f450 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:05.651452 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36920755-1632-4565-806b-31aba7c1f450 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:05.651452 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36920755-1632-4565-806b-31aba7c1f450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:05.652094 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-5c54948b-bcab-44ec-a262-e30460f26621 admin admin] The token cache is being invalidate because project 3f4b6d7fda0746748b525bf401ed2e89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:44:05.652094 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-5c54948b-bcab-44ec-a262-e30460f26621 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:05.652677 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-5c54948b-bcab-44ec-a262-e30460f26621 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:05.654441 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 985/1946] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:44:05 2022] DELETE /identity/v3/projects/3f4b6d7fda0746748b525bf401ed2e89 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:44:05.656046 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3c30c-cae4-4076-aca7-df269ff10dc4 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:05.665240 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3c30c-cae4-4076-aca7-df269ff10dc4 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:05.665240 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3c30c-cae4-4076-aca7-df269ff10dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:05.666794 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-36920755-1632-4565-806b-31aba7c1f450 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:05.668151 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-36920755-1632-4565-806b-31aba7c1f450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:05.681225 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-d1b3c30c-cae4-4076-aca7-df269ff10dc4 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:05.682471 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-d1b3c30c-cae4-4076-aca7-df269ff10dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:05.685367 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 962/1947] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:44:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:44:05.686781 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b970c9b-7019-4ba2-8fec-7e2bcff1173a None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:05.687134 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b970c9b-7019-4ba2-8fec-7e2bcff1173a None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:05.687580 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b970c9b-7019-4ba2-8fec-7e2bcff1173a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:05.694837 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 986/1948] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:44:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:44:05.700228 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b3c30c-cae4-4076-aca7-df269ff10dc4 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:05.710183 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b3c30c-cae4-4076-aca7-df269ff10dc4 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:05.711284 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-0b970c9b-7019-4ba2-8fec-7e2bcff1173a None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:05.712689 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0b970c9b-7019-4ba2-8fec-7e2bcff1173a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:05.715638 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a786f134-711d-408f-9e8b-3d9594f3c807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:05.716397 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a786f134-711d-408f-9e8b-3d9594f3c807 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:05.716750 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a786f134-711d-408f-9e8b-3d9594f3c807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:05.717162 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a786f134-711d-408f-9e8b-3d9594f3c807 admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:05.717826 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a786f134-711d-408f-9e8b-3d9594f3c807 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:44:05.718149 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a786f134-711d-408f-9e8b-3d9594f3c807 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:05.719817 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a786f134-711d-408f-9e8b-3d9594f3c807 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:05.721302 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 963/1949] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:44:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:44:05.722195 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b970c9b-7019-4ba2-8fec-7e2bcff1173a None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:05.724164 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0b970c9b-7019-4ba2-8fec-7e2bcff1173a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:05.740991 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 987/1950] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Apr 11 16:44:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:44:05.742441 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050815fa-9377-419e-8802-b99fe82086bd None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:05.742739 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050815fa-9377-419e-8802-b99fe82086bd None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:05.743026 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050815fa-9377-419e-8802-b99fe82086bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:05.763351 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-050815fa-9377-419e-8802-b99fe82086bd None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:05.764650 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-050815fa-9377-419e-8802-b99fe82086bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:05.773707 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 988/1951] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:44:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:44:05.774467 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050815fa-9377-419e-8802-b99fe82086bd None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:05.784405 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050815fa-9377-419e-8802-b99fe82086bd None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:05.789526 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2290e1e-df06-47e1-b4e1-0d5e97146b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:05.790393 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2290e1e-df06-47e1-b4e1-0d5e97146b18 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:05.790677 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2290e1e-df06-47e1-b4e1-0d5e97146b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:05.790951 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2290e1e-df06-47e1-b4e1-0d5e97146b18 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:05.791681 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2290e1e-df06-47e1-b4e1-0d5e97146b18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:05.793640 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2290e1e-df06-47e1-b4e1-0d5e97146b18 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:05.794884 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b970c9b-7019-4ba2-8fec-7e2bcff1173a None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:05.798940 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f75bd60-3288-4c23-b264-0704e0d9bd31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:05.799633 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f75bd60-3288-4c23-b264-0704e0d9bd31 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:05.799929 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f75bd60-3288-4c23-b264-0704e0d9bd31 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:05.800212 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f75bd60-3288-4c23-b264-0704e0d9bd31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:05.810050 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f75bd60-3288-4c23-b264-0704e0d9bd31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:05.814180 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f75bd60-3288-4c23-b264-0704e0d9bd31 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:05.821908 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 964/1952] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:44:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:44:05.822806 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f75bd60-3288-4c23-b264-0704e0d9bd31 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:05.832285 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f75bd60-3288-4c23-b264-0704e0d9bd31 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:05.838543 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc406f2-bcae-4bb4-9481-26f3dfdbce03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:05.839269 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc406f2-bcae-4bb4-9481-26f3dfdbce03 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:05.839601 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc406f2-bcae-4bb4-9481-26f3dfdbce03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:05.839884 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc406f2-bcae-4bb4-9481-26f3dfdbce03 admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:05.840717 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc406f2-bcae-4bb4-9481-26f3dfdbce03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:44:05.841151 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc406f2-bcae-4bb4-9481-26f3dfdbce03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:05.842780 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc406f2-bcae-4bb4-9481-26f3dfdbce03 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:05.860599 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 965/1953] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Apr 11 16:44:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:44:05.861903 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc406f2-bcae-4bb4-9481-26f3dfdbce03 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:05.874052 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc406f2-bcae-4bb4-9481-26f3dfdbce03 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:05.879337 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4887d2-cb8c-4dcb-958b-3cc376461812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:05.880723 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4887d2-cb8c-4dcb-958b-3cc376461812 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:05.880723 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4887d2-cb8c-4dcb-958b-3cc376461812 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:05.881300 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4887d2-cb8c-4dcb-958b-3cc376461812 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:05.881981 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4887d2-cb8c-4dcb-958b-3cc376461812 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:05.884254 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4887d2-cb8c-4dcb-958b-3cc376461812 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:05.890834 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 989/1954] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:44:05 2022] POST /identity/v3/projects => generated 371 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:44:05.896918 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2290e1e-df06-47e1-b4e1-0d5e97146b18 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:05.975300 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2290e1e-df06-47e1-b4e1-0d5e97146b18 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:05.980422 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5363e380-d0b8-4544-a79e-c91aff76127b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:05.981110 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5363e380-d0b8-4544-a79e-c91aff76127b admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:05.981413 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5363e380-d0b8-4544-a79e-c91aff76127b admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:05.981688 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5363e380-d0b8-4544-a79e-c91aff76127b admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:05.982393 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5363e380-d0b8-4544-a79e-c91aff76127b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:05.984370 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5363e380-d0b8-4544-a79e-c91aff76127b admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:06.020018 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 966/1955] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:44:05 2022] POST /identity/v3/projects => generated 383 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:44:06.024178 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4887d2-cb8c-4dcb-958b-3cc376461812 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:06.088276 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4887d2-cb8c-4dcb-958b-3cc376461812 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:06.093486 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a93e3b9-f528-4f1f-8559-476814a2a56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:06.094177 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a93e3b9-f528-4f1f-8559-476814a2a56c admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:06.094467 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a93e3b9-f528-4f1f-8559-476814a2a56c admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:06.094750 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a93e3b9-f528-4f1f-8559-476814a2a56c admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:06.095457 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a93e3b9-f528-4f1f-8559-476814a2a56c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:06.100407 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a93e3b9-f528-4f1f-8559-476814a2a56c admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:06.124355 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 990/1956] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:44:05 2022] POST /identity/v3/users => generated 286 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:44:06.146983 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5363e380-d0b8-4544-a79e-c91aff76127b admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:06.156781 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5363e380-d0b8-4544-a79e-c91aff76127b admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:06.161453 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a469e-a453-4a3a-9736-fb2abb5ceae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:06.162274 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a469e-a453-4a3a-9736-fb2abb5ceae6 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:06.162571 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a469e-a453-4a3a-9736-fb2abb5ceae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:06.162841 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a469e-a453-4a3a-9736-fb2abb5ceae6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:06.163635 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32a469e-a453-4a3a-9736-fb2abb5ceae6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:06.165216 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32a469e-a453-4a3a-9736-fb2abb5ceae6 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:06.175779 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 991/1957] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:44:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 16:44:06.180053 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a469e-a453-4a3a-9736-fb2abb5ceae6 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:06.190455 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a469e-a453-4a3a-9736-fb2abb5ceae6 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:06.198003 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d494d632-2a45-41f6-a8ab-929455c61033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:06.198688 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d494d632-2a45-41f6-a8ab-929455c61033 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:06.198979 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d494d632-2a45-41f6-a8ab-929455c61033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:06.199262 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d494d632-2a45-41f6-a8ab-929455c61033 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:06.200374 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d494d632-2a45-41f6-a8ab-929455c61033 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:06.201975 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d494d632-2a45-41f6-a8ab-929455c61033 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:06.213610 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 992/1958] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:44:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 16:44:06.217818 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d494d632-2a45-41f6-a8ab-929455c61033 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:06.227634 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d494d632-2a45-41f6-a8ab-929455c61033 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:06.232159 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e45392-d284-439e-a10c-4cfc945b49dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:06.233063 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e45392-d284-439e-a10c-4cfc945b49dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:06.233358 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e45392-d284-439e-a10c-4cfc945b49dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:06.233638 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e45392-d284-439e-a10c-4cfc945b49dd admin admin] PATH_INFO: `/v3/projects/7c73dedb0aee471aa791e50481cf8d30/users/5cd36d9f79ae41ed9a524fa2935206d9/roles/0d41da7bec094450b5bff4e4831be52c` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:06.248232 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e45392-d284-439e-a10c-4cfc945b49dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c73dedb0aee471aa791e50481cf8d30, user_id=5cd36d9f79ae41ed9a524fa2935206d9, role_id=0d41da7bec094450b5bff4e4831be52c)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:06.250806 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e45392-d284-439e-a10c-4cfc945b49dd admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:06.433490 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 967/1959] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:44:06 2022] POST /identity/v3/users => generated 292 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:44:06.439280 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a93e3b9-f528-4f1f-8559-476814a2a56c admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:06.454468 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a93e3b9-f528-4f1f-8559-476814a2a56c admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:06.477338 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 993/1960] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:44:06 2022] PUT /identity/v3/projects/7c73dedb0aee471aa791e50481cf8d30/users/5cd36d9f79ae41ed9a524fa2935206d9/roles/0d41da7bec094450b5bff4e4831be52c => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:44:06.478925 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e45392-d284-439e-a10c-4cfc945b49dd admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:06.480564 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-b9e45392-d284-439e-a10c-4cfc945b49dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:06.563847 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eee414-e97c-4835-9029-7047e509082d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:06.564625 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eee414-e97c-4835-9029-7047e509082d admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:06.564975 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eee414-e97c-4835-9029-7047e509082d admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:06.565347 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eee414-e97c-4835-9029-7047e509082d admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:06.566187 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eee414-e97c-4835-9029-7047e509082d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:06.568122 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eee414-e97c-4835-9029-7047e509082d admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:06.580378 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 968/1961] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:44:06 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 16:44:06.581737 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d65cb-5d47-4eb8-9acc-cf58cd5a9911 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:06.582372 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d65cb-5d47-4eb8-9acc-cf58cd5a9911 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:06.582372 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d65cb-5d47-4eb8-9acc-cf58cd5a9911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:06.613485 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e45392-d284-439e-a10c-4cfc945b49dd admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:06.623564 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-8a9d65cb-5d47-4eb8-9acc-cf58cd5a9911 None None] MFA Rules not processed for user `5cd36d9f79ae41ed9a524fa2935206d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:06.626875 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-8a9d65cb-5d47-4eb8-9acc-cf58cd5a9911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:06.630911 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc0a64-2757-4258-8d2e-8501cfe7b3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:06.632341 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc0a64-2757-4258-8d2e-8501cfe7b3bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:06.632846 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc0a64-2757-4258-8d2e-8501cfe7b3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:06.633308 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc0a64-2757-4258-8d2e-8501cfe7b3bb admin admin] PATH_INFO: `/v3/projects/803cefce21c643cdb275ca86e038f711` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:06.635031 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebc0a64-2757-4258-8d2e-8501cfe7b3bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=803cefce21c643cdb275ca86e038f711)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:06.637387 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebc0a64-2757-4258-8d2e-8501cfe7b3bb admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:06.719784 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 969/1962] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:44:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:44:06.720639 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9d65cb-5d47-4eb8-9acc-cf58cd5a9911 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:06.742692 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9d65cb-5d47-4eb8-9acc-cf58cd5a9911 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:06.747957 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b205a042-abb8-493b-825d-a16099c04a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:06.748681 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b205a042-abb8-493b-825d-a16099c04a9b admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:06.748956 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b205a042-abb8-493b-825d-a16099c04a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:06.749234 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b205a042-abb8-493b-825d-a16099c04a9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:06.749973 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b205a042-abb8-493b-825d-a16099c04a9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:06.751599 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b205a042-abb8-493b-825d-a16099c04a9b admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:06.764152 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 970/1963] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:44:06 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:44:06.764477 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b205a042-abb8-493b-825d-a16099c04a9b admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:06.768327 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b205a042-abb8-493b-825d-a16099c04a9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:06.782315 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-9ebc0a64-2757-4258-8d2e-8501cfe7b3bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '803cefce21c643cdb275ca86e038f711', 'request_id': 'req-9ebc0a64-2757-4258-8d2e-8501cfe7b3bb'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:06.839047 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b205a042-abb8-493b-825d-a16099c04a9b admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:06.856535 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-9ebc0a64-2757-4258-8d2e-8501cfe7b3bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '803cefce21c643cdb275ca86e038f711', 'request_id': 'req-9ebc0a64-2757-4258-8d2e-8501cfe7b3bb'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:06.867913 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-9ebc0a64-2757-4258-8d2e-8501cfe7b3bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '803cefce21c643cdb275ca86e038f711', 'request_id': 'req-9ebc0a64-2757-4258-8d2e-8501cfe7b3bb'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:06.886196 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-9ebc0a64-2757-4258-8d2e-8501cfe7b3bb admin admin] The token cache is being invalidate because project 803cefce21c643cdb275ca86e038f711 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:44:06.886584 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-9ebc0a64-2757-4258-8d2e-8501cfe7b3bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:06.887600 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-9ebc0a64-2757-4258-8d2e-8501cfe7b3bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:06.889554 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 994/1964] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:44:06 2022] DELETE /identity/v3/projects/803cefce21c643cdb275ca86e038f711 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:44:06.890897 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc0a64-2757-4258-8d2e-8501cfe7b3bb admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:06.894927 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-9ebc0a64-2757-4258-8d2e-8501cfe7b3bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:06.907065 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde91596-964f-4ec8-b901-892cfe81a62e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '950b5b5f690d41509ead753065a0b793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:06.907764 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde91596-964f-4ec8-b901-892cfe81a62e service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:06.908055 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde91596-964f-4ec8-b901-892cfe81a62e service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:06.908335 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde91596-964f-4ec8-b901-892cfe81a62e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:06.910237 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-cde91596-964f-4ec8-b901-892cfe81a62e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:06.978704 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde91596-964f-4ec8-b901-892cfe81a62e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:06.980593 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde91596-964f-4ec8-b901-892cfe81a62e service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:06.982534 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc0a64-2757-4258-8d2e-8501cfe7b3bb admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:06.987849 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3120ceda-5a31-48c5-9a2e-250ae19dc874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:06.988365 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3120ceda-5a31-48c5-9a2e-250ae19dc874 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:06.988649 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3120ceda-5a31-48c5-9a2e-250ae19dc874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:06.988924 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3120ceda-5a31-48c5-9a2e-250ae19dc874 admin admin] PATH_INFO: `/v3/projects/ef21e2a4d1af4eaba711aa29dce9ef23/users/6c27e51885e840e2ae832482de877401/roles/0d41da7bec094450b5bff4e4831be52c` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:06.992212 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 971/1965] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:44:06 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:44:06.993143 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde91596-964f-4ec8-b901-892cfe81a62e service cinder] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:06.994671 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-cde91596-964f-4ec8-b901-892cfe81a62e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:07.006743 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3120ceda-5a31-48c5-9a2e-250ae19dc874 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef21e2a4d1af4eaba711aa29dce9ef23, user_id=6c27e51885e840e2ae832482de877401, role_id=0d41da7bec094450b5bff4e4831be52c)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:07.009474 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3120ceda-5a31-48c5-9a2e-250ae19dc874 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:07.015723 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde91596-964f-4ec8-b901-892cfe81a62e service cinder] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:07.020416 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306ba980-4f40-4feb-8a58-a8617c3ad4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:07.021352 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ba980-4f40-4feb-8a58-a8617c3ad4e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:07.021638 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ba980-4f40-4feb-8a58-a8617c3ad4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:07.021986 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ba980-4f40-4feb-8a58-a8617c3ad4e6 admin admin] PATH_INFO: `/v3/users/d93eb33fa0964416aa17d5280a6883d7` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:07.023250 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306ba980-4f40-4feb-8a58-a8617c3ad4e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d93eb33fa0964416aa17d5280a6883d7)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:07.026142 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306ba980-4f40-4feb-8a58-a8617c3ad4e6 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:07.120765 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 995/1966] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:44:06 2022] PUT /identity/v3/projects/ef21e2a4d1af4eaba711aa29dce9ef23/users/6c27e51885e840e2ae832482de877401/roles/0d41da7bec094450b5bff4e4831be52c => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:44:07.132725 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f96dd-d465-4d5c-8d57-2e64502f7a53 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:07.133850 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f96dd-d465-4d5c-8d57-2e64502f7a53 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:07.134155 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f96dd-d465-4d5c-8d57-2e64502f7a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:07.166680 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-2c8f96dd-d465-4d5c-8d57-2e64502f7a53 None None] MFA Rules not processed for user `6c27e51885e840e2ae832482de877401`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:07.168111 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-2c8f96dd-d465-4d5c-8d57-2e64502f7a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:07.284782 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 996/1967] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:44:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:44:07.297204 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8f96dd-d465-4d5c-8d57-2e64502f7a53 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:07.304405 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-306ba980-4f40-4feb-8a58-a8617c3ad4e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd93eb33fa0964416aa17d5280a6883d7'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:07.305341 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-306ba980-4f40-4feb-8a58-a8617c3ad4e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd93eb33fa0964416aa17d5280a6883d7'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:07.369886 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8f96dd-d465-4d5c-8d57-2e64502f7a53 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:07.375059 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a4eb13-1566-49b5-a80c-20a8f2329d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:07.375770 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a4eb13-1566-49b5-a80c-20a8f2329d7d admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:07.376059 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a4eb13-1566-49b5-a80c-20a8f2329d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:07.376341 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a4eb13-1566-49b5-a80c-20a8f2329d7d admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:07.377043 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a4eb13-1566-49b5-a80c-20a8f2329d7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:07.381012 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a4eb13-1566-49b5-a80c-20a8f2329d7d admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:07.429571 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-306ba980-4f40-4feb-8a58-a8617c3ad4e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd93eb33fa0964416aa17d5280a6883d7'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:07.438517 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-306ba980-4f40-4feb-8a58-a8617c3ad4e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd93eb33fa0964416aa17d5280a6883d7'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:07.451119 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-306ba980-4f40-4feb-8a58-a8617c3ad4e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd93eb33fa0964416aa17d5280a6883d7'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:07.460627 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 972/1968] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:44:06 2022] DELETE /identity/v3/users/d93eb33fa0964416aa17d5280a6883d7 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:44:07.584954 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 997/1969] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:44:07 2022] POST /identity/v3/projects => generated 385 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:44:07.586201 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306ba980-4f40-4feb-8a58-a8617c3ad4e6 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:07.587816 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-306ba980-4f40-4feb-8a58-a8617c3ad4e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:07.664355 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306ba980-4f40-4feb-8a58-a8617c3ad4e6 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:07.746501 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3eeac2-c2bc-4c94-b8bd-a614cb06342c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:07.756650 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3eeac2-c2bc-4c94-b8bd-a614cb06342c admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:07.756650 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3eeac2-c2bc-4c94-b8bd-a614cb06342c admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:07.756650 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3eeac2-c2bc-4c94-b8bd-a614cb06342c admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:07.756650 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3eeac2-c2bc-4c94-b8bd-a614cb06342c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:07.756650 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3eeac2-c2bc-4c94-b8bd-a614cb06342c admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:07.913359 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 973/1970] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:44:07 2022] POST /identity/v3/users => generated 293 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:44:07.914602 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a4eb13-1566-49b5-a80c-20a8f2329d7d admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:07.924944 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a4eb13-1566-49b5-a80c-20a8f2329d7d admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:07.930785 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478043cc-1f13-48e9-b0fd-6f354242cd2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:07.931476 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478043cc-1f13-48e9-b0fd-6f354242cd2d admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:07.931793 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478043cc-1f13-48e9-b0fd-6f354242cd2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:07.932103 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478043cc-1f13-48e9-b0fd-6f354242cd2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:07.932853 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478043cc-1f13-48e9-b0fd-6f354242cd2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:07.934463 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478043cc-1f13-48e9-b0fd-6f354242cd2d admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:07.946779 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 998/1971] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:44:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 16:44:07.951350 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3eeac2-c2bc-4c94-b8bd-a614cb06342c admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:07.962150 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3eeac2-c2bc-4c94-b8bd-a614cb06342c admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:07.967385 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ebe22-b123-40dd-937b-b58664308d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:07.968129 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ebe22-b123-40dd-937b-b58664308d55 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:07.968418 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ebe22-b123-40dd-937b-b58664308d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:07.968684 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ebe22-b123-40dd-937b-b58664308d55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:07.969618 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41ebe22-b123-40dd-937b-b58664308d55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:07.971126 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41ebe22-b123-40dd-937b-b58664308d55 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:07.986891 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 974/1972] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:44:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:44:07.988865 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478043cc-1f13-48e9-b0fd-6f354242cd2d admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:08.000779 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478043cc-1f13-48e9-b0fd-6f354242cd2d admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:08.007615 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f70e26-4a1c-46df-aec9-28bbe0e00fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:08.007930 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ebe22-b123-40dd-937b-b58664308d55 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:08.008830 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f70e26-4a1c-46df-aec9-28bbe0e00fcb admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:08.009064 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f70e26-4a1c-46df-aec9-28bbe0e00fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:08.009372 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f70e26-4a1c-46df-aec9-28bbe0e00fcb admin admin] PATH_INFO: `/v3/projects/a93fc1c5a2564c1dbd049d0fcb4af917/users/bc394252f8e74bbeb1b72de2aa69364a/roles/0d41da7bec094450b5bff4e4831be52c` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:08.009760 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-d41ebe22-b123-40dd-937b-b58664308d55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:08.023183 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ebe22-b123-40dd-937b-b58664308d55 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:08.029646 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f70e26-4a1c-46df-aec9-28bbe0e00fcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a93fc1c5a2564c1dbd049d0fcb4af917, user_id=bc394252f8e74bbeb1b72de2aa69364a, role_id=0d41da7bec094450b5bff4e4831be52c)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:08.031397 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2280f879-d9d9-44ff-a2e1-1af1f5a3210e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:08.032674 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280f879-d9d9-44ff-a2e1-1af1f5a3210e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:08.034995 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f70e26-4a1c-46df-aec9-28bbe0e00fcb admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:08.035364 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280f879-d9d9-44ff-a2e1-1af1f5a3210e admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:08.035364 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280f879-d9d9-44ff-a2e1-1af1f5a3210e admin admin] PATH_INFO: `/v3/projects/59222c07aeb34cd18e016e8ed7a69c5c` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:08.035364 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2280f879-d9d9-44ff-a2e1-1af1f5a3210e admin admin] RBAC: Authorizing `identity:delete_project(project_id=59222c07aeb34cd18e016e8ed7a69c5c)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:08.036863 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2280f879-d9d9-44ff-a2e1-1af1f5a3210e admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:08.169791 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 999/1973] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:44:07 2022] PUT /identity/v3/projects/a93fc1c5a2564c1dbd049d0fcb4af917/users/bc394252f8e74bbeb1b72de2aa69364a/roles/0d41da7bec094450b5bff4e4831be52c => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:44:08.182904 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec2f18-bc77-44f3-8e26-5edc5adcba1c None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:08.183220 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec2f18-bc77-44f3-8e26-5edc5adcba1c None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:08.183659 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec2f18-bc77-44f3-8e26-5edc5adcba1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:08.215063 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-53ec2f18-bc77-44f3-8e26-5edc5adcba1c None None] MFA Rules not processed for user `bc394252f8e74bbeb1b72de2aa69364a`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:08.216577 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-53ec2f18-bc77-44f3-8e26-5edc5adcba1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:08.224803 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-2280f879-d9d9-44ff-a2e1-1af1f5a3210e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59222c07aeb34cd18e016e8ed7a69c5c', 'request_id': 'req-2280f879-d9d9-44ff-a2e1-1af1f5a3210e'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:08.231456 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-2280f879-d9d9-44ff-a2e1-1af1f5a3210e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59222c07aeb34cd18e016e8ed7a69c5c', 'request_id': 'req-2280f879-d9d9-44ff-a2e1-1af1f5a3210e'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:08.283967 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1000/1974] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:44:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:44:08.290070 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec2f18-bc77-44f3-8e26-5edc5adcba1c None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:08.321316 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-2280f879-d9d9-44ff-a2e1-1af1f5a3210e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59222c07aeb34cd18e016e8ed7a69c5c', 'request_id': 'req-2280f879-d9d9-44ff-a2e1-1af1f5a3210e'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:08.344067 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-2280f879-d9d9-44ff-a2e1-1af1f5a3210e admin admin] The token cache is being invalidate because project 59222c07aeb34cd18e016e8ed7a69c5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:44:08.344381 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-2280f879-d9d9-44ff-a2e1-1af1f5a3210e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:08.346238 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-2280f879-d9d9-44ff-a2e1-1af1f5a3210e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:08.353301 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 975/1975] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:44:08 2022] DELETE /identity/v3/projects/59222c07aeb34cd18e016e8ed7a69c5c => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:44:08.356235 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad4a3b-ed87-49b5-8d8e-bb2a9e61a238 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:08.356649 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad4a3b-ed87-49b5-8d8e-bb2a9e61a238 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:08.356931 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad4a3b-ed87-49b5-8d8e-bb2a9e61a238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:08.381314 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec2f18-bc77-44f3-8e26-5edc5adcba1c None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:08.382073 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-a4ad4a3b-ed87-49b5-8d8e-bb2a9e61a238 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:08.383345 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a4ad4a3b-ed87-49b5-8d8e-bb2a9e61a238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:08.386770 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1329fcc2-f8d2-4362-a8fb-931cd18c21e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:08.387479 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1329fcc2-f8d2-4362-a8fb-931cd18c21e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:08.387794 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1329fcc2-f8d2-4362-a8fb-931cd18c21e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:08.388070 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1329fcc2-f8d2-4362-a8fb-931cd18c21e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:08.389070 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1329fcc2-f8d2-4362-a8fb-931cd18c21e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:08.391540 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1329fcc2-f8d2-4362-a8fb-931cd18c21e2 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:08.394031 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 976/1976] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:44:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:44:08.403599 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c1c5f-e268-4512-a777-836fd96f7dd4 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:08.403930 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c1c5f-e268-4512-a777-836fd96f7dd4 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:08.404288 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c1c5f-e268-4512-a777-836fd96f7dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:08.425890 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-de7c1c5f-e268-4512-a777-836fd96f7dd4 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:08.427119 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-de7c1c5f-e268-4512-a777-836fd96f7dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:08.435908 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 977/1977] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:44:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:44:08.440033 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7c1c5f-e268-4512-a777-836fd96f7dd4 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:08.449802 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7c1c5f-e268-4512-a777-836fd96f7dd4 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:08.454809 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8a8037-45d7-4a56-a9f6-797d46eee0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:08.455509 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a8037-45d7-4a56-a9f6-797d46eee0ff admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:08.455851 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a8037-45d7-4a56-a9f6-797d46eee0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:08.456339 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a8037-45d7-4a56-a9f6-797d46eee0ff admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:08.457181 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8a8037-45d7-4a56-a9f6-797d46eee0ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:44:08.457682 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8a8037-45d7-4a56-a9f6-797d46eee0ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:08.459879 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8a8037-45d7-4a56-a9f6-797d46eee0ff admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:08.478236 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 978/1978] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Apr 11 16:44:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:44:08.483442 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8a8037-45d7-4a56-a9f6-797d46eee0ff admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:08.494549 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8a8037-45d7-4a56-a9f6-797d46eee0ff admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:08.509575 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc71b20-aee8-426f-a9a6-c6421775fe50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:08.510499 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc71b20-aee8-426f-a9a6-c6421775fe50 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:08.510784 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc71b20-aee8-426f-a9a6-c6421775fe50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:08.511061 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc71b20-aee8-426f-a9a6-c6421775fe50 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:08.511789 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc71b20-aee8-426f-a9a6-c6421775fe50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:08.514115 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc71b20-aee8-426f-a9a6-c6421775fe50 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:08.514274 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1001/1979] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:44:08 2022] POST /identity/v3/projects => generated 383 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:44:08.515015 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1329fcc2-f8d2-4362-a8fb-931cd18c21e2 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:08.517556 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-1329fcc2-f8d2-4362-a8fb-931cd18c21e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:08.590183 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1329fcc2-f8d2-4362-a8fb-931cd18c21e2 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:08.598053 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628fef66-133f-4e1d-a7bf-9dfdea5aa273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:08.599661 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628fef66-133f-4e1d-a7bf-9dfdea5aa273 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:08.600045 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628fef66-133f-4e1d-a7bf-9dfdea5aa273 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:08.600522 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628fef66-133f-4e1d-a7bf-9dfdea5aa273 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:08.601504 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628fef66-133f-4e1d-a7bf-9dfdea5aa273 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:08.603761 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628fef66-133f-4e1d-a7bf-9dfdea5aa273 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:08.657019 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 979/1980] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:44:08 2022] POST /identity/v3/projects => generated 383 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:44:08.661988 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc71b20-aee8-426f-a9a6-c6421775fe50 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:08.729074 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc71b20-aee8-426f-a9a6-c6421775fe50 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:08.733717 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f87165b-6bf6-4b48-b14c-ad4a712f15bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:08.734386 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f87165b-6bf6-4b48-b14c-ad4a712f15bc admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:08.734672 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f87165b-6bf6-4b48-b14c-ad4a712f15bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:08.734951 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f87165b-6bf6-4b48-b14c-ad4a712f15bc admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:08.735680 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f87165b-6bf6-4b48-b14c-ad4a712f15bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:08.737652 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f87165b-6bf6-4b48-b14c-ad4a712f15bc admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:08.752753 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1002/1981] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:44:08 2022] POST /identity/v3/users => generated 298 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:44:08.754059 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628fef66-133f-4e1d-a7bf-9dfdea5aa273 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:08.766825 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628fef66-133f-4e1d-a7bf-9dfdea5aa273 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:08.772390 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcdc91a-798e-4513-a770-e9abe2196996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:08.773091 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcdc91a-798e-4513-a770-e9abe2196996 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:08.773371 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcdc91a-798e-4513-a770-e9abe2196996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:08.773646 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcdc91a-798e-4513-a770-e9abe2196996 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:08.774496 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcdc91a-798e-4513-a770-e9abe2196996 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:08.776248 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcdc91a-798e-4513-a770-e9abe2196996 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:08.790634 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1003/1982] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:44:08 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:44:08.793062 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcdc91a-798e-4513-a770-e9abe2196996 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:08.795342 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-4bcdc91a-798e-4513-a770-e9abe2196996 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:08.815486 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcdc91a-798e-4513-a770-e9abe2196996 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:08.821359 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f750deb-48c6-4413-83dc-d1d51f4e7309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:08.822394 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f750deb-48c6-4413-83dc-d1d51f4e7309 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:08.822775 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f750deb-48c6-4413-83dc-d1d51f4e7309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:08.823129 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f750deb-48c6-4413-83dc-d1d51f4e7309 admin admin] PATH_INFO: `/v3/users/d42f484f79ba42e7b20b20ea061b4d61` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:08.824667 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f750deb-48c6-4413-83dc-d1d51f4e7309 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d42f484f79ba42e7b20b20ea061b4d61)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:08.827107 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f750deb-48c6-4413-83dc-d1d51f4e7309 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:08.866462 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 980/1983] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:44:08 2022] POST /identity/v3/users => generated 292 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:44:08.866462 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f87165b-6bf6-4b48-b14c-ad4a712f15bc admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:08.884811 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f87165b-6bf6-4b48-b14c-ad4a712f15bc admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:08.889490 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e5ae9c-28eb-4cdc-9723-6ed8db6f6964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:08.890597 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e5ae9c-28eb-4cdc-9723-6ed8db6f6964 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:08.890881 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e5ae9c-28eb-4cdc-9723-6ed8db6f6964 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:08.891157 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e5ae9c-28eb-4cdc-9723-6ed8db6f6964 admin admin] PATH_INFO: `/v3/projects/fdf6e2a974ef49a7801863faaecff8c4/users/733c11fc299a4878b98bcb13aeb044e3/roles/702e5e78b5d744529384b96a390ae92f` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:08.914727 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e5ae9c-28eb-4cdc-9723-6ed8db6f6964 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdf6e2a974ef49a7801863faaecff8c4, user_id=733c11fc299a4878b98bcb13aeb044e3, role_id=702e5e78b5d744529384b96a390ae92f)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:08.917954 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e5ae9c-28eb-4cdc-9723-6ed8db6f6964 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:09.055131 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 981/1984] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:44:08 2022] PUT /identity/v3/projects/fdf6e2a974ef49a7801863faaecff8c4/users/733c11fc299a4878b98bcb13aeb044e3/roles/702e5e78b5d744529384b96a390ae92f => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:44:09.056870 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e5ae9c-28eb-4cdc-9723-6ed8db6f6964 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:09.106564 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-0f750deb-48c6-4413-83dc-d1d51f4e7309 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd42f484f79ba42e7b20b20ea061b4d61'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:09.130463 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e5ae9c-28eb-4cdc-9723-6ed8db6f6964 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:09.135721 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf65bdb0-2649-4041-aa1d-5406de24defe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:09.136481 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65bdb0-2649-4041-aa1d-5406de24defe admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:09.136767 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65bdb0-2649-4041-aa1d-5406de24defe admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:09.137061 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65bdb0-2649-4041-aa1d-5406de24defe admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:09.137798 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf65bdb0-2649-4041-aa1d-5406de24defe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:09.139404 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf65bdb0-2649-4041-aa1d-5406de24defe admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:09.152314 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 982/1985] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:44:09 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:44:09.153404 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf65bdb0-2649-4041-aa1d-5406de24defe admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:09.165046 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf65bdb0-2649-4041-aa1d-5406de24defe admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:09.183258 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ccc8b-e2b7-4d9d-84d9-452943533cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:09.191811 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ccc8b-e2b7-4d9d-84d9-452943533cdb admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:09.191811 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ccc8b-e2b7-4d9d-84d9-452943533cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:09.191811 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ccc8b-e2b7-4d9d-84d9-452943533cdb admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:09.191811 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122ccc8b-e2b7-4d9d-84d9-452943533cdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:09.191811 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122ccc8b-e2b7-4d9d-84d9-452943533cdb admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:09.198428 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 983/1986] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:44:09 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:44:09.199430 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ccc8b-e2b7-4d9d-84d9-452943533cdb admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:09.211099 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ccc8b-e2b7-4d9d-84d9-452943533cdb admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:09.215865 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4d35bc-0ef6-4210-9bc5-f1c75e47245d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:09.216561 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4d35bc-0ef6-4210-9bc5-f1c75e47245d admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:09.216847 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4d35bc-0ef6-4210-9bc5-f1c75e47245d admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:09.217126 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4d35bc-0ef6-4210-9bc5-f1c75e47245d admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:09.218081 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4d35bc-0ef6-4210-9bc5-f1c75e47245d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:09.219986 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4d35bc-0ef6-4210-9bc5-f1c75e47245d admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:09.237904 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 984/1987] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:44:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:44:09.237904 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4d35bc-0ef6-4210-9bc5-f1c75e47245d admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:09.243151 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4d35bc-0ef6-4210-9bc5-f1c75e47245d admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:09.247791 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaa95b6-5685-4973-ae00-e4df5d4891d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:09.248688 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaa95b6-5685-4973-ae00-e4df5d4891d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:09.249017 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaa95b6-5685-4973-ae00-e4df5d4891d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:09.249293 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaa95b6-5685-4973-ae00-e4df5d4891d4 admin admin] PATH_INFO: `/v3/projects/fdf6e2a974ef49a7801863faaecff8c4/users/733c11fc299a4878b98bcb13aeb044e3/roles/702e5e78b5d744529384b96a390ae92f` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:09.251263 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaa95b6-5685-4973-ae00-e4df5d4891d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdf6e2a974ef49a7801863faaecff8c4, user_id=733c11fc299a4878b98bcb13aeb044e3, role_id=702e5e78b5d744529384b96a390ae92f)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:09.253899 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaa95b6-5685-4973-ae00-e4df5d4891d4 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:09.264353 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 985/1988] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:44:09 2022] PUT /identity/v3/projects/fdf6e2a974ef49a7801863faaecff8c4/users/733c11fc299a4878b98bcb13aeb044e3/roles/702e5e78b5d744529384b96a390ae92f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:44:09.265296 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaa95b6-5685-4973-ae00-e4df5d4891d4 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:09.268915 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-0f750deb-48c6-4413-83dc-d1d51f4e7309 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd42f484f79ba42e7b20b20ea061b4d61'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:09.280598 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-0f750deb-48c6-4413-83dc-d1d51f4e7309 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd42f484f79ba42e7b20b20ea061b4d61'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:09.281348 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-0f750deb-48c6-4413-83dc-d1d51f4e7309 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd42f484f79ba42e7b20b20ea061b4d61'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:09.293968 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-0f750deb-48c6-4413-83dc-d1d51f4e7309 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd42f484f79ba42e7b20b20ea061b4d61'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:09.300276 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1004/1989] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:44:08 2022] DELETE /identity/v3/users/d42f484f79ba42e7b20b20ea061b4d61 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:44:09.301960 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef3f8dc-862f-4662-afa8-ce430327b502 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:09.302313 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef3f8dc-862f-4662-afa8-ce430327b502 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:09.302844 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef3f8dc-862f-4662-afa8-ce430327b502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:09.329831 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-fef3f8dc-862f-4662-afa8-ce430327b502 None None] MFA Rules not processed for user `733c11fc299a4878b98bcb13aeb044e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:09.331027 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-fef3f8dc-862f-4662-afa8-ce430327b502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:09.337089 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaa95b6-5685-4973-ae00-e4df5d4891d4 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:09.399938 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c39ea8-e091-450e-9e97-be46a4cc0a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:09.401130 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c39ea8-e091-450e-9e97-be46a4cc0a50 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:09.401421 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c39ea8-e091-450e-9e97-be46a4cc0a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:09.401701 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c39ea8-e091-450e-9e97-be46a4cc0a50 admin admin] PATH_INFO: `/v3/projects/e3eb4ab2780b452aba01cb8e8319f56d/users/fd9c69f6ce394cddb3d411b15738164a/roles/0d41da7bec094450b5bff4e4831be52c` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:09.403816 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1005/1990] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:44:09 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:44:09.405392 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f87c9-6d1d-44f1-b25f-40594382e89c None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:09.405748 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f87c9-6d1d-44f1-b25f-40594382e89c None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:09.406092 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f87c9-6d1d-44f1-b25f-40594382e89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:09.423799 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c39ea8-e091-450e-9e97-be46a4cc0a50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3eb4ab2780b452aba01cb8e8319f56d, user_id=fd9c69f6ce394cddb3d411b15738164a, role_id=0d41da7bec094450b5bff4e4831be52c)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:09.424677 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-021f87c9-6d1d-44f1-b25f-40594382e89c None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:09.425900 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-021f87c9-6d1d-44f1-b25f-40594382e89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:09.426779 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c39ea8-e091-450e-9e97-be46a4cc0a50 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:09.434439 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1006/1991] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:44:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:44:09.435299 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021f87c9-6d1d-44f1-b25f-40594382e89c None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:09.436564 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-021f87c9-6d1d-44f1-b25f-40594382e89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:09.499811 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021f87c9-6d1d-44f1-b25f-40594382e89c None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:09.503698 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abadb83e-50f3-4a66-8e7e-91fc13b4c3d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '950b5b5f690d41509ead753065a0b793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:09.504358 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abadb83e-50f3-4a66-8e7e-91fc13b4c3d8 service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:09.505194 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abadb83e-50f3-4a66-8e7e-91fc13b4c3d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:09.505486 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abadb83e-50f3-4a66-8e7e-91fc13b4c3d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:09.515278 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abadb83e-50f3-4a66-8e7e-91fc13b4c3d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:09.516760 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abadb83e-50f3-4a66-8e7e-91fc13b4c3d8 service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:09.522065 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 986/1992] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:44:09 2022] PUT /identity/v3/projects/e3eb4ab2780b452aba01cb8e8319f56d/users/fd9c69f6ce394cddb3d411b15738164a/roles/0d41da7bec094450b5bff4e4831be52c => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:44:09.523197 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c39ea8-e091-450e-9e97-be46a4cc0a50 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:09.527691 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1007/1993] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:44:09 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:44:09.534443 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37cd957-419f-4677-afd0-f84ace573642 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:09.534728 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37cd957-419f-4677-afd0-f84ace573642 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:09.538232 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37cd957-419f-4677-afd0-f84ace573642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:09.540138 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-f4c39ea8-e091-450e-9e97-be46a4cc0a50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:09.565085 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-b37cd957-419f-4677-afd0-f84ace573642 None None] MFA Rules not processed for user `fd9c69f6ce394cddb3d411b15738164a`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:09.566432 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-b37cd957-419f-4677-afd0-f84ace573642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:09.624020 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c39ea8-e091-450e-9e97-be46a4cc0a50 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:09.634329 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7e6920-ef5c-4614-ae13-a106b92c1463 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:09.634984 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e6920-ef5c-4614-ae13-a106b92c1463 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:09.635282 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e6920-ef5c-4614-ae13-a106b92c1463 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:09.635593 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e6920-ef5c-4614-ae13-a106b92c1463 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:09.663573 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1008/1994] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:44:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:44:09.666596 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37cd957-419f-4677-afd0-f84ace573642 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:09.668045 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-b37cd957-419f-4677-afd0-f84ace573642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:09.736682 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7e6920-ef5c-4614-ae13-a106b92c1463 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:09.738159 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7e6920-ef5c-4614-ae13-a106b92c1463 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:09.740512 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37cd957-419f-4677-afd0-f84ace573642 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:09.745514 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a98e2c-35a0-4093-a5ed-498c0bbf5750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:09.747273 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a98e2c-35a0-4093-a5ed-498c0bbf5750 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:09.747273 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a98e2c-35a0-4093-a5ed-498c0bbf5750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:09.747273 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a98e2c-35a0-4093-a5ed-498c0bbf5750 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:09.747628 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a98e2c-35a0-4093-a5ed-498c0bbf5750 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:09.748816 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 987/1995] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:44:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:44:09.749486 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a98e2c-35a0-4093-a5ed-498c0bbf5750 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:09.888781 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1009/1996] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:44:09 2022] POST /identity/v3/projects => generated 385 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:44:09.892847 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7e6920-ef5c-4614-ae13-a106b92c1463 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:09.903122 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7e6920-ef5c-4614-ae13-a106b92c1463 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:09.973108 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aa6274-9cda-4044-b41b-6f3133cd8348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:09.973912 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa6274-9cda-4044-b41b-6f3133cd8348 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:09.980520 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa6274-9cda-4044-b41b-6f3133cd8348 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:09.980520 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa6274-9cda-4044-b41b-6f3133cd8348 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:09.980520 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aa6274-9cda-4044-b41b-6f3133cd8348 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:09.980520 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aa6274-9cda-4044-b41b-6f3133cd8348 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:10.299200 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 988/1997] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:44:09 2022] POST /identity/v3/users => generated 299 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:44:10.306547 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a98e2c-35a0-4093-a5ed-498c0bbf5750 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:10.316635 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a98e2c-35a0-4093-a5ed-498c0bbf5750 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:10.321510 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d84d9c2-3cae-4103-8537-d9552520ac6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:10.322181 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84d9c2-3cae-4103-8537-d9552520ac6e admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:10.322468 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84d9c2-3cae-4103-8537-d9552520ac6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:10.322752 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84d9c2-3cae-4103-8537-d9552520ac6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:10.323536 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d84d9c2-3cae-4103-8537-d9552520ac6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:10.325136 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d84d9c2-3cae-4103-8537-d9552520ac6e admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:10.338512 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1010/1998] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:44:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 16:44:10.344962 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aa6274-9cda-4044-b41b-6f3133cd8348 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:10.356553 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aa6274-9cda-4044-b41b-6f3133cd8348 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:10.361022 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b3bc18-523e-43b8-b496-f667ddb18da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:10.361905 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3bc18-523e-43b8-b496-f667ddb18da3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:10.362233 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3bc18-523e-43b8-b496-f667ddb18da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:10.362562 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3bc18-523e-43b8-b496-f667ddb18da3 admin admin] PATH_INFO: `/v3/projects/37ca6b916d8a45f7b16fdc2482ca5cc2/users/66141a041758448e862f84c4458f6c30/roles/702e5e78b5d744529384b96a390ae92f` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:10.378121 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b3bc18-523e-43b8-b496-f667ddb18da3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37ca6b916d8a45f7b16fdc2482ca5cc2, user_id=66141a041758448e862f84c4458f6c30, role_id=702e5e78b5d744529384b96a390ae92f)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:10.381245 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b3bc18-523e-43b8-b496-f667ddb18da3 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:10.420141 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d84d9c2-3cae-4103-8537-d9552520ac6e admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:10.421960 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-6d84d9c2-3cae-4103-8537-d9552520ac6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:10.435601 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d84d9c2-3cae-4103-8537-d9552520ac6e admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:10.440315 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdec477-5833-497c-9e72-b9f3cb7d29b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:10.441196 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdec477-5833-497c-9e72-b9f3cb7d29b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:10.441524 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdec477-5833-497c-9e72-b9f3cb7d29b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:10.441856 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdec477-5833-497c-9e72-b9f3cb7d29b2 admin admin] PATH_INFO: `/v3/projects/e88d3e45d46d4e7f83d952dade8044e0` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:10.443545 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdec477-5833-497c-9e72-b9f3cb7d29b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e88d3e45d46d4e7f83d952dade8044e0)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:10.445522 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdec477-5833-497c-9e72-b9f3cb7d29b2 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:10.567127 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 989/1999] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:44:10 2022] PUT /identity/v3/projects/37ca6b916d8a45f7b16fdc2482ca5cc2/users/66141a041758448e862f84c4458f6c30/roles/702e5e78b5d744529384b96a390ae92f => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:44:10.571320 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b3bc18-523e-43b8-b496-f667ddb18da3 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:10.640168 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b3bc18-523e-43b8-b496-f667ddb18da3 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:10.644630 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e6dfcb-fd21-4b0f-873d-563ce91d733e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:10.646538 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e6dfcb-fd21-4b0f-873d-563ce91d733e admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:10.646538 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e6dfcb-fd21-4b0f-873d-563ce91d733e admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:10.646538 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e6dfcb-fd21-4b0f-873d-563ce91d733e admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:10.647303 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e6dfcb-fd21-4b0f-873d-563ce91d733e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:10.648819 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e6dfcb-fd21-4b0f-873d-563ce91d733e admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:10.658532 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 990/2000] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:44:10 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 16:44:10.663209 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e6dfcb-fd21-4b0f-873d-563ce91d733e admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:10.673276 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e6dfcb-fd21-4b0f-873d-563ce91d733e admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:10.678899 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9d8001-76c6-47ba-bd3b-b691031e591e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:10.679869 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d8001-76c6-47ba-bd3b-b691031e591e admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:10.680158 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d8001-76c6-47ba-bd3b-b691031e591e admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:10.680701 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d8001-76c6-47ba-bd3b-b691031e591e admin admin] PATH_INFO: `/v3/projects/37ca6b916d8a45f7b16fdc2482ca5cc2/users/66141a041758448e862f84c4458f6c30/roles/702e5e78b5d744529384b96a390ae92f` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:10.682902 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9d8001-76c6-47ba-bd3b-b691031e591e admin admin] RBAC: Authorizing `identity:create_grant(project_id=37ca6b916d8a45f7b16fdc2482ca5cc2, user_id=66141a041758448e862f84c4458f6c30, role_id=702e5e78b5d744529384b96a390ae92f)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:10.685717 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9d8001-76c6-47ba-bd3b-b691031e591e admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:10.699147 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 991/2001] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:44:10 2022] PUT /identity/v3/projects/37ca6b916d8a45f7b16fdc2482ca5cc2/users/66141a041758448e862f84c4458f6c30/roles/702e5e78b5d744529384b96a390ae92f => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:44:10.706615 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-3fdec477-5833-497c-9e72-b9f3cb7d29b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e88d3e45d46d4e7f83d952dade8044e0', 'request_id': 'req-3fdec477-5833-497c-9e72-b9f3cb7d29b2'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:10.709851 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f5f968-bafb-4d0b-a9bf-f164f85c0935 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:10.710147 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f5f968-bafb-4d0b-a9bf-f164f85c0935 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:10.710590 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f5f968-bafb-4d0b-a9bf-f164f85c0935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:10.738043 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-43f5f968-bafb-4d0b-a9bf-f164f85c0935 None None] MFA Rules not processed for user `66141a041758448e862f84c4458f6c30`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:10.739295 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-43f5f968-bafb-4d0b-a9bf-f164f85c0935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:10.788453 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-3fdec477-5833-497c-9e72-b9f3cb7d29b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e88d3e45d46d4e7f83d952dade8044e0', 'request_id': 'req-3fdec477-5833-497c-9e72-b9f3cb7d29b2'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:10.799253 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-3fdec477-5833-497c-9e72-b9f3cb7d29b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e88d3e45d46d4e7f83d952dade8044e0', 'request_id': 'req-3fdec477-5833-497c-9e72-b9f3cb7d29b2'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:10.813175 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-3fdec477-5833-497c-9e72-b9f3cb7d29b2 admin admin] The token cache is being invalidate because project e88d3e45d46d4e7f83d952dade8044e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:44:10.813472 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-3fdec477-5833-497c-9e72-b9f3cb7d29b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:10.814162 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-3fdec477-5833-497c-9e72-b9f3cb7d29b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:10.818691 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1011/2002] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:44:10 2022] DELETE /identity/v3/projects/e88d3e45d46d4e7f83d952dade8044e0 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:44:10.822916 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 992/2003] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:44:10 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:44:10.824595 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdec477-5833-497c-9e72-b9f3cb7d29b2 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:10.826164 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-3fdec477-5833-497c-9e72-b9f3cb7d29b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:10.834253 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f5f968-bafb-4d0b-a9bf-f164f85c0935 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:10.834253 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-43f5f968-bafb-4d0b-a9bf-f164f85c0935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:10.896991 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f5f968-bafb-4d0b-a9bf-f164f85c0935 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:10.900654 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd368af-2f5c-451f-87a9-2630527ce4bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '950b5b5f690d41509ead753065a0b793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:10.901308 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd368af-2f5c-451f-87a9-2630527ce4bd service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:10.901599 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd368af-2f5c-451f-87a9-2630527ce4bd service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:10.901905 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd368af-2f5c-451f-87a9-2630527ce4bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:10.903898 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-3cd368af-2f5c-451f-87a9-2630527ce4bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:10.909294 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdec477-5833-497c-9e72-b9f3cb7d29b2 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:10.965578 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd368af-2f5c-451f-87a9-2630527ce4bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:10.966943 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd368af-2f5c-451f-87a9-2630527ce4bd service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:10.969543 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dcef72-3013-45ba-8e4c-ff4d13b907a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:10.970437 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dcef72-3013-45ba-8e4c-ff4d13b907a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:10.970724 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dcef72-3013-45ba-8e4c-ff4d13b907a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:10.970999 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dcef72-3013-45ba-8e4c-ff4d13b907a3 admin admin] PATH_INFO: `/v3/users/47c257bcdb874d36963fbe076582087f` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:10.972936 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dcef72-3013-45ba-8e4c-ff4d13b907a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47c257bcdb874d36963fbe076582087f)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:10.975091 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dcef72-3013-45ba-8e4c-ff4d13b907a3 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:10.976977 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 993/2004] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:44:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 16:44:11.260351 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-26dcef72-3013-45ba-8e4c-ff4d13b907a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47c257bcdb874d36963fbe076582087f'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:11.267582 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd368af-2f5c-451f-87a9-2630527ce4bd service cinder] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:11.268915 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-3cd368af-2f5c-451f-87a9-2630527ce4bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:11.282639 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd368af-2f5c-451f-87a9-2630527ce4bd service cinder] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:11.288848 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9676ee07-9f66-4139-9a77-05422029cdcb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '950b5b5f690d41509ead753065a0b793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:11.289722 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9676ee07-9f66-4139-9a77-05422029cdcb service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:11.290067 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9676ee07-9f66-4139-9a77-05422029cdcb service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:11.290345 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9676ee07-9f66-4139-9a77-05422029cdcb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:11.293447 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-9676ee07-9f66-4139-9a77-05422029cdcb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:11.361684 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9676ee07-9f66-4139-9a77-05422029cdcb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:11.363239 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9676ee07-9f66-4139-9a77-05422029cdcb service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:11.372240 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-26dcef72-3013-45ba-8e4c-ff4d13b907a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47c257bcdb874d36963fbe076582087f'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:11.375063 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 994/2005] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:44:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 16:44:11.387758 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-26dcef72-3013-45ba-8e4c-ff4d13b907a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47c257bcdb874d36963fbe076582087f'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:11.389480 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-26dcef72-3013-45ba-8e4c-ff4d13b907a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47c257bcdb874d36963fbe076582087f'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:11.406936 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-26dcef72-3013-45ba-8e4c-ff4d13b907a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47c257bcdb874d36963fbe076582087f'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:11.418458 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1012/2006] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:44:10 2022] DELETE /identity/v3/users/47c257bcdb874d36963fbe076582087f => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:44:12.151617 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9676ee07-9f66-4139-9a77-05422029cdcb service cinder] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:12.173107 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9676ee07-9f66-4139-9a77-05422029cdcb service cinder] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:12.254442 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c4ce17-88c2-49f3-935c-cc09355bc0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:12.256158 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c4ce17-88c2-49f3-935c-cc09355bc0bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:12.256494 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c4ce17-88c2-49f3-935c-cc09355bc0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:12.256775 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c4ce17-88c2-49f3-935c-cc09355bc0bc admin admin] PATH_INFO: `/v3/projects/adfd1d3fee394d3ca6d9c39166657ddc` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:12.258073 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c4ce17-88c2-49f3-935c-cc09355bc0bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=adfd1d3fee394d3ca6d9c39166657ddc)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:12.260087 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c4ce17-88c2-49f3-935c-cc09355bc0bc admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:12.427320 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-b4c4ce17-88c2-49f3-935c-cc09355bc0bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adfd1d3fee394d3ca6d9c39166657ddc', 'request_id': 'req-b4c4ce17-88c2-49f3-935c-cc09355bc0bc'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:12.433085 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-b4c4ce17-88c2-49f3-935c-cc09355bc0bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adfd1d3fee394d3ca6d9c39166657ddc', 'request_id': 'req-b4c4ce17-88c2-49f3-935c-cc09355bc0bc'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:12.518803 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-b4c4ce17-88c2-49f3-935c-cc09355bc0bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adfd1d3fee394d3ca6d9c39166657ddc', 'request_id': 'req-b4c4ce17-88c2-49f3-935c-cc09355bc0bc'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:12.532506 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-b4c4ce17-88c2-49f3-935c-cc09355bc0bc admin admin] The token cache is being invalidate because project adfd1d3fee394d3ca6d9c39166657ddc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:44:12.532798 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-b4c4ce17-88c2-49f3-935c-cc09355bc0bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:12.533466 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-b4c4ce17-88c2-49f3-935c-cc09355bc0bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:12.535033 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 995/2007] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:44:12 2022] DELETE /identity/v3/projects/adfd1d3fee394d3ca6d9c39166657ddc => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:44:12.540282 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815ca7c-ec9c-4399-ab02-43503533aaa6 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:12.540921 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815ca7c-ec9c-4399-ab02-43503533aaa6 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:12.540921 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815ca7c-ec9c-4399-ab02-43503533aaa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:12.560822 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-5815ca7c-ec9c-4399-ab02-43503533aaa6 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:12.562469 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-5815ca7c-ec9c-4399-ab02-43503533aaa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:12.642173 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1013/2008] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:44:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:44:12.651681 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af4e73-67d0-4b93-ad69-8f8be562efb9 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:12.652404 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af4e73-67d0-4b93-ad69-8f8be562efb9 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:12.652969 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af4e73-67d0-4b93-ad69-8f8be562efb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:12.685581 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-f8af4e73-67d0-4b93-ad69-8f8be562efb9 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:12.687146 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-f8af4e73-67d0-4b93-ad69-8f8be562efb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:12.707445 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 996/2009] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:44:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:44:12.713513 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5815ca7c-ec9c-4399-ab02-43503533aaa6 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:12.724757 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5815ca7c-ec9c-4399-ab02-43503533aaa6 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:12.731270 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb55c99c-0ab0-46ae-97e2-466e3056876c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:12.732336 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb55c99c-0ab0-46ae-97e2-466e3056876c admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:12.732996 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb55c99c-0ab0-46ae-97e2-466e3056876c admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:12.733644 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb55c99c-0ab0-46ae-97e2-466e3056876c admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:12.734876 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb55c99c-0ab0-46ae-97e2-466e3056876c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:44:12.735296 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb55c99c-0ab0-46ae-97e2-466e3056876c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:12.737410 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb55c99c-0ab0-46ae-97e2-466e3056876c admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:12.754478 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1014/2010] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Apr 11 16:44:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:44:12.760251 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8af4e73-67d0-4b93-ad69-8f8be562efb9 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:12.772362 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8af4e73-67d0-4b93-ad69-8f8be562efb9 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:12.777441 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a28b22-bf49-44d2-8696-db1874d39b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:12.778215 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a28b22-bf49-44d2-8696-db1874d39b97 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:12.778575 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a28b22-bf49-44d2-8696-db1874d39b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:12.778928 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a28b22-bf49-44d2-8696-db1874d39b97 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:12.779749 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a28b22-bf49-44d2-8696-db1874d39b97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:12.781879 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a28b22-bf49-44d2-8696-db1874d39b97 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:12.889202 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 997/2011] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:44:12 2022] POST /identity/v3/projects => generated 389 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:44:12.906203 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb55c99c-0ab0-46ae-97e2-466e3056876c admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:12.915279 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb55c99c-0ab0-46ae-97e2-466e3056876c admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:13.037528 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6987802d-0a8e-4a45-8faa-2fcf7f007b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:13.038359 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6987802d-0a8e-4a45-8faa-2fcf7f007b17 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:13.038716 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6987802d-0a8e-4a45-8faa-2fcf7f007b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:13.039084 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6987802d-0a8e-4a45-8faa-2fcf7f007b17 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:13.040156 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6987802d-0a8e-4a45-8faa-2fcf7f007b17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:13.042179 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6987802d-0a8e-4a45-8faa-2fcf7f007b17 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:13.200015 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1015/2012] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:44:12 2022] POST /identity/v3/users => generated 295 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:44:13.203668 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a28b22-bf49-44d2-8696-db1874d39b97 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:13.215704 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a28b22-bf49-44d2-8696-db1874d39b97 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:13.220884 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b42ad2-0d4e-487c-b5cd-4c43ffc5353a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:13.221822 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b42ad2-0d4e-487c-b5cd-4c43ffc5353a admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:13.226985 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b42ad2-0d4e-487c-b5cd-4c43ffc5353a admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:13.226985 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b42ad2-0d4e-487c-b5cd-4c43ffc5353a admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:13.226985 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b42ad2-0d4e-487c-b5cd-4c43ffc5353a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:13.226985 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b42ad2-0d4e-487c-b5cd-4c43ffc5353a admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:13.240767 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 998/2013] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:44:13 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:44:13.241603 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6987802d-0a8e-4a45-8faa-2fcf7f007b17 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:13.253012 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6987802d-0a8e-4a45-8faa-2fcf7f007b17 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:13.259049 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85859407-2846-47d7-90d5-f3c089dcdfd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:13.259777 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85859407-2846-47d7-90d5-f3c089dcdfd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:13.263761 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85859407-2846-47d7-90d5-f3c089dcdfd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:13.263761 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85859407-2846-47d7-90d5-f3c089dcdfd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:13.263761 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85859407-2846-47d7-90d5-f3c089dcdfd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:13.263761 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85859407-2846-47d7-90d5-f3c089dcdfd1 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:13.274213 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1016/2014] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:44:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:44:13.278348 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b42ad2-0d4e-487c-b5cd-4c43ffc5353a admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:13.293250 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b42ad2-0d4e-487c-b5cd-4c43ffc5353a admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:13.298038 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7610654-1911-474a-8a07-30719d194b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:13.302438 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7610654-1911-474a-8a07-30719d194b2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:13.302438 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7610654-1911-474a-8a07-30719d194b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:13.302438 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7610654-1911-474a-8a07-30719d194b2f admin admin] PATH_INFO: `/v3/projects/e863b622538f43cca2876d75b4d4546c/users/aaa0ff571d1e40adaa5947009658c3f5/roles/0d41da7bec094450b5bff4e4831be52c` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:13.316610 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7610654-1911-474a-8a07-30719d194b2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e863b622538f43cca2876d75b4d4546c, user_id=aaa0ff571d1e40adaa5947009658c3f5, role_id=0d41da7bec094450b5bff4e4831be52c)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:13.322000 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7610654-1911-474a-8a07-30719d194b2f admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:13.428845 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 999/2015] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:44:13 2022] PUT /identity/v3/projects/e863b622538f43cca2876d75b4d4546c/users/aaa0ff571d1e40adaa5947009658c3f5/roles/0d41da7bec094450b5bff4e4831be52c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:44:13.444254 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0708ab7e-2eb2-46d2-b121-9c03d9673f9d None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:13.444605 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0708ab7e-2eb2-46d2-b121-9c03d9673f9d None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:13.444883 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0708ab7e-2eb2-46d2-b121-9c03d9673f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:13.490087 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-0708ab7e-2eb2-46d2-b121-9c03d9673f9d None None] MFA Rules not processed for user `aaa0ff571d1e40adaa5947009658c3f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:13.491217 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-0708ab7e-2eb2-46d2-b121-9c03d9673f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:13.567467 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1017/2016] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:44:13 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:44:13.568747 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7610654-1911-474a-8a07-30719d194b2f admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:13.641573 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7610654-1911-474a-8a07-30719d194b2f admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:13.736717 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de2f25-e98a-4b1b-9fdc-1ae359c71f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:13.736717 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de2f25-e98a-4b1b-9fdc-1ae359c71f9f admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:13.736717 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de2f25-e98a-4b1b-9fdc-1ae359c71f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:13.736717 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de2f25-e98a-4b1b-9fdc-1ae359c71f9f admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:13.737181 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43de2f25-e98a-4b1b-9fdc-1ae359c71f9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:13.737181 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43de2f25-e98a-4b1b-9fdc-1ae359c71f9f admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:14.054260 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1000/2017] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:44:13 2022] POST /identity/v3/projects => generated 389 bytes in 486 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:44:14.058659 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0708ab7e-2eb2-46d2-b121-9c03d9673f9d None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:14.072064 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0708ab7e-2eb2-46d2-b121-9c03d9673f9d None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:14.147539 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d6ef46-914d-4847-ab02-ad02022b4acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:14.148247 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6ef46-914d-4847-ab02-ad02022b4acf admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:14.148540 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6ef46-914d-4847-ab02-ad02022b4acf admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:14.148816 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6ef46-914d-4847-ab02-ad02022b4acf admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:14.149543 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d6ef46-914d-4847-ab02-ad02022b4acf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:14.151710 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d6ef46-914d-4847-ab02-ad02022b4acf admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:14.279414 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1018/2018] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:44:14 2022] POST /identity/v3/users => generated 301 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:44:14.283148 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de2f25-e98a-4b1b-9fdc-1ae359c71f9f admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:14.294259 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de2f25-e98a-4b1b-9fdc-1ae359c71f9f admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:14.300140 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26c529d-f24c-4440-9528-150ca7f5857b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:14.300872 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26c529d-f24c-4440-9528-150ca7f5857b admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:14.301158 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26c529d-f24c-4440-9528-150ca7f5857b admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:14.302021 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26c529d-f24c-4440-9528-150ca7f5857b admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:14.302844 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26c529d-f24c-4440-9528-150ca7f5857b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:14.306694 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26c529d-f24c-4440-9528-150ca7f5857b admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:14.318991 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1001/2019] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:44:14 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:44:14.323360 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d6ef46-914d-4847-ab02-ad02022b4acf admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:14.333920 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d6ef46-914d-4847-ab02-ad02022b4acf admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:14.338775 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2412058e-2148-4d32-b4a7-78dba2846763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:14.339727 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412058e-2148-4d32-b4a7-78dba2846763 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:14.340018 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412058e-2148-4d32-b4a7-78dba2846763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:14.340296 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412058e-2148-4d32-b4a7-78dba2846763 admin admin] PATH_INFO: `/v3/projects/c6d861754c6a427c92ebb28bf88919f8/users/d0ec9ae489a0403ca9be159e988d1f3e/roles/702e5e78b5d744529384b96a390ae92f` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:14.356351 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2412058e-2148-4d32-b4a7-78dba2846763 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6d861754c6a427c92ebb28bf88919f8, user_id=d0ec9ae489a0403ca9be159e988d1f3e, role_id=702e5e78b5d744529384b96a390ae92f)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:14.359135 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2412058e-2148-4d32-b4a7-78dba2846763 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:14.507290 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1019/2020] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:44:14 2022] PUT /identity/v3/projects/c6d861754c6a427c92ebb28bf88919f8/users/d0ec9ae489a0403ca9be159e988d1f3e/roles/702e5e78b5d744529384b96a390ae92f => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:44:14.511706 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26c529d-f24c-4440-9528-150ca7f5857b admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:14.523160 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26c529d-f24c-4440-9528-150ca7f5857b admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:14.589245 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eaf055-b5ce-4d2a-bf27-fbf53bc16ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:14.590051 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eaf055-b5ce-4d2a-bf27-fbf53bc16ca5 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:14.590413 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eaf055-b5ce-4d2a-bf27-fbf53bc16ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:14.590848 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eaf055-b5ce-4d2a-bf27-fbf53bc16ca5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:14.591594 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eaf055-b5ce-4d2a-bf27-fbf53bc16ca5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:14.595093 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eaf055-b5ce-4d2a-bf27-fbf53bc16ca5 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:14.608192 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1002/2021] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:44:14 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:44:14.612506 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2412058e-2148-4d32-b4a7-78dba2846763 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:14.632038 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2412058e-2148-4d32-b4a7-78dba2846763 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:14.637078 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774d2358-795a-4782-8a99-ca78183c59d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:14.638021 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d2358-795a-4782-8a99-ca78183c59d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:14.638308 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d2358-795a-4782-8a99-ca78183c59d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:14.638648 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d2358-795a-4782-8a99-ca78183c59d6 admin admin] PATH_INFO: `/v3/projects/c6d861754c6a427c92ebb28bf88919f8/users/d0ec9ae489a0403ca9be159e988d1f3e/roles/702e5e78b5d744529384b96a390ae92f` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:14.640746 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774d2358-795a-4782-8a99-ca78183c59d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6d861754c6a427c92ebb28bf88919f8, user_id=d0ec9ae489a0403ca9be159e988d1f3e, role_id=702e5e78b5d744529384b96a390ae92f)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:14.644491 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774d2358-795a-4782-8a99-ca78183c59d6 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:14.657317 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1020/2022] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:44:14 2022] PUT /identity/v3/projects/c6d861754c6a427c92ebb28bf88919f8/users/d0ec9ae489a0403ca9be159e988d1f3e/roles/702e5e78b5d744529384b96a390ae92f => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:44:14.682120 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33a07b-02f3-4df9-943d-f0fb14933849 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:14.682461 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33a07b-02f3-4df9-943d-f0fb14933849 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:14.682895 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33a07b-02f3-4df9-943d-f0fb14933849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:14.714152 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-4a33a07b-02f3-4df9-943d-f0fb14933849 None None] MFA Rules not processed for user `d0ec9ae489a0403ca9be159e988d1f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:14.715727 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-4a33a07b-02f3-4df9-943d-f0fb14933849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:14.797528 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1003/2023] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:44:14 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:44:14.908605 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774d2358-795a-4782-8a99-ca78183c59d6 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:14.910515 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-774d2358-795a-4782-8a99-ca78183c59d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:15.002554 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774d2358-795a-4782-8a99-ca78183c59d6 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:15.006303 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2091f92c-1059-4cd0-aed3-701364679a86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '950b5b5f690d41509ead753065a0b793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:15.006974 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091f92c-1059-4cd0-aed3-701364679a86 service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:15.007262 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091f92c-1059-4cd0-aed3-701364679a86 service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:15.007591 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091f92c-1059-4cd0-aed3-701364679a86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:15.029372 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2091f92c-1059-4cd0-aed3-701364679a86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:15.030902 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2091f92c-1059-4cd0-aed3-701364679a86 service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:15.044016 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1021/2024] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:44:14 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 16:44:15.240981 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a33a07b-02f3-4df9-943d-f0fb14933849 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:15.336128 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a33a07b-02f3-4df9-943d-f0fb14933849 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:15.341020 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353da0e7-a370-4982-9991-0889aa4f9b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:15.341928 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353da0e7-a370-4982-9991-0889aa4f9b0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:15.342215 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353da0e7-a370-4982-9991-0889aa4f9b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:15.342500 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353da0e7-a370-4982-9991-0889aa4f9b0d admin admin] PATH_INFO: `/v3/users/aaa0ff571d1e40adaa5947009658c3f5` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:15.343741 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353da0e7-a370-4982-9991-0889aa4f9b0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=aaa0ff571d1e40adaa5947009658c3f5)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:15.345675 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353da0e7-a370-4982-9991-0889aa4f9b0d admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:16.036423 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-353da0e7-a370-4982-9991-0889aa4f9b0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aaa0ff571d1e40adaa5947009658c3f5'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:16.046749 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-353da0e7-a370-4982-9991-0889aa4f9b0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aaa0ff571d1e40adaa5947009658c3f5'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:16.291991 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-353da0e7-a370-4982-9991-0889aa4f9b0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aaa0ff571d1e40adaa5947009658c3f5'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:16.303361 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-353da0e7-a370-4982-9991-0889aa4f9b0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aaa0ff571d1e40adaa5947009658c3f5'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:16.341333 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-353da0e7-a370-4982-9991-0889aa4f9b0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aaa0ff571d1e40adaa5947009658c3f5'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:16.359404 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1004/2025] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:44:15 2022] DELETE /identity/v3/users/aaa0ff571d1e40adaa5947009658c3f5 => generated 0 bytes in 1118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:44:16.361660 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade74a9a-a394-42e3-b078-88e911705551 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:16.362132 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade74a9a-a394-42e3-b078-88e911705551 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:16.362346 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade74a9a-a394-42e3-b078-88e911705551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:16.393059 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-ade74a9a-a394-42e3-b078-88e911705551 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:16.394384 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-ade74a9a-a394-42e3-b078-88e911705551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:16.490595 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1022/2026] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:44:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:44:16.514338 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353da0e7-a370-4982-9991-0889aa4f9b0d admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:16.514338 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-353da0e7-a370-4982-9991-0889aa4f9b0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:16.576777 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353da0e7-a370-4982-9991-0889aa4f9b0d admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:16.580519 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17825ced-9788-4634-8d0d-36d3fa306bf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:16.581186 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17825ced-9788-4634-8d0d-36d3fa306bf9 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:16.581472 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17825ced-9788-4634-8d0d-36d3fa306bf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:16.582125 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17825ced-9788-4634-8d0d-36d3fa306bf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:16.592282 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17825ced-9788-4634-8d0d-36d3fa306bf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:16.593725 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17825ced-9788-4634-8d0d-36d3fa306bf9 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:16.603952 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1005/2027] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:44:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:44:17.153801 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade74a9a-a394-42e3-b078-88e911705551 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:17.153801 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-ade74a9a-a394-42e3-b078-88e911705551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:17.163726 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade74a9a-a394-42e3-b078-88e911705551 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:17.172205 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3230744-a1d0-4363-8d44-6cb979b36b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:17.173461 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3230744-a1d0-4363-8d44-6cb979b36b48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:17.173880 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3230744-a1d0-4363-8d44-6cb979b36b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:17.174407 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3230744-a1d0-4363-8d44-6cb979b36b48 admin admin] PATH_INFO: `/v3/projects/e863b622538f43cca2876d75b4d4546c` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:17.176976 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3230744-a1d0-4363-8d44-6cb979b36b48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e863b622538f43cca2876d75b4d4546c)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:17.180397 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3230744-a1d0-4363-8d44-6cb979b36b48 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:17.497475 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b3230744-a1d0-4363-8d44-6cb979b36b48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e863b622538f43cca2876d75b4d4546c', 'request_id': 'req-b3230744-a1d0-4363-8d44-6cb979b36b48'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:17.623381 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b3230744-a1d0-4363-8d44-6cb979b36b48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e863b622538f43cca2876d75b4d4546c', 'request_id': 'req-b3230744-a1d0-4363-8d44-6cb979b36b48'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:17.633324 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b3230744-a1d0-4363-8d44-6cb979b36b48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e863b622538f43cca2876d75b4d4546c', 'request_id': 'req-b3230744-a1d0-4363-8d44-6cb979b36b48'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:17.646413 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b3230744-a1d0-4363-8d44-6cb979b36b48 admin admin] The token cache is being invalidate because project e863b622538f43cca2876d75b4d4546c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:44:17.646702 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b3230744-a1d0-4363-8d44-6cb979b36b48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:17.647368 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b3230744-a1d0-4363-8d44-6cb979b36b48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:17.649989 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1023/2028] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:44:17 2022] DELETE /identity/v3/projects/e863b622538f43cca2876d75b4d4546c => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:44:17.653350 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17825ced-9788-4634-8d0d-36d3fa306bf9 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:17.665445 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17825ced-9788-4634-8d0d-36d3fa306bf9 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:17.763297 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef7e552-7ed3-40e5-93da-d4501b40dd4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:17.764269 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7e552-7ed3-40e5-93da-d4501b40dd4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:17.764574 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7e552-7ed3-40e5-93da-d4501b40dd4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:17.765037 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7e552-7ed3-40e5-93da-d4501b40dd4c admin admin] PATH_INFO: `/v3/users/d0ec9ae489a0403ca9be159e988d1f3e` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:17.767115 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef7e552-7ed3-40e5-93da-d4501b40dd4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0ec9ae489a0403ca9be159e988d1f3e)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:17.772527 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef7e552-7ed3-40e5-93da-d4501b40dd4c admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:18.028833 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-eef7e552-7ed3-40e5-93da-d4501b40dd4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0ec9ae489a0403ca9be159e988d1f3e'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:18.030615 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-eef7e552-7ed3-40e5-93da-d4501b40dd4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0ec9ae489a0403ca9be159e988d1f3e'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:18.098010 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-eef7e552-7ed3-40e5-93da-d4501b40dd4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0ec9ae489a0403ca9be159e988d1f3e'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:18.107639 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-eef7e552-7ed3-40e5-93da-d4501b40dd4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0ec9ae489a0403ca9be159e988d1f3e'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:18.122264 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-eef7e552-7ed3-40e5-93da-d4501b40dd4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0ec9ae489a0403ca9be159e988d1f3e'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:18.133270 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1006/2029] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:44:17 2022] DELETE /identity/v3/users/d0ec9ae489a0403ca9be159e988d1f3e => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:44:18.708014 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3230744-a1d0-4363-8d44-6cb979b36b48 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:18.709380 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-b3230744-a1d0-4363-8d44-6cb979b36b48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:18.747023 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3230744-a1d0-4363-8d44-6cb979b36b48 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:18.812192 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a75ddb-1817-44fb-8e02-557d234bfc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:18.813125 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a75ddb-1817-44fb-8e02-557d234bfc7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:18.813443 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a75ddb-1817-44fb-8e02-557d234bfc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:18.813731 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a75ddb-1817-44fb-8e02-557d234bfc7c admin admin] PATH_INFO: `/v3/projects/c6d861754c6a427c92ebb28bf88919f8` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:18.815041 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a75ddb-1817-44fb-8e02-557d234bfc7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6d861754c6a427c92ebb28bf88919f8)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:18.817592 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a75ddb-1817-44fb-8e02-557d234bfc7c admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:18.991364 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-28a75ddb-1817-44fb-8e02-557d234bfc7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6d861754c6a427c92ebb28bf88919f8', 'request_id': 'req-28a75ddb-1817-44fb-8e02-557d234bfc7c'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:19.092223 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-28a75ddb-1817-44fb-8e02-557d234bfc7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6d861754c6a427c92ebb28bf88919f8', 'request_id': 'req-28a75ddb-1817-44fb-8e02-557d234bfc7c'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:19.099379 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-28a75ddb-1817-44fb-8e02-557d234bfc7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6d861754c6a427c92ebb28bf88919f8', 'request_id': 'req-28a75ddb-1817-44fb-8e02-557d234bfc7c'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:19.113016 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-28a75ddb-1817-44fb-8e02-557d234bfc7c admin admin] The token cache is being invalidate because project c6d861754c6a427c92ebb28bf88919f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:44:19.113294 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-28a75ddb-1817-44fb-8e02-557d234bfc7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:19.114735 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-28a75ddb-1817-44fb-8e02-557d234bfc7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:19.120200 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1024/2030] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:44:18 2022] DELETE /identity/v3/projects/c6d861754c6a427c92ebb28bf88919f8 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:44:19.121949 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263408dc-63ce-485f-82c3-c81eb39becd8 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:19.122381 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263408dc-63ce-485f-82c3-c81eb39becd8 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:19.122381 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263408dc-63ce-485f-82c3-c81eb39becd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:19.155308 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-263408dc-63ce-485f-82c3-c81eb39becd8 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:19.156173 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-263408dc-63ce-485f-82c3-c81eb39becd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:19.235720 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1007/2031] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:44:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:44:19.244169 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2699ccb3-cbbb-4978-a11a-9a321ebb21d3 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:19.244398 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2699ccb3-cbbb-4978-a11a-9a321ebb21d3 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:19.244686 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2699ccb3-cbbb-4978-a11a-9a321ebb21d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:19.265221 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-2699ccb3-cbbb-4978-a11a-9a321ebb21d3 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:19.266652 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-2699ccb3-cbbb-4978-a11a-9a321ebb21d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:19.275959 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1025/2032] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:44:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:44:19.280233 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263408dc-63ce-485f-82c3-c81eb39becd8 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:19.291021 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263408dc-63ce-485f-82c3-c81eb39becd8 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:19.295879 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c51ad8a-b508-4c15-b0c6-1185d05fe13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:19.296883 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c51ad8a-b508-4c15-b0c6-1185d05fe13f admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:19.297245 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c51ad8a-b508-4c15-b0c6-1185d05fe13f admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:19.297683 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c51ad8a-b508-4c15-b0c6-1185d05fe13f admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:19.298457 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c51ad8a-b508-4c15-b0c6-1185d05fe13f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:44:19.299003 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c51ad8a-b508-4c15-b0c6-1185d05fe13f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:19.300831 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c51ad8a-b508-4c15-b0c6-1185d05fe13f admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:19.313858 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1008/2033] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Apr 11 16:44:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:44:19.318763 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2699ccb3-cbbb-4978-a11a-9a321ebb21d3 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:19.328765 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2699ccb3-cbbb-4978-a11a-9a321ebb21d3 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:19.335002 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14604404-6e8c-45a0-8993-bb0a17b14230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:19.335803 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14604404-6e8c-45a0-8993-bb0a17b14230 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:19.336193 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14604404-6e8c-45a0-8993-bb0a17b14230 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:19.337669 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14604404-6e8c-45a0-8993-bb0a17b14230 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:19.337669 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14604404-6e8c-45a0-8993-bb0a17b14230 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:19.339307 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14604404-6e8c-45a0-8993-bb0a17b14230 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:19.444270 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1026/2034] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:44:19 2022] POST /identity/v3/projects => generated 387 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:44:19.448264 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c51ad8a-b508-4c15-b0c6-1185d05fe13f admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:19.460206 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c51ad8a-b508-4c15-b0c6-1185d05fe13f admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:19.560877 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf5b632-e7bd-4598-b89f-4c8ce7261a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:19.561649 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf5b632-e7bd-4598-b89f-4c8ce7261a7e admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:19.562031 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf5b632-e7bd-4598-b89f-4c8ce7261a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:19.562376 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf5b632-e7bd-4598-b89f-4c8ce7261a7e admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:19.563151 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf5b632-e7bd-4598-b89f-4c8ce7261a7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:19.565576 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf5b632-e7bd-4598-b89f-4c8ce7261a7e admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:19.692801 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1009/2035] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:44:19 2022] POST /identity/v3/users => generated 294 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:44:19.697062 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14604404-6e8c-45a0-8993-bb0a17b14230 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:19.709982 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14604404-6e8c-45a0-8993-bb0a17b14230 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:19.719666 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad55b5f6-f675-4d74-a457-497566e3f9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:19.720683 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55b5f6-f675-4d74-a457-497566e3f9ae admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:19.721025 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55b5f6-f675-4d74-a457-497566e3f9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:19.721653 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55b5f6-f675-4d74-a457-497566e3f9ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:19.722556 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad55b5f6-f675-4d74-a457-497566e3f9ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:19.725121 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad55b5f6-f675-4d74-a457-497566e3f9ae admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:19.739906 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1027/2036] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:44:19 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:44:19.742156 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf5b632-e7bd-4598-b89f-4c8ce7261a7e admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:19.753585 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf5b632-e7bd-4598-b89f-4c8ce7261a7e admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:19.758951 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39563ecd-eb65-432b-a336-ffcffb338507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:19.761042 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39563ecd-eb65-432b-a336-ffcffb338507 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:19.761042 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39563ecd-eb65-432b-a336-ffcffb338507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:19.761042 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39563ecd-eb65-432b-a336-ffcffb338507 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:19.761297 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39563ecd-eb65-432b-a336-ffcffb338507 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:19.762972 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39563ecd-eb65-432b-a336-ffcffb338507 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:19.781007 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1010/2037] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:44:19 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:44:19.781916 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad55b5f6-f675-4d74-a457-497566e3f9ae admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:19.795480 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad55b5f6-f675-4d74-a457-497566e3f9ae admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:19.800873 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aa4e6f-8779-41e2-abb4-4046ac439c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:19.804591 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa4e6f-8779-41e2-abb4-4046ac439c6b admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:19.805442 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa4e6f-8779-41e2-abb4-4046ac439c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:19.806114 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa4e6f-8779-41e2-abb4-4046ac439c6b admin admin] PATH_INFO: `/v3/projects/00fc6e27fa2e4e1994326b4140db0e83/users/a84cf8063a5944649de0cdd734db410b/roles/0d41da7bec094450b5bff4e4831be52c` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:19.836144 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aa4e6f-8779-41e2-abb4-4046ac439c6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=00fc6e27fa2e4e1994326b4140db0e83, user_id=a84cf8063a5944649de0cdd734db410b, role_id=0d41da7bec094450b5bff4e4831be52c)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:19.839167 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aa4e6f-8779-41e2-abb4-4046ac439c6b admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:19.986705 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9553d91-5ef0-44b1-b506-ba9503aea08d None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:19.987216 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9553d91-5ef0-44b1-b506-ba9503aea08d None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:19.987672 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9553d91-5ef0-44b1-b506-ba9503aea08d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:19.990269 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1028/2038] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:44:19 2022] PUT /identity/v3/projects/00fc6e27fa2e4e1994326b4140db0e83/users/a84cf8063a5944649de0cdd734db410b/roles/0d41da7bec094450b5bff4e4831be52c => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:44:20.019361 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-e9553d91-5ef0-44b1-b506-ba9503aea08d None None] MFA Rules not processed for user `a84cf8063a5944649de0cdd734db410b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:20.021302 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e9553d91-5ef0-44b1-b506-ba9503aea08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:20.104223 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1011/2039] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:44:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:44:20.113950 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aa4e6f-8779-41e2-abb4-4046ac439c6b admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:20.236334 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aa4e6f-8779-41e2-abb4-4046ac439c6b admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:20.243219 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ccee5-d5f8-4880-a2f7-c2a6dd8b6401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:20.244140 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ccee5-d5f8-4880-a2f7-c2a6dd8b6401 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:20.244482 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ccee5-d5f8-4880-a2f7-c2a6dd8b6401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:20.259968 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ccee5-d5f8-4880-a2f7-c2a6dd8b6401 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:20.259968 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06ccee5-d5f8-4880-a2f7-c2a6dd8b6401 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:20.259968 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06ccee5-d5f8-4880-a2f7-c2a6dd8b6401 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:20.319472 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9553d91-5ef0-44b1-b506-ba9503aea08d None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:20.319472 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e9553d91-5ef0-44b1-b506-ba9503aea08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:20.382000 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1029/2040] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:44:20 2022] POST /identity/v3/projects => generated 385 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:44:20.385209 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9553d91-5ef0-44b1-b506-ba9503aea08d None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:20.392529 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ccee5-d5f8-4880-a2f7-c2a6dd8b6401 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:20.443751 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058064a2-cec3-4ea1-a42c-dfaf7a97503d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '950b5b5f690d41509ead753065a0b793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:20.444559 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058064a2-cec3-4ea1-a42c-dfaf7a97503d service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:20.445089 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058064a2-cec3-4ea1-a42c-dfaf7a97503d service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:20.445503 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058064a2-cec3-4ea1-a42c-dfaf7a97503d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:20.447879 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-058064a2-cec3-4ea1-a42c-dfaf7a97503d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:20.483174 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ccee5-d5f8-4880-a2f7-c2a6dd8b6401 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:20.505185 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189518f4-a393-46f1-8d7f-457c17e17e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:20.505914 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189518f4-a393-46f1-8d7f-457c17e17e6b admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:20.506178 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189518f4-a393-46f1-8d7f-457c17e17e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:20.506455 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189518f4-a393-46f1-8d7f-457c17e17e6b admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:20.507209 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189518f4-a393-46f1-8d7f-457c17e17e6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:20.509162 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189518f4-a393-46f1-8d7f-457c17e17e6b admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:20.540388 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058064a2-cec3-4ea1-a42c-dfaf7a97503d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:20.542540 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058064a2-cec3-4ea1-a42c-dfaf7a97503d service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:20.554243 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1012/2041] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:44:20 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 16:44:20.595158 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1030/2042] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:44:20 2022] POST /identity/v3/users => generated 299 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:44:20.601945 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058064a2-cec3-4ea1-a42c-dfaf7a97503d service cinder] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:20.621491 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058064a2-cec3-4ea1-a42c-dfaf7a97503d service cinder] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:20.634761 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9c40ac-b428-4adb-b905-ca89c8d53f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:20.635763 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c40ac-b428-4adb-b905-ca89c8d53f06 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:20.636284 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c40ac-b428-4adb-b905-ca89c8d53f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:20.636814 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c40ac-b428-4adb-b905-ca89c8d53f06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:20.638661 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9c40ac-b428-4adb-b905-ca89c8d53f06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:20.641241 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9c40ac-b428-4adb-b905-ca89c8d53f06 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:20.656019 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1013/2043] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:44:20 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:44:20.660371 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189518f4-a393-46f1-8d7f-457c17e17e6b admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:20.673523 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189518f4-a393-46f1-8d7f-457c17e17e6b admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:20.680345 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45997f04-dcb0-44e9-8326-f224658068d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:20.681744 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45997f04-dcb0-44e9-8326-f224658068d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:20.682036 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45997f04-dcb0-44e9-8326-f224658068d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:20.682322 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45997f04-dcb0-44e9-8326-f224658068d1 admin admin] PATH_INFO: `/v3/projects/6f320df2cce14879a9c85a67325ee035/users/880a07cf69f24347ae3e78b6c8ad676a/roles/702e5e78b5d744529384b96a390ae92f` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:20.705604 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45997f04-dcb0-44e9-8326-f224658068d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f320df2cce14879a9c85a67325ee035, user_id=880a07cf69f24347ae3e78b6c8ad676a, role_id=702e5e78b5d744529384b96a390ae92f)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:20.708898 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45997f04-dcb0-44e9-8326-f224658068d1 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:20.830124 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1031/2044] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:44:20 2022] PUT /identity/v3/projects/6f320df2cce14879a9c85a67325ee035/users/880a07cf69f24347ae3e78b6c8ad676a/roles/702e5e78b5d744529384b96a390ae92f => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:44:20.834627 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9c40ac-b428-4adb-b905-ca89c8d53f06 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:20.852263 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9c40ac-b428-4adb-b905-ca89c8d53f06 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:20.923288 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd327c50-a8e9-4b86-aadc-9cfc387b5713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:20.923901 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd327c50-a8e9-4b86-aadc-9cfc387b5713 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:20.924186 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd327c50-a8e9-4b86-aadc-9cfc387b5713 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:20.924465 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd327c50-a8e9-4b86-aadc-9cfc387b5713 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:20.925195 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd327c50-a8e9-4b86-aadc-9cfc387b5713 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:20.926972 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd327c50-a8e9-4b86-aadc-9cfc387b5713 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:20.938704 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1014/2045] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:44:20 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:44:20.942858 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45997f04-dcb0-44e9-8326-f224658068d1 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:20.955360 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45997f04-dcb0-44e9-8326-f224658068d1 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:20.962237 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255b54e6-0707-4a43-963d-77e8d083af05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:20.963286 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b54e6-0707-4a43-963d-77e8d083af05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:20.963767 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b54e6-0707-4a43-963d-77e8d083af05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:20.969492 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b54e6-0707-4a43-963d-77e8d083af05 admin admin] PATH_INFO: `/v3/projects/6f320df2cce14879a9c85a67325ee035/users/880a07cf69f24347ae3e78b6c8ad676a/roles/702e5e78b5d744529384b96a390ae92f` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:20.970559 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255b54e6-0707-4a43-963d-77e8d083af05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f320df2cce14879a9c85a67325ee035, user_id=880a07cf69f24347ae3e78b6c8ad676a, role_id=702e5e78b5d744529384b96a390ae92f)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:20.974126 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255b54e6-0707-4a43-963d-77e8d083af05 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:20.994664 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1032/2046] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:44:20 2022] PUT /identity/v3/projects/6f320df2cce14879a9c85a67325ee035/users/880a07cf69f24347ae3e78b6c8ad676a/roles/702e5e78b5d744529384b96a390ae92f => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:44:20.996674 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6e8c7-ae06-4163-92f7-b9129168efd1 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:20.996969 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6e8c7-ae06-4163-92f7-b9129168efd1 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:20.997338 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6e8c7-ae06-4163-92f7-b9129168efd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:21.039320 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-b7e6e8c7-ae06-4163-92f7-b9129168efd1 None None] MFA Rules not processed for user `880a07cf69f24347ae3e78b6c8ad676a`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:21.040868 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b7e6e8c7-ae06-4163-92f7-b9129168efd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:21.146041 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1015/2047] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:44:20 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:44:21.308125 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255b54e6-0707-4a43-963d-77e8d083af05 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:21.376714 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255b54e6-0707-4a43-963d-77e8d083af05 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:21.380748 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3fd3c5-1414-47ed-bb85-b90b5d6d028d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '950b5b5f690d41509ead753065a0b793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:21.381468 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3fd3c5-1414-47ed-bb85-b90b5d6d028d service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:21.381754 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3fd3c5-1414-47ed-bb85-b90b5d6d028d service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:21.382032 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3fd3c5-1414-47ed-bb85-b90b5d6d028d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:21.393073 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3fd3c5-1414-47ed-bb85-b90b5d6d028d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:21.395181 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3fd3c5-1414-47ed-bb85-b90b5d6d028d service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:21.407240 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1033/2048] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:44:21 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:44:21.910388 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e6e8c7-ae06-4163-92f7-b9129168efd1 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:21.920419 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e6e8c7-ae06-4163-92f7-b9129168efd1 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:21.924948 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc64248-c098-44b3-9807-c1f8ebc0d063 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '950b5b5f690d41509ead753065a0b793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:21.925609 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc64248-c098-44b3-9807-c1f8ebc0d063 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:21.926142 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc64248-c098-44b3-9807-c1f8ebc0d063 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:21.926755 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc64248-c098-44b3-9807-c1f8ebc0d063 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:21.928645 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ccc64248-c098-44b3-9807-c1f8ebc0d063 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:21.995888 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc64248-c098-44b3-9807-c1f8ebc0d063 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:21.997316 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc64248-c098-44b3-9807-c1f8ebc0d063 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:22.007795 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1016/2049] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:44:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:44:25.025243 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3fd3c5-1414-47ed-bb85-b90b5d6d028d service cinder] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:25.091317 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3fd3c5-1414-47ed-bb85-b90b5d6d028d service cinder] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:25.097451 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b964b9f6-a4ce-49bb-97e4-bb2c708328c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:25.101425 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b964b9f6-a4ce-49bb-97e4-bb2c708328c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:25.101425 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b964b9f6-a4ce-49bb-97e4-bb2c708328c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:25.101425 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b964b9f6-a4ce-49bb-97e4-bb2c708328c2 admin admin] PATH_INFO: `/v3/users/a84cf8063a5944649de0cdd734db410b` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:25.101953 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b964b9f6-a4ce-49bb-97e4-bb2c708328c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a84cf8063a5944649de0cdd734db410b)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:25.104413 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b964b9f6-a4ce-49bb-97e4-bb2c708328c2 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:25.384636 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b964b9f6-a4ce-49bb-97e4-bb2c708328c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a84cf8063a5944649de0cdd734db410b'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:25.525747 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b964b9f6-a4ce-49bb-97e4-bb2c708328c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a84cf8063a5944649de0cdd734db410b'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:25.532833 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b964b9f6-a4ce-49bb-97e4-bb2c708328c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a84cf8063a5944649de0cdd734db410b'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:25.533512 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b964b9f6-a4ce-49bb-97e4-bb2c708328c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a84cf8063a5944649de0cdd734db410b'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:25.545669 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b964b9f6-a4ce-49bb-97e4-bb2c708328c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a84cf8063a5944649de0cdd734db410b'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:25.552588 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1034/2050] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:44:25 2022] DELETE /identity/v3/users/a84cf8063a5944649de0cdd734db410b => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:44:25.557358 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b750e71-4838-4a92-8f88-0573419b444b None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:25.557837 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b750e71-4838-4a92-8f88-0573419b444b None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:25.557837 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b750e71-4838-4a92-8f88-0573419b444b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:25.575288 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-4b750e71-4838-4a92-8f88-0573419b444b None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:25.576507 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-4b750e71-4838-4a92-8f88-0573419b444b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:25.645347 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1017/2051] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:44:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:44:25.655592 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b964b9f6-a4ce-49bb-97e4-bb2c708328c2 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:25.657092 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-b964b9f6-a4ce-49bb-97e4-bb2c708328c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:25.714240 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b964b9f6-a4ce-49bb-97e4-bb2c708328c2 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:25.717897 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a424b-3a03-4c86-afd7-a475a1078ebf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:25.718580 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a424b-3a03-4c86-afd7-a475a1078ebf service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:25.718846 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a424b-3a03-4c86-afd7-a475a1078ebf service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:25.719122 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a424b-3a03-4c86-afd7-a475a1078ebf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:25.728663 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a424b-3a03-4c86-afd7-a475a1078ebf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:25.730109 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a424b-3a03-4c86-afd7-a475a1078ebf service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:25.740241 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1035/2052] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:44:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:44:26.319740 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b750e71-4838-4a92-8f88-0573419b444b None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:26.321226 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-4b750e71-4838-4a92-8f88-0573419b444b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:26.336777 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b750e71-4838-4a92-8f88-0573419b444b None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:26.344901 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71592a37-dc52-4e8b-b567-05c5238e85d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:26.345787 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71592a37-dc52-4e8b-b567-05c5238e85d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:26.346067 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71592a37-dc52-4e8b-b567-05c5238e85d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:26.346350 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71592a37-dc52-4e8b-b567-05c5238e85d0 admin admin] PATH_INFO: `/v3/projects/00fc6e27fa2e4e1994326b4140db0e83` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:26.347743 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71592a37-dc52-4e8b-b567-05c5238e85d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00fc6e27fa2e4e1994326b4140db0e83)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:26.349666 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71592a37-dc52-4e8b-b567-05c5238e85d0 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:26.555706 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-71592a37-dc52-4e8b-b567-05c5238e85d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00fc6e27fa2e4e1994326b4140db0e83', 'request_id': 'req-71592a37-dc52-4e8b-b567-05c5238e85d0'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:26.561276 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-71592a37-dc52-4e8b-b567-05c5238e85d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00fc6e27fa2e4e1994326b4140db0e83', 'request_id': 'req-71592a37-dc52-4e8b-b567-05c5238e85d0'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:26.663165 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-71592a37-dc52-4e8b-b567-05c5238e85d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00fc6e27fa2e4e1994326b4140db0e83', 'request_id': 'req-71592a37-dc52-4e8b-b567-05c5238e85d0'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:26.674325 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-71592a37-dc52-4e8b-b567-05c5238e85d0 admin admin] The token cache is being invalidate because project 00fc6e27fa2e4e1994326b4140db0e83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:44:26.674619 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-71592a37-dc52-4e8b-b567-05c5238e85d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:26.675252 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-71592a37-dc52-4e8b-b567-05c5238e85d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:26.677507 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1018/2053] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:44:26 2022] DELETE /identity/v3/projects/00fc6e27fa2e4e1994326b4140db0e83 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:44:26.681862 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a424b-3a03-4c86-afd7-a475a1078ebf service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:26.691229 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a424b-3a03-4c86-afd7-a475a1078ebf service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:26.746865 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f76440-3ee7-4fae-89d4-c9a102c85d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:26.747779 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f76440-3ee7-4fae-89d4-c9a102c85d17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:26.748070 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f76440-3ee7-4fae-89d4-c9a102c85d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:26.748350 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f76440-3ee7-4fae-89d4-c9a102c85d17 admin admin] PATH_INFO: `/v3/users/880a07cf69f24347ae3e78b6c8ad676a` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:26.749547 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f76440-3ee7-4fae-89d4-c9a102c85d17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=880a07cf69f24347ae3e78b6c8ad676a)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:26.751453 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f76440-3ee7-4fae-89d4-c9a102c85d17 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:26.979622 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-59f76440-3ee7-4fae-89d4-c9a102c85d17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '880a07cf69f24347ae3e78b6c8ad676a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:27.102979 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-59f76440-3ee7-4fae-89d4-c9a102c85d17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '880a07cf69f24347ae3e78b6c8ad676a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:27.110437 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-59f76440-3ee7-4fae-89d4-c9a102c85d17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '880a07cf69f24347ae3e78b6c8ad676a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:27.111008 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-59f76440-3ee7-4fae-89d4-c9a102c85d17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '880a07cf69f24347ae3e78b6c8ad676a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:27.122495 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-59f76440-3ee7-4fae-89d4-c9a102c85d17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '880a07cf69f24347ae3e78b6c8ad676a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:27.128358 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1036/2054] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:44:26 2022] DELETE /identity/v3/users/880a07cf69f24347ae3e78b6c8ad676a => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:44:27.619830 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71592a37-dc52-4e8b-b567-05c5238e85d0 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:27.623026 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-71592a37-dc52-4e8b-b567-05c5238e85d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:27.637054 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71592a37-dc52-4e8b-b567-05c5238e85d0 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:27.704174 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b7c474-639a-4ccd-827e-d4f7476faf84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:27.705054 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b7c474-639a-4ccd-827e-d4f7476faf84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:27.705423 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b7c474-639a-4ccd-827e-d4f7476faf84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:27.705707 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b7c474-639a-4ccd-827e-d4f7476faf84 admin admin] PATH_INFO: `/v3/projects/6f320df2cce14879a9c85a67325ee035` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:27.707680 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b7c474-639a-4ccd-827e-d4f7476faf84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f320df2cce14879a9c85a67325ee035)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:27.709491 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b7c474-639a-4ccd-827e-d4f7476faf84 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:27.833089 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-45b7c474-639a-4ccd-827e-d4f7476faf84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f320df2cce14879a9c85a67325ee035', 'request_id': 'req-45b7c474-639a-4ccd-827e-d4f7476faf84'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:27.838544 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-45b7c474-639a-4ccd-827e-d4f7476faf84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f320df2cce14879a9c85a67325ee035', 'request_id': 'req-45b7c474-639a-4ccd-827e-d4f7476faf84'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:27.920975 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f76440-3ee7-4fae-89d4-c9a102c85d17 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:27.922472 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-59f76440-3ee7-4fae-89d4-c9a102c85d17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:27.931366 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-45b7c474-639a-4ccd-827e-d4f7476faf84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f320df2cce14879a9c85a67325ee035', 'request_id': 'req-45b7c474-639a-4ccd-827e-d4f7476faf84'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:27.936159 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f76440-3ee7-4fae-89d4-c9a102c85d17 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:27.944551 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-45b7c474-639a-4ccd-827e-d4f7476faf84 admin admin] The token cache is being invalidate because project 6f320df2cce14879a9c85a67325ee035 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:44:27.945013 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-45b7c474-639a-4ccd-827e-d4f7476faf84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:27.945968 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-45b7c474-639a-4ccd-827e-d4f7476faf84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:27.947553 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1019/2055] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:44:27 2022] DELETE /identity/v3/projects/6f320df2cce14879a9c85a67325ee035 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:44:27.953230 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5afa691-cd97-4ea9-821b-797c5b40b1ed None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:27.953548 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5afa691-cd97-4ea9-821b-797c5b40b1ed None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:27.953829 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5afa691-cd97-4ea9-821b-797c5b40b1ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:27.973014 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-e5afa691-cd97-4ea9-821b-797c5b40b1ed None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:27.974263 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e5afa691-cd97-4ea9-821b-797c5b40b1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:27.998467 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0494a939-0d97-456a-8f28-ad0026f03f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:27.999299 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0494a939-0d97-456a-8f28-ad0026f03f3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:27.999611 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0494a939-0d97-456a-8f28-ad0026f03f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:27.999889 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0494a939-0d97-456a-8f28-ad0026f03f3d admin admin] PATH_INFO: `/v3/users/6c27e51885e840e2ae832482de877401` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:28.001074 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0494a939-0d97-456a-8f28-ad0026f03f3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c27e51885e840e2ae832482de877401)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:28.002990 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0494a939-0d97-456a-8f28-ad0026f03f3d admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:28.030806 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1020/2056] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:44:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:44:28.039651 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944af33-09bd-4dc6-b8b3-046e0629302e None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:28.039946 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944af33-09bd-4dc6-b8b3-046e0629302e None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:28.040227 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944af33-09bd-4dc6-b8b3-046e0629302e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:28.058182 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-9944af33-09bd-4dc6-b8b3-046e0629302e None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:28.059399 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-9944af33-09bd-4dc6-b8b3-046e0629302e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:28.067317 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1021/2057] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:44:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:44:28.071229 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9944af33-09bd-4dc6-b8b3-046e0629302e None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:28.079805 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9944af33-09bd-4dc6-b8b3-046e0629302e None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:28.084519 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5848f92f-5276-4867-b728-e34ca8e23983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:28.085151 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848f92f-5276-4867-b728-e34ca8e23983 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:28.085434 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848f92f-5276-4867-b728-e34ca8e23983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:28.085713 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848f92f-5276-4867-b728-e34ca8e23983 admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:28.086486 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5848f92f-5276-4867-b728-e34ca8e23983 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:44:28.086797 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5848f92f-5276-4867-b728-e34ca8e23983 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:28.088403 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5848f92f-5276-4867-b728-e34ca8e23983 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:28.100097 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1022/2058] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Apr 11 16:44:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:44:28.110079 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5848f92f-5276-4867-b728-e34ca8e23983 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:28.122406 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5848f92f-5276-4867-b728-e34ca8e23983 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:28.127864 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29bef0c-f042-4fd2-ab87-2b538e27c747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:28.128074 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29bef0c-f042-4fd2-ab87-2b538e27c747 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:28.128330 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29bef0c-f042-4fd2-ab87-2b538e27c747 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:28.129280 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29bef0c-f042-4fd2-ab87-2b538e27c747 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:28.129452 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29bef0c-f042-4fd2-ab87-2b538e27c747 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:28.131351 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29bef0c-f042-4fd2-ab87-2b538e27c747 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:28.230744 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-0494a939-0d97-456a-8f28-ad0026f03f3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c27e51885e840e2ae832482de877401'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:28.252709 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1023/2059] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:44:28 2022] POST /identity/v3/projects => generated 377 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:44:28.256986 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29bef0c-f042-4fd2-ab87-2b538e27c747 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:28.317700 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29bef0c-f042-4fd2-ab87-2b538e27c747 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:28.322312 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0564a62-b6dd-4345-a89a-59bde45382a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:28.322984 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0564a62-b6dd-4345-a89a-59bde45382a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:28.323264 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0564a62-b6dd-4345-a89a-59bde45382a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:28.323595 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0564a62-b6dd-4345-a89a-59bde45382a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:28.324257 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0564a62-b6dd-4345-a89a-59bde45382a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:28.326151 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0564a62-b6dd-4345-a89a-59bde45382a8 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:28.346695 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-0494a939-0d97-456a-8f28-ad0026f03f3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c27e51885e840e2ae832482de877401'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:28.354980 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-0494a939-0d97-456a-8f28-ad0026f03f3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c27e51885e840e2ae832482de877401'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:28.355640 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-0494a939-0d97-456a-8f28-ad0026f03f3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c27e51885e840e2ae832482de877401'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:28.367676 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-0494a939-0d97-456a-8f28-ad0026f03f3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c27e51885e840e2ae832482de877401'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:28.373588 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1037/2060] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:44:27 2022] DELETE /identity/v3/users/6c27e51885e840e2ae832482de877401 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:44:28.377874 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca7601e-48b0-4ff0-be24-2d64ef7e3022 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:28.378162 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca7601e-48b0-4ff0-be24-2d64ef7e3022 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:28.378443 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca7601e-48b0-4ff0-be24-2d64ef7e3022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:28.395341 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-8ca7601e-48b0-4ff0-be24-2d64ef7e3022 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:28.396668 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-8ca7601e-48b0-4ff0-be24-2d64ef7e3022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:28.458519 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1024/2061] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:44:28 2022] POST /identity/v3/users => generated 289 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:44:28.458722 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1038/2062] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:44:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:44:28.460241 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0564a62-b6dd-4345-a89a-59bde45382a8 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:28.461476 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e0564a62-b6dd-4345-a89a-59bde45382a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:28.465756 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca7601e-48b0-4ff0-be24-2d64ef7e3022 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:28.467153 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-8ca7601e-48b0-4ff0-be24-2d64ef7e3022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:28.474896 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0564a62-b6dd-4345-a89a-59bde45382a8 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:28.479660 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7209db17-32c3-4484-a02f-2d6bb935cdcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:28.480334 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209db17-32c3-4484-a02f-2d6bb935cdcc admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:28.480621 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209db17-32c3-4484-a02f-2d6bb935cdcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:28.480897 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209db17-32c3-4484-a02f-2d6bb935cdcc admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:28.481625 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7209db17-32c3-4484-a02f-2d6bb935cdcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:28.483209 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7209db17-32c3-4484-a02f-2d6bb935cdcc admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:28.493222 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1025/2063] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:44:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:44:28.497144 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7209db17-32c3-4484-a02f-2d6bb935cdcc admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:28.507489 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7209db17-32c3-4484-a02f-2d6bb935cdcc admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:28.512131 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7138481b-0363-4f8f-aa19-d33ef3ef6808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:28.512791 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138481b-0363-4f8f-aa19-d33ef3ef6808 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:28.513080 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138481b-0363-4f8f-aa19-d33ef3ef6808 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:28.513356 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138481b-0363-4f8f-aa19-d33ef3ef6808 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:28.514080 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7138481b-0363-4f8f-aa19-d33ef3ef6808 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:28.515677 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7138481b-0363-4f8f-aa19-d33ef3ef6808 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:28.526629 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1026/2064] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:44:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:44:28.530410 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca7601e-48b0-4ff0-be24-2d64ef7e3022 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:28.530719 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7138481b-0363-4f8f-aa19-d33ef3ef6808 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:28.534022 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0226d52e-772d-4797-8753-9225fa7d80c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:28.534658 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0226d52e-772d-4797-8753-9225fa7d80c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:28.534937 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0226d52e-772d-4797-8753-9225fa7d80c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:28.535286 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0226d52e-772d-4797-8753-9225fa7d80c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:28.540202 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7138481b-0363-4f8f-aa19-d33ef3ef6808 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:28.544380 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0226d52e-772d-4797-8753-9225fa7d80c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:28.544792 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cda07c-e44f-45d6-9bd1-24d477a79351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:28.545665 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cda07c-e44f-45d6-9bd1-24d477a79351 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:28.545835 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0226d52e-772d-4797-8753-9225fa7d80c6 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:28.545935 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cda07c-e44f-45d6-9bd1-24d477a79351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:28.546217 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cda07c-e44f-45d6-9bd1-24d477a79351 admin admin] PATH_INFO: `/v3/projects/42394293407a4810b2d0ffe658e5084b/users/ce8c28566d3e42fa92fc528eee6aa23d/roles/0d41da7bec094450b5bff4e4831be52c` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:28.556442 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1039/2065] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:44:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 16:44:28.568226 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cda07c-e44f-45d6-9bd1-24d477a79351 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42394293407a4810b2d0ffe658e5084b, user_id=ce8c28566d3e42fa92fc528eee6aa23d, role_id=0d41da7bec094450b5bff4e4831be52c)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:28.571284 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cda07c-e44f-45d6-9bd1-24d477a79351 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:28.697877 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1027/2066] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:44:28 2022] PUT /identity/v3/projects/42394293407a4810b2d0ffe658e5084b/users/ce8c28566d3e42fa92fc528eee6aa23d/roles/0d41da7bec094450b5bff4e4831be52c => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:44:28.710221 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc03e17d-2cb5-43e8-ae53-36f9dbcd7aa2 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:28.710507 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc03e17d-2cb5-43e8-ae53-36f9dbcd7aa2 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:28.710784 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc03e17d-2cb5-43e8-ae53-36f9dbcd7aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:28.738548 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-cc03e17d-2cb5-43e8-ae53-36f9dbcd7aa2 None None] MFA Rules not processed for user `ce8c28566d3e42fa92fc528eee6aa23d`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:28.740013 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-cc03e17d-2cb5-43e8-ae53-36f9dbcd7aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:28.825940 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1040/2067] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:44:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:44:28.837883 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cda07c-e44f-45d6-9bd1-24d477a79351 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:28.839900 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e3cda07c-e44f-45d6-9bd1-24d477a79351 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:28.903730 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cda07c-e44f-45d6-9bd1-24d477a79351 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:28.910357 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f70dc3d-bd6f-4dba-a711-518191a0ce7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '950b5b5f690d41509ead753065a0b793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:28.911113 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70dc3d-bd6f-4dba-a711-518191a0ce7d service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:28.911586 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70dc3d-bd6f-4dba-a711-518191a0ce7d service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:28.911955 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70dc3d-bd6f-4dba-a711-518191a0ce7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:28.922688 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f70dc3d-bd6f-4dba-a711-518191a0ce7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:28.924183 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f70dc3d-bd6f-4dba-a711-518191a0ce7d service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:28.936152 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1028/2068] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:44:28 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:44:29.014658 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc03e17d-2cb5-43e8-ae53-36f9dbcd7aa2 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:29.016281 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-cc03e17d-2cb5-43e8-ae53-36f9dbcd7aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:29.095884 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc03e17d-2cb5-43e8-ae53-36f9dbcd7aa2 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:29.101223 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad965841-73ce-486b-8934-be5c76e1eef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:29.102105 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad965841-73ce-486b-8934-be5c76e1eef1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:29.102382 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad965841-73ce-486b-8934-be5c76e1eef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:29.102656 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad965841-73ce-486b-8934-be5c76e1eef1 admin admin] PATH_INFO: `/v3/projects/ef21e2a4d1af4eaba711aa29dce9ef23` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:29.103905 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad965841-73ce-486b-8934-be5c76e1eef1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef21e2a4d1af4eaba711aa29dce9ef23)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:29.105914 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad965841-73ce-486b-8934-be5c76e1eef1 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:29.222064 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-ad965841-73ce-486b-8934-be5c76e1eef1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef21e2a4d1af4eaba711aa29dce9ef23', 'request_id': 'req-ad965841-73ce-486b-8934-be5c76e1eef1'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:29.312571 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-ad965841-73ce-486b-8934-be5c76e1eef1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef21e2a4d1af4eaba711aa29dce9ef23', 'request_id': 'req-ad965841-73ce-486b-8934-be5c76e1eef1'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:29.319540 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-ad965841-73ce-486b-8934-be5c76e1eef1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef21e2a4d1af4eaba711aa29dce9ef23', 'request_id': 'req-ad965841-73ce-486b-8934-be5c76e1eef1'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:29.330790 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-ad965841-73ce-486b-8934-be5c76e1eef1 admin admin] The token cache is being invalidate because project ef21e2a4d1af4eaba711aa29dce9ef23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:44:29.331079 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-ad965841-73ce-486b-8934-be5c76e1eef1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:29.331764 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-ad965841-73ce-486b-8934-be5c76e1eef1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:29.333977 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1041/2069] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:44:29 2022] DELETE /identity/v3/projects/ef21e2a4d1af4eaba711aa29dce9ef23 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:44:29.337994 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f70dc3d-bd6f-4dba-a711-518191a0ce7d service cinder] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:29.349084 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f70dc3d-bd6f-4dba-a711-518191a0ce7d service cinder] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:29.408712 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7313e4-e56b-48c2-abcc-fd25a5a78aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:29.409579 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7313e4-e56b-48c2-abcc-fd25a5a78aca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:29.409894 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7313e4-e56b-48c2-abcc-fd25a5a78aca admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:29.410223 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7313e4-e56b-48c2-abcc-fd25a5a78aca admin admin] PATH_INFO: `/v3/users/bc394252f8e74bbeb1b72de2aa69364a` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:29.411495 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7313e4-e56b-48c2-abcc-fd25a5a78aca admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc394252f8e74bbeb1b72de2aa69364a)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:29.413424 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7313e4-e56b-48c2-abcc-fd25a5a78aca admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:29.607752 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-ef7313e4-e56b-48c2-abcc-fd25a5a78aca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc394252f8e74bbeb1b72de2aa69364a'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:29.608564 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-ef7313e4-e56b-48c2-abcc-fd25a5a78aca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc394252f8e74bbeb1b72de2aa69364a'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:29.691922 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-ef7313e4-e56b-48c2-abcc-fd25a5a78aca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc394252f8e74bbeb1b72de2aa69364a'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:29.702100 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-ef7313e4-e56b-48c2-abcc-fd25a5a78aca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc394252f8e74bbeb1b72de2aa69364a'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:29.715130 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-ef7313e4-e56b-48c2-abcc-fd25a5a78aca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc394252f8e74bbeb1b72de2aa69364a'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:29.721262 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1029/2070] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:44:29 2022] DELETE /identity/v3/users/bc394252f8e74bbeb1b72de2aa69364a => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:44:30.361591 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad965841-73ce-486b-8934-be5c76e1eef1 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:30.363704 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-ad965841-73ce-486b-8934-be5c76e1eef1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:30.376840 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad965841-73ce-486b-8934-be5c76e1eef1 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:30.435262 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e627563a-319b-4e58-a225-fabb4b3854f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:30.436155 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e627563a-319b-4e58-a225-fabb4b3854f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:30.436438 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e627563a-319b-4e58-a225-fabb4b3854f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:30.436713 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e627563a-319b-4e58-a225-fabb4b3854f1 admin admin] PATH_INFO: `/v3/projects/a93fc1c5a2564c1dbd049d0fcb4af917` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:30.437868 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e627563a-319b-4e58-a225-fabb4b3854f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a93fc1c5a2564c1dbd049d0fcb4af917)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:30.439816 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e627563a-319b-4e58-a225-fabb4b3854f1 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:30.571596 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-e627563a-319b-4e58-a225-fabb4b3854f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a93fc1c5a2564c1dbd049d0fcb4af917', 'request_id': 'req-e627563a-319b-4e58-a225-fabb4b3854f1'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:30.662583 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-e627563a-319b-4e58-a225-fabb4b3854f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a93fc1c5a2564c1dbd049d0fcb4af917', 'request_id': 'req-e627563a-319b-4e58-a225-fabb4b3854f1'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:30.668529 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-e627563a-319b-4e58-a225-fabb4b3854f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a93fc1c5a2564c1dbd049d0fcb4af917', 'request_id': 'req-e627563a-319b-4e58-a225-fabb4b3854f1'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:30.680267 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-e627563a-319b-4e58-a225-fabb4b3854f1 admin admin] The token cache is being invalidate because project a93fc1c5a2564c1dbd049d0fcb4af917 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:44:30.680557 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-e627563a-319b-4e58-a225-fabb4b3854f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:30.681198 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-e627563a-319b-4e58-a225-fabb4b3854f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:30.682729 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1042/2071] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:44:30 2022] DELETE /identity/v3/projects/a93fc1c5a2564c1dbd049d0fcb4af917 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:44:30.686609 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7313e4-e56b-48c2-abcc-fd25a5a78aca admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:30.688058 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ef7313e4-e56b-48c2-abcc-fd25a5a78aca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:30.701134 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7313e4-e56b-48c2-abcc-fd25a5a78aca admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:30.756055 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5a8f7b-4d71-4738-bae5-f8b5c9458538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:30.756936 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a8f7b-4d71-4738-bae5-f8b5c9458538 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:30.757223 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a8f7b-4d71-4738-bae5-f8b5c9458538 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:30.757501 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a8f7b-4d71-4738-bae5-f8b5c9458538 admin admin] PATH_INFO: `/v3/users/733c11fc299a4878b98bcb13aeb044e3` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:30.758703 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5a8f7b-4d71-4738-bae5-f8b5c9458538 admin admin] RBAC: Authorizing `identity:delete_user(user_id=733c11fc299a4878b98bcb13aeb044e3)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:30.760656 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5a8f7b-4d71-4738-bae5-f8b5c9458538 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:31.002358 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0a5a8f7b-4d71-4738-bae5-f8b5c9458538 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '733c11fc299a4878b98bcb13aeb044e3'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:31.003147 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0a5a8f7b-4d71-4738-bae5-f8b5c9458538 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '733c11fc299a4878b98bcb13aeb044e3'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:31.085413 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0a5a8f7b-4d71-4738-bae5-f8b5c9458538 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '733c11fc299a4878b98bcb13aeb044e3'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:31.093057 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0a5a8f7b-4d71-4738-bae5-f8b5c9458538 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '733c11fc299a4878b98bcb13aeb044e3'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:31.106624 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0a5a8f7b-4d71-4738-bae5-f8b5c9458538 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '733c11fc299a4878b98bcb13aeb044e3'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:31.112744 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1030/2072] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:44:30 2022] DELETE /identity/v3/users/733c11fc299a4878b98bcb13aeb044e3 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:44:31.573500 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e627563a-319b-4e58-a225-fabb4b3854f1 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:31.575097 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-e627563a-319b-4e58-a225-fabb4b3854f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:31.596145 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e627563a-319b-4e58-a225-fabb4b3854f1 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:31.655837 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98191ac8-3ccb-4f5c-8049-a34926752f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:31.657344 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98191ac8-3ccb-4f5c-8049-a34926752f5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:31.657792 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98191ac8-3ccb-4f5c-8049-a34926752f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:31.658265 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98191ac8-3ccb-4f5c-8049-a34926752f5c admin admin] PATH_INFO: `/v3/projects/fdf6e2a974ef49a7801863faaecff8c4` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:31.660616 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98191ac8-3ccb-4f5c-8049-a34926752f5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdf6e2a974ef49a7801863faaecff8c4)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:31.663990 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98191ac8-3ccb-4f5c-8049-a34926752f5c admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:31.788380 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-98191ac8-3ccb-4f5c-8049-a34926752f5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdf6e2a974ef49a7801863faaecff8c4', 'request_id': 'req-98191ac8-3ccb-4f5c-8049-a34926752f5c'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:31.889568 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-98191ac8-3ccb-4f5c-8049-a34926752f5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdf6e2a974ef49a7801863faaecff8c4', 'request_id': 'req-98191ac8-3ccb-4f5c-8049-a34926752f5c'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:31.896306 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-98191ac8-3ccb-4f5c-8049-a34926752f5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdf6e2a974ef49a7801863faaecff8c4', 'request_id': 'req-98191ac8-3ccb-4f5c-8049-a34926752f5c'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:31.907810 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-98191ac8-3ccb-4f5c-8049-a34926752f5c admin admin] The token cache is being invalidate because project fdf6e2a974ef49a7801863faaecff8c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:44:31.908098 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-98191ac8-3ccb-4f5c-8049-a34926752f5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:31.908744 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-98191ac8-3ccb-4f5c-8049-a34926752f5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:31.910390 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1043/2073] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:44:31 2022] DELETE /identity/v3/projects/fdf6e2a974ef49a7801863faaecff8c4 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:44:31.916579 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20cf3f7-07c9-4045-9e4b-222b269c52d3 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:31.917100 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20cf3f7-07c9-4045-9e4b-222b269c52d3 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:31.917210 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20cf3f7-07c9-4045-9e4b-222b269c52d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:31.936140 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-e20cf3f7-07c9-4045-9e4b-222b269c52d3 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:31.937352 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e20cf3f7-07c9-4045-9e4b-222b269c52d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:31.998456 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1031/2074] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:44:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:44:32.024946 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c89d8-d471-40e9-96b9-7fca621a5637 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:32.025238 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c89d8-d471-40e9-96b9-7fca621a5637 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:32.025528 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c89d8-d471-40e9-96b9-7fca621a5637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:32.047366 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-a32c89d8-d471-40e9-96b9-7fca621a5637 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:32.048620 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-a32c89d8-d471-40e9-96b9-7fca621a5637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:32.057583 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1044/2075] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:44:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:44:32.062803 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20cf3f7-07c9-4045-9e4b-222b269c52d3 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:32.073116 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20cf3f7-07c9-4045-9e4b-222b269c52d3 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:32.078069 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56829f5-0c07-4f45-bb8e-8f86f536e7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:32.078801 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56829f5-0c07-4f45-bb8e-8f86f536e7a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:32.079269 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56829f5-0c07-4f45-bb8e-8f86f536e7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:32.079570 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56829f5-0c07-4f45-bb8e-8f86f536e7a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:32.080307 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56829f5-0c07-4f45-bb8e-8f86f536e7a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:44:32.080615 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56829f5-0c07-4f45-bb8e-8f86f536e7a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:32.082424 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56829f5-0c07-4f45-bb8e-8f86f536e7a2 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:32.099170 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1032/2076] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Apr 11 16:44:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:44:32.100365 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c89d8-d471-40e9-96b9-7fca621a5637 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:32.112469 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c89d8-d471-40e9-96b9-7fca621a5637 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:32.117942 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647f0c3d-f961-429f-b82f-5010027004a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:32.118633 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f0c3d-f961-429f-b82f-5010027004a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:32.118967 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f0c3d-f961-429f-b82f-5010027004a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:32.119324 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f0c3d-f961-429f-b82f-5010027004a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:32.119988 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647f0c3d-f961-429f-b82f-5010027004a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:32.122112 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647f0c3d-f961-429f-b82f-5010027004a4 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:32.293988 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1045/2077] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:44:32 2022] POST /identity/v3/projects => generated 385 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:44:32.298182 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56829f5-0c07-4f45-bb8e-8f86f536e7a2 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:32.308794 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56829f5-0c07-4f45-bb8e-8f86f536e7a2 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:32.364301 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44594c4-5768-4a69-baed-9f0f0d47ad3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:32.364973 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44594c4-5768-4a69-baed-9f0f0d47ad3e admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:32.365256 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44594c4-5768-4a69-baed-9f0f0d47ad3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:32.365535 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44594c4-5768-4a69-baed-9f0f0d47ad3e admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:32.366349 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44594c4-5768-4a69-baed-9f0f0d47ad3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:32.368359 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44594c4-5768-4a69-baed-9f0f0d47ad3e admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:32.530090 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1033/2078] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:44:32 2022] POST /identity/v3/users => generated 293 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:44:32.534630 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647f0c3d-f961-429f-b82f-5010027004a4 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:32.553531 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647f0c3d-f961-429f-b82f-5010027004a4 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:32.559836 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2596318a-658f-4679-aa70-72a2b26b0d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:32.560580 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2596318a-658f-4679-aa70-72a2b26b0d24 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:32.560864 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2596318a-658f-4679-aa70-72a2b26b0d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:32.561137 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2596318a-658f-4679-aa70-72a2b26b0d24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:32.561869 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2596318a-658f-4679-aa70-72a2b26b0d24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:32.563678 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2596318a-658f-4679-aa70-72a2b26b0d24 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:32.585208 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1046/2079] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:44:32 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:44:32.586554 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44594c4-5768-4a69-baed-9f0f0d47ad3e admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:32.598197 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44594c4-5768-4a69-baed-9f0f0d47ad3e admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:32.605279 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b4ae80-e58b-416a-9ee4-d85f995ef419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:32.605971 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b4ae80-e58b-416a-9ee4-d85f995ef419 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:32.606315 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b4ae80-e58b-416a-9ee4-d85f995ef419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:32.607283 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b4ae80-e58b-416a-9ee4-d85f995ef419 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:32.611904 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b4ae80-e58b-416a-9ee4-d85f995ef419 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:32.615088 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b4ae80-e58b-416a-9ee4-d85f995ef419 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:32.635136 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1034/2080] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:44:32 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 16:44:32.638714 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2596318a-658f-4679-aa70-72a2b26b0d24 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:32.650412 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2596318a-658f-4679-aa70-72a2b26b0d24 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:32.655461 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34367447-7155-4579-974c-27de8784acf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:32.656328 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34367447-7155-4579-974c-27de8784acf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:32.656614 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34367447-7155-4579-974c-27de8784acf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:32.656890 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34367447-7155-4579-974c-27de8784acf6 admin admin] PATH_INFO: `/v3/projects/531e23876eb3483fb661dbb4c8a5a9ce/users/33ac5e78a7ae4edfa21dae5584649523/roles/0d41da7bec094450b5bff4e4831be52c` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:32.672622 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34367447-7155-4579-974c-27de8784acf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=531e23876eb3483fb661dbb4c8a5a9ce, user_id=33ac5e78a7ae4edfa21dae5584649523, role_id=0d41da7bec094450b5bff4e4831be52c)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:32.675265 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34367447-7155-4579-974c-27de8784acf6 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:32.815977 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1047/2081] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:44:32 2022] PUT /identity/v3/projects/531e23876eb3483fb661dbb4c8a5a9ce/users/33ac5e78a7ae4edfa21dae5584649523/roles/0d41da7bec094450b5bff4e4831be52c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:44:32.828354 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94552baf-1529-4a34-b23f-7c9b5c09decc None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:32.828693 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94552baf-1529-4a34-b23f-7c9b5c09decc None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:32.828983 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94552baf-1529-4a34-b23f-7c9b5c09decc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:32.856724 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-94552baf-1529-4a34-b23f-7c9b5c09decc None None] MFA Rules not processed for user `33ac5e78a7ae4edfa21dae5584649523`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:32.857937 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-94552baf-1529-4a34-b23f-7c9b5c09decc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:32.922118 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1035/2082] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:44:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:44:32.961204 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34367447-7155-4579-974c-27de8784acf6 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:32.963308 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-34367447-7155-4579-974c-27de8784acf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:32.963833 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94552baf-1529-4a34-b23f-7c9b5c09decc None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:32.965194 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-94552baf-1529-4a34-b23f-7c9b5c09decc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:33.028164 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94552baf-1529-4a34-b23f-7c9b5c09decc None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:33.032030 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9abf558-106d-4338-8772-b928bb3d0e73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '950b5b5f690d41509ead753065a0b793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:33.032690 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9abf558-106d-4338-8772-b928bb3d0e73 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:33.032977 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9abf558-106d-4338-8772-b928bb3d0e73 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:33.033257 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9abf558-106d-4338-8772-b928bb3d0e73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:33.038757 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34367447-7155-4579-974c-27de8784acf6 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:33.042816 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9abf558-106d-4338-8772-b928bb3d0e73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:33.043553 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f876d02-960e-42a5-bf6c-66f1613f347a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:33.044290 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9abf558-106d-4338-8772-b928bb3d0e73 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:33.044448 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f876d02-960e-42a5-bf6c-66f1613f347a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:33.047912 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f876d02-960e-42a5-bf6c-66f1613f347a admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:33.047912 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f876d02-960e-42a5-bf6c-66f1613f347a admin admin] PATH_INFO: `/v3/users/fd9c69f6ce394cddb3d411b15738164a` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:33.047912 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f876d02-960e-42a5-bf6c-66f1613f347a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd9c69f6ce394cddb3d411b15738164a)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:33.048185 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f876d02-960e-42a5-bf6c-66f1613f347a admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:33.053443 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1036/2083] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:44:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 16:44:33.306337 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-8f876d02-960e-42a5-bf6c-66f1613f347a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd9c69f6ce394cddb3d411b15738164a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:33.514650 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-8f876d02-960e-42a5-bf6c-66f1613f347a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd9c69f6ce394cddb3d411b15738164a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:33.523196 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-8f876d02-960e-42a5-bf6c-66f1613f347a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd9c69f6ce394cddb3d411b15738164a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:33.523932 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-8f876d02-960e-42a5-bf6c-66f1613f347a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd9c69f6ce394cddb3d411b15738164a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:33.536784 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-8f876d02-960e-42a5-bf6c-66f1613f347a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd9c69f6ce394cddb3d411b15738164a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:33.543232 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1048/2084] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:44:32 2022] DELETE /identity/v3/users/fd9c69f6ce394cddb3d411b15738164a => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:44:33.547927 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51ea2e-147c-42ce-9e35-cddddf24cc47 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:33.548216 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51ea2e-147c-42ce-9e35-cddddf24cc47 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:33.548526 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51ea2e-147c-42ce-9e35-cddddf24cc47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:33.566344 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-5c51ea2e-147c-42ce-9e35-cddddf24cc47 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:33.567593 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-5c51ea2e-147c-42ce-9e35-cddddf24cc47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:33.625586 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1037/2085] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:44:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:44:33.635386 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f876d02-960e-42a5-bf6c-66f1613f347a admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:33.639666 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-8f876d02-960e-42a5-bf6c-66f1613f347a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:33.641480 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c51ea2e-147c-42ce-9e35-cddddf24cc47 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:33.642851 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-5c51ea2e-147c-42ce-9e35-cddddf24cc47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:33.655542 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c51ea2e-147c-42ce-9e35-cddddf24cc47 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:33.661102 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6efd597-4edf-470e-90ee-5760363c6788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:33.661990 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6efd597-4edf-470e-90ee-5760363c6788 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:33.662278 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6efd597-4edf-470e-90ee-5760363c6788 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:33.662557 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6efd597-4edf-470e-90ee-5760363c6788 admin admin] PATH_INFO: `/v3/users/5cd36d9f79ae41ed9a524fa2935206d9` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:33.663819 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6efd597-4edf-470e-90ee-5760363c6788 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cd36d9f79ae41ed9a524fa2935206d9)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:33.665773 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6efd597-4edf-470e-90ee-5760363c6788 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:33.724644 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f876d02-960e-42a5-bf6c-66f1613f347a admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:33.729083 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b7d10-412b-4407-a492-0a3e1156d57d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:33.729812 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b7d10-412b-4407-a492-0a3e1156d57d service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:33.730098 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b7d10-412b-4407-a492-0a3e1156d57d service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:33.730545 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b7d10-412b-4407-a492-0a3e1156d57d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:33.741617 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6b7d10-412b-4407-a492-0a3e1156d57d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:33.743237 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6b7d10-412b-4407-a492-0a3e1156d57d service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:33.765504 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1049/2086] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:44:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:44:33.872929 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e6efd597-4edf-470e-90ee-5760363c6788 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cd36d9f79ae41ed9a524fa2935206d9'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:33.874817 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e6efd597-4edf-470e-90ee-5760363c6788 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cd36d9f79ae41ed9a524fa2935206d9'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:33.965871 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e6efd597-4edf-470e-90ee-5760363c6788 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cd36d9f79ae41ed9a524fa2935206d9'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:33.975014 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e6efd597-4edf-470e-90ee-5760363c6788 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cd36d9f79ae41ed9a524fa2935206d9'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:33.989273 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e6efd597-4edf-470e-90ee-5760363c6788 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cd36d9f79ae41ed9a524fa2935206d9'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:33.998995 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1038/2087] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:44:33 2022] DELETE /identity/v3/users/5cd36d9f79ae41ed9a524fa2935206d9 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:44:34.003250 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17dc65-ddad-412c-b42e-c2369ad81b44 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:34.004200 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17dc65-ddad-412c-b42e-c2369ad81b44 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:34.004645 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17dc65-ddad-412c-b42e-c2369ad81b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:34.030837 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-ad17dc65-ddad-412c-b42e-c2369ad81b44 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:34.032089 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-ad17dc65-ddad-412c-b42e-c2369ad81b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:34.117107 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1050/2088] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:44:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:44:34.123750 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6efd597-4edf-470e-90ee-5760363c6788 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:34.126219 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e6efd597-4edf-470e-90ee-5760363c6788 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:34.218520 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6efd597-4edf-470e-90ee-5760363c6788 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:34.226967 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad305584-51a8-4405-a35d-3b3170d4c9b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:34.228126 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad305584-51a8-4405-a35d-3b3170d4c9b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:34.228592 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad305584-51a8-4405-a35d-3b3170d4c9b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:34.229050 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad305584-51a8-4405-a35d-3b3170d4c9b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:34.246960 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad305584-51a8-4405-a35d-3b3170d4c9b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:34.246960 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad305584-51a8-4405-a35d-3b3170d4c9b6 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:34.257793 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1039/2089] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:44:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:44:34.459575 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad17dc65-ddad-412c-b42e-c2369ad81b44 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:34.462044 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-ad17dc65-ddad-412c-b42e-c2369ad81b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:34.490602 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad17dc65-ddad-412c-b42e-c2369ad81b44 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:34.514096 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9be9ba-ec2f-43ab-9646-63b9a529891f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:34.516447 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9be9ba-ec2f-43ab-9646-63b9a529891f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:34.516988 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9be9ba-ec2f-43ab-9646-63b9a529891f admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:34.517644 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9be9ba-ec2f-43ab-9646-63b9a529891f admin admin] PATH_INFO: `/v3/projects/e3eb4ab2780b452aba01cb8e8319f56d` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:34.519294 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9be9ba-ec2f-43ab-9646-63b9a529891f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3eb4ab2780b452aba01cb8e8319f56d)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:34.521985 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9be9ba-ec2f-43ab-9646-63b9a529891f admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:34.721298 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-ae9be9ba-ec2f-43ab-9646-63b9a529891f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3eb4ab2780b452aba01cb8e8319f56d', 'request_id': 'req-ae9be9ba-ec2f-43ab-9646-63b9a529891f'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:34.817367 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-ae9be9ba-ec2f-43ab-9646-63b9a529891f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3eb4ab2780b452aba01cb8e8319f56d', 'request_id': 'req-ae9be9ba-ec2f-43ab-9646-63b9a529891f'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:34.823292 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-ae9be9ba-ec2f-43ab-9646-63b9a529891f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3eb4ab2780b452aba01cb8e8319f56d', 'request_id': 'req-ae9be9ba-ec2f-43ab-9646-63b9a529891f'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:34.842684 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-ae9be9ba-ec2f-43ab-9646-63b9a529891f admin admin] The token cache is being invalidate because project e3eb4ab2780b452aba01cb8e8319f56d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:44:34.843661 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-ae9be9ba-ec2f-43ab-9646-63b9a529891f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:34.844303 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-ae9be9ba-ec2f-43ab-9646-63b9a529891f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:34.850050 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1051/2090] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:44:34 2022] DELETE /identity/v3/projects/e3eb4ab2780b452aba01cb8e8319f56d => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:44:34.851192 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad305584-51a8-4405-a35d-3b3170d4c9b6 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:34.864599 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad305584-51a8-4405-a35d-3b3170d4c9b6 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:34.932622 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a667a043-32ad-4e28-bcfd-6e0bc416bd8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:34.933434 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a667a043-32ad-4e28-bcfd-6e0bc416bd8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:34.933721 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a667a043-32ad-4e28-bcfd-6e0bc416bd8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:34.934001 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a667a043-32ad-4e28-bcfd-6e0bc416bd8c admin admin] PATH_INFO: `/v3/users/66141a041758448e862f84c4458f6c30` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:34.935226 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a667a043-32ad-4e28-bcfd-6e0bc416bd8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=66141a041758448e862f84c4458f6c30)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:34.937223 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a667a043-32ad-4e28-bcfd-6e0bc416bd8c admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:34.979209 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9be9ba-ec2f-43ab-9646-63b9a529891f admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:34.981097 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-ae9be9ba-ec2f-43ab-9646-63b9a529891f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:35.004741 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9be9ba-ec2f-43ab-9646-63b9a529891f admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:35.006582 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b505b2-2792-4e14-9a72-808e4be92f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:35.007626 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b505b2-2792-4e14-9a72-808e4be92f7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:35.007916 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b505b2-2792-4e14-9a72-808e4be92f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:35.008240 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b505b2-2792-4e14-9a72-808e4be92f7e admin admin] PATH_INFO: `/v3/projects/7c73dedb0aee471aa791e50481cf8d30` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:35.009467 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b505b2-2792-4e14-9a72-808e4be92f7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c73dedb0aee471aa791e50481cf8d30)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:35.011415 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b505b2-2792-4e14-9a72-808e4be92f7e admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:35.231293 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a667a043-32ad-4e28-bcfd-6e0bc416bd8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66141a041758448e862f84c4458f6c30'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:35.231898 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-d9b505b2-2792-4e14-9a72-808e4be92f7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c73dedb0aee471aa791e50481cf8d30', 'request_id': 'req-d9b505b2-2792-4e14-9a72-808e4be92f7e'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:35.231997 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a667a043-32ad-4e28-bcfd-6e0bc416bd8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66141a041758448e862f84c4458f6c30'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:35.360127 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-d9b505b2-2792-4e14-9a72-808e4be92f7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c73dedb0aee471aa791e50481cf8d30', 'request_id': 'req-d9b505b2-2792-4e14-9a72-808e4be92f7e'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:35.366848 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-d9b505b2-2792-4e14-9a72-808e4be92f7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c73dedb0aee471aa791e50481cf8d30', 'request_id': 'req-d9b505b2-2792-4e14-9a72-808e4be92f7e'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:35.377905 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-d9b505b2-2792-4e14-9a72-808e4be92f7e admin admin] The token cache is being invalidate because project 7c73dedb0aee471aa791e50481cf8d30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:44:35.378193 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-d9b505b2-2792-4e14-9a72-808e4be92f7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:35.379396 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-d9b505b2-2792-4e14-9a72-808e4be92f7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:35.380997 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1052/2091] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:44:34 2022] DELETE /identity/v3/projects/7c73dedb0aee471aa791e50481cf8d30 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:44:35.491505 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a667a043-32ad-4e28-bcfd-6e0bc416bd8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66141a041758448e862f84c4458f6c30'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:35.505939 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a667a043-32ad-4e28-bcfd-6e0bc416bd8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66141a041758448e862f84c4458f6c30'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:35.519811 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a667a043-32ad-4e28-bcfd-6e0bc416bd8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66141a041758448e862f84c4458f6c30'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:35.526323 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1040/2092] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:44:34 2022] DELETE /identity/v3/users/66141a041758448e862f84c4458f6c30 => generated 0 bytes in 676 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:44:35.973300 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b505b2-2792-4e14-9a72-808e4be92f7e admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:35.974810 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-d9b505b2-2792-4e14-9a72-808e4be92f7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:36.042360 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b505b2-2792-4e14-9a72-808e4be92f7e admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:36.101492 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6650c5-92eb-424a-bb26-228c6bf16740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:36.102581 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6650c5-92eb-424a-bb26-228c6bf16740 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:36.103016 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6650c5-92eb-424a-bb26-228c6bf16740 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:36.103453 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6650c5-92eb-424a-bb26-228c6bf16740 admin admin] PATH_INFO: `/v3/projects/37ca6b916d8a45f7b16fdc2482ca5cc2` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:36.104883 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6650c5-92eb-424a-bb26-228c6bf16740 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37ca6b916d8a45f7b16fdc2482ca5cc2)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:36.107130 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6650c5-92eb-424a-bb26-228c6bf16740 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:36.233847 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-8b6650c5-92eb-424a-bb26-228c6bf16740 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37ca6b916d8a45f7b16fdc2482ca5cc2', 'request_id': 'req-8b6650c5-92eb-424a-bb26-228c6bf16740'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:36.331080 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-8b6650c5-92eb-424a-bb26-228c6bf16740 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37ca6b916d8a45f7b16fdc2482ca5cc2', 'request_id': 'req-8b6650c5-92eb-424a-bb26-228c6bf16740'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:36.337624 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-8b6650c5-92eb-424a-bb26-228c6bf16740 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37ca6b916d8a45f7b16fdc2482ca5cc2', 'request_id': 'req-8b6650c5-92eb-424a-bb26-228c6bf16740'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:36.348797 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-8b6650c5-92eb-424a-bb26-228c6bf16740 admin admin] The token cache is being invalidate because project 37ca6b916d8a45f7b16fdc2482ca5cc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:44:36.349082 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-8b6650c5-92eb-424a-bb26-228c6bf16740 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:36.349739 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-8b6650c5-92eb-424a-bb26-228c6bf16740 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:36.353384 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1053/2093] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:44:35 2022] DELETE /identity/v3/projects/37ca6b916d8a45f7b16fdc2482ca5cc2 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:44:36.357361 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bdba04-6c78-43e9-a836-bc38e6b9ee41 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:36.357871 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bdba04-6c78-43e9-a836-bc38e6b9ee41 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:36.357974 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bdba04-6c78-43e9-a836-bc38e6b9ee41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:36.376695 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-e1bdba04-6c78-43e9-a836-bc38e6b9ee41 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:36.377964 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e1bdba04-6c78-43e9-a836-bc38e6b9ee41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:36.436094 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1041/2094] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:44:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:44:36.447039 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14d397-ba79-4590-8d40-b69c211bf91f None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:36.447039 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14d397-ba79-4590-8d40-b69c211bf91f None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:36.447579 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14d397-ba79-4590-8d40-b69c211bf91f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:36.467826 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-5a14d397-ba79-4590-8d40-b69c211bf91f None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:36.469111 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-5a14d397-ba79-4590-8d40-b69c211bf91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:36.478778 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1054/2095] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:44:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:44:36.483152 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bdba04-6c78-43e9-a836-bc38e6b9ee41 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:36.494000 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bdba04-6c78-43e9-a836-bc38e6b9ee41 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:36.499767 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a7ccee-fbc1-4b62-80a0-73c82585d7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:36.500478 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7ccee-fbc1-4b62-80a0-73c82585d7dc admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:36.500767 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7ccee-fbc1-4b62-80a0-73c82585d7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:36.501051 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7ccee-fbc1-4b62-80a0-73c82585d7dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:36.501816 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a7ccee-fbc1-4b62-80a0-73c82585d7dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:44:36.502128 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a7ccee-fbc1-4b62-80a0-73c82585d7dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:36.504446 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a7ccee-fbc1-4b62-80a0-73c82585d7dc admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:36.518697 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1042/2096] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Apr 11 16:44:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:44:36.522914 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a14d397-ba79-4590-8d40-b69c211bf91f None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:36.532717 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a14d397-ba79-4590-8d40-b69c211bf91f None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:36.537917 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f74917-727a-42b5-905c-f55d8662590e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:36.538890 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f74917-727a-42b5-905c-f55d8662590e admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:36.539322 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f74917-727a-42b5-905c-f55d8662590e admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:36.539647 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f74917-727a-42b5-905c-f55d8662590e admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:36.540361 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f74917-727a-42b5-905c-f55d8662590e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:36.542305 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f74917-727a-42b5-905c-f55d8662590e admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:36.659221 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1055/2097] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:44:36 2022] POST /identity/v3/projects => generated 375 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:44:36.663776 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a7ccee-fbc1-4b62-80a0-73c82585d7dc admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:36.683121 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a7ccee-fbc1-4b62-80a0-73c82585d7dc admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:36.779829 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81aa826-a871-4e1c-ba32-51731184155f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:36.780960 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81aa826-a871-4e1c-ba32-51731184155f admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:36.781466 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81aa826-a871-4e1c-ba32-51731184155f admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:36.781958 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81aa826-a871-4e1c-ba32-51731184155f admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:36.783238 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81aa826-a871-4e1c-ba32-51731184155f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:36.788171 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81aa826-a871-4e1c-ba32-51731184155f admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:36.869751 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1043/2098] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:44:36 2022] POST /identity/v3/users => generated 288 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:44:36.873656 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f74917-727a-42b5-905c-f55d8662590e admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:36.883905 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f74917-727a-42b5-905c-f55d8662590e admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:36.888443 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab68eb36-d941-44bb-a308-057471691da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:36.889109 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68eb36-d941-44bb-a308-057471691da2 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:36.889388 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68eb36-d941-44bb-a308-057471691da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:36.889711 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68eb36-d941-44bb-a308-057471691da2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:36.890409 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab68eb36-d941-44bb-a308-057471691da2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:36.892023 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab68eb36-d941-44bb-a308-057471691da2 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:36.902760 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1056/2099] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:44:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:44:36.906755 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81aa826-a871-4e1c-ba32-51731184155f admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:36.917495 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81aa826-a871-4e1c-ba32-51731184155f admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:36.922317 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4169f59-03a4-4e09-89a0-65f1b58025e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:36.923059 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4169f59-03a4-4e09-89a0-65f1b58025e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:36.923422 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4169f59-03a4-4e09-89a0-65f1b58025e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:36.923748 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4169f59-03a4-4e09-89a0-65f1b58025e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:36.924483 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4169f59-03a4-4e09-89a0-65f1b58025e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:36.926671 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4169f59-03a4-4e09-89a0-65f1b58025e6 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:36.937253 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1044/2100] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:44:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 16:44:36.941735 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab68eb36-d941-44bb-a308-057471691da2 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:36.952116 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab68eb36-d941-44bb-a308-057471691da2 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:36.957145 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f574a6c0-154c-40cc-90f7-d5a58d6f5efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:36.958044 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f574a6c0-154c-40cc-90f7-d5a58d6f5efb admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:36.958330 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f574a6c0-154c-40cc-90f7-d5a58d6f5efb admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:36.958659 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f574a6c0-154c-40cc-90f7-d5a58d6f5efb admin admin] PATH_INFO: `/v3/projects/f08efdafbad441c1bd131c0553497193/users/fc07771cdf534f61b39a95d1d4369a42/roles/0d41da7bec094450b5bff4e4831be52c` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:36.974447 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f574a6c0-154c-40cc-90f7-d5a58d6f5efb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f08efdafbad441c1bd131c0553497193, user_id=fc07771cdf534f61b39a95d1d4369a42, role_id=0d41da7bec094450b5bff4e4831be52c)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:36.977215 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f574a6c0-154c-40cc-90f7-d5a58d6f5efb admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:37.103992 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1057/2101] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:44:36 2022] PUT /identity/v3/projects/f08efdafbad441c1bd131c0553497193/users/fc07771cdf534f61b39a95d1d4369a42/roles/0d41da7bec094450b5bff4e4831be52c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:44:37.115913 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c78ac38-b992-43f7-913c-5ab165852f56 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:37.116203 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c78ac38-b992-43f7-913c-5ab165852f56 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:37.116482 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c78ac38-b992-43f7-913c-5ab165852f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:37.143129 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-2c78ac38-b992-43f7-913c-5ab165852f56 None None] MFA Rules not processed for user `fc07771cdf534f61b39a95d1d4369a42`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:37.145057 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-2c78ac38-b992-43f7-913c-5ab165852f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:37.213958 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1045/2102] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:44:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:44:37.232889 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f574a6c0-154c-40cc-90f7-d5a58d6f5efb admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:37.234614 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-f574a6c0-154c-40cc-90f7-d5a58d6f5efb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:37.296802 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f574a6c0-154c-40cc-90f7-d5a58d6f5efb admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:37.300675 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac9405-c383-4ffa-9167-517611ba83b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '950b5b5f690d41509ead753065a0b793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:37.301634 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac9405-c383-4ffa-9167-517611ba83b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:37.301877 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac9405-c383-4ffa-9167-517611ba83b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:37.302161 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac9405-c383-4ffa-9167-517611ba83b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:37.311437 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fac9405-c383-4ffa-9167-517611ba83b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:37.312942 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fac9405-c383-4ffa-9167-517611ba83b9 service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:37.322606 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1058/2103] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:44:37 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:44:41.702647 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c78ac38-b992-43f7-913c-5ab165852f56 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:41.704157 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-2c78ac38-b992-43f7-913c-5ab165852f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:41.767392 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c78ac38-b992-43f7-913c-5ab165852f56 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:41.772565 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53044629-de04-487b-bfca-66a0ddfc218e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:41.773437 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53044629-de04-487b-bfca-66a0ddfc218e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:41.773718 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53044629-de04-487b-bfca-66a0ddfc218e admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:41.773990 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53044629-de04-487b-bfca-66a0ddfc218e admin admin] PATH_INFO: `/v3/users/2dcefc455dba4693a162e096919bd89a` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:41.775167 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53044629-de04-487b-bfca-66a0ddfc218e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2dcefc455dba4693a162e096919bd89a)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:41.777160 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53044629-de04-487b-bfca-66a0ddfc218e admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:41.985308 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-53044629-de04-487b-bfca-66a0ddfc218e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2dcefc455dba4693a162e096919bd89a'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:41.985975 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-53044629-de04-487b-bfca-66a0ddfc218e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2dcefc455dba4693a162e096919bd89a'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:42.057090 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-53044629-de04-487b-bfca-66a0ddfc218e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2dcefc455dba4693a162e096919bd89a'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:42.064176 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-53044629-de04-487b-bfca-66a0ddfc218e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2dcefc455dba4693a162e096919bd89a'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:42.076007 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-53044629-de04-487b-bfca-66a0ddfc218e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2dcefc455dba4693a162e096919bd89a'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:42.082438 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1046/2104] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:44:41 2022] DELETE /identity/v3/users/2dcefc455dba4693a162e096919bd89a => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:44:42.087282 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f0476-4067-4fa8-8898-d325e170f86f None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:42.087820 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f0476-4067-4fa8-8898-d325e170f86f None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:42.087910 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f0476-4067-4fa8-8898-d325e170f86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:42.104975 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-3f0f0476-4067-4fa8-8898-d325e170f86f None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:42.106200 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-3f0f0476-4067-4fa8-8898-d325e170f86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:42.166412 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1059/2105] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:44:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:44:42.176327 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53044629-de04-487b-bfca-66a0ddfc218e admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:42.178021 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-53044629-de04-487b-bfca-66a0ddfc218e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:42.235851 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53044629-de04-487b-bfca-66a0ddfc218e admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:42.239673 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bda5de-cff5-4d1d-8f85-d0fd53aca210 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:42.240352 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bda5de-cff5-4d1d-8f85-d0fd53aca210 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:42.240631 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bda5de-cff5-4d1d-8f85-d0fd53aca210 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:42.240904 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bda5de-cff5-4d1d-8f85-d0fd53aca210 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:42.250295 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bda5de-cff5-4d1d-8f85-d0fd53aca210 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:42.261383 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bda5de-cff5-4d1d-8f85-d0fd53aca210 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:42.262627 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1047/2106] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:44:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 16:44:42.773558 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0f0476-4067-4fa8-8898-d325e170f86f None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:42.775434 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-3f0f0476-4067-4fa8-8898-d325e170f86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:42.789702 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0f0476-4067-4fa8-8898-d325e170f86f None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:42.794756 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3163ed-67b9-46d9-94d7-2501f2e36423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:42.795658 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3163ed-67b9-46d9-94d7-2501f2e36423 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:42.795941 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3163ed-67b9-46d9-94d7-2501f2e36423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:42.796254 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3163ed-67b9-46d9-94d7-2501f2e36423 admin admin] PATH_INFO: `/v3/projects/4bb7c3b41c4149d7895824c78ff1182e` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:42.797592 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3163ed-67b9-46d9-94d7-2501f2e36423 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bb7c3b41c4149d7895824c78ff1182e)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:42.799724 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3163ed-67b9-46d9-94d7-2501f2e36423 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:42.933675 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-cd3163ed-67b9-46d9-94d7-2501f2e36423 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bb7c3b41c4149d7895824c78ff1182e', 'request_id': 'req-cd3163ed-67b9-46d9-94d7-2501f2e36423'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:43.117565 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-cd3163ed-67b9-46d9-94d7-2501f2e36423 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bb7c3b41c4149d7895824c78ff1182e', 'request_id': 'req-cd3163ed-67b9-46d9-94d7-2501f2e36423'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:43.123729 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-cd3163ed-67b9-46d9-94d7-2501f2e36423 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bb7c3b41c4149d7895824c78ff1182e', 'request_id': 'req-cd3163ed-67b9-46d9-94d7-2501f2e36423'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:43.140184 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-cd3163ed-67b9-46d9-94d7-2501f2e36423 admin admin] The token cache is being invalidate because project 4bb7c3b41c4149d7895824c78ff1182e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:44:43.140728 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-cd3163ed-67b9-46d9-94d7-2501f2e36423 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:43.141844 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-cd3163ed-67b9-46d9-94d7-2501f2e36423 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:43.144852 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1060/2107] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:44:42 2022] DELETE /identity/v3/projects/4bb7c3b41c4149d7895824c78ff1182e => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:44:43.148821 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bda5de-cff5-4d1d-8f85-d0fd53aca210 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:43.177275 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bda5de-cff5-4d1d-8f85-d0fd53aca210 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:43.217416 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e2aea9-3a38-4147-a851-86a2ead02255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:43.218223 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2aea9-3a38-4147-a851-86a2ead02255 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:43.218503 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2aea9-3a38-4147-a851-86a2ead02255 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:43.218779 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2aea9-3a38-4147-a851-86a2ead02255 admin admin] PATH_INFO: `/v3/users/ea8e5c1334ba4fb49033a5999c7e342b` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:43.220022 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e2aea9-3a38-4147-a851-86a2ead02255 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea8e5c1334ba4fb49033a5999c7e342b)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:43.221931 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e2aea9-3a38-4147-a851-86a2ead02255 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:43.464936 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-53e2aea9-3a38-4147-a851-86a2ead02255 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea8e5c1334ba4fb49033a5999c7e342b'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:43.465588 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-53e2aea9-3a38-4147-a851-86a2ead02255 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea8e5c1334ba4fb49033a5999c7e342b'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:43.559438 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-53e2aea9-3a38-4147-a851-86a2ead02255 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea8e5c1334ba4fb49033a5999c7e342b'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:43.566967 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-53e2aea9-3a38-4147-a851-86a2ead02255 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea8e5c1334ba4fb49033a5999c7e342b'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:43.578532 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-53e2aea9-3a38-4147-a851-86a2ead02255 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea8e5c1334ba4fb49033a5999c7e342b'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:43.585341 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1048/2108] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:44:43 2022] DELETE /identity/v3/users/ea8e5c1334ba4fb49033a5999c7e342b => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:44:43.989788 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3163ed-67b9-46d9-94d7-2501f2e36423 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:43.993277 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-cd3163ed-67b9-46d9-94d7-2501f2e36423 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:44.011684 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3163ed-67b9-46d9-94d7-2501f2e36423 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:44.076024 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f387539d-45f9-4f3b-9f4e-953d58e273b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:44.076907 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387539d-45f9-4f3b-9f4e-953d58e273b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:44.077190 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387539d-45f9-4f3b-9f4e-953d58e273b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:44.077464 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387539d-45f9-4f3b-9f4e-953d58e273b4 admin admin] PATH_INFO: `/v3/projects/aef4b6a8017e46938972de3427adf46d` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:44.078656 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f387539d-45f9-4f3b-9f4e-953d58e273b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aef4b6a8017e46938972de3427adf46d)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:44.080688 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f387539d-45f9-4f3b-9f4e-953d58e273b4 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:44.258047 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f387539d-45f9-4f3b-9f4e-953d58e273b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aef4b6a8017e46938972de3427adf46d', 'request_id': 'req-f387539d-45f9-4f3b-9f4e-953d58e273b4'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:44.353799 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f387539d-45f9-4f3b-9f4e-953d58e273b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aef4b6a8017e46938972de3427adf46d', 'request_id': 'req-f387539d-45f9-4f3b-9f4e-953d58e273b4'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:44.359773 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f387539d-45f9-4f3b-9f4e-953d58e273b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aef4b6a8017e46938972de3427adf46d', 'request_id': 'req-f387539d-45f9-4f3b-9f4e-953d58e273b4'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:44.415924 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f387539d-45f9-4f3b-9f4e-953d58e273b4 admin admin] The token cache is being invalidate because project aef4b6a8017e46938972de3427adf46d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:44:44.416210 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f387539d-45f9-4f3b-9f4e-953d58e273b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:44.416841 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f387539d-45f9-4f3b-9f4e-953d58e273b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:44.418405 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1061/2109] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:44:43 2022] DELETE /identity/v3/projects/aef4b6a8017e46938972de3427adf46d => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:44:44.423621 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ec6ee-be7e-4bb5-8494-cfebb9998a2e None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:44.424111 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ec6ee-be7e-4bb5-8494-cfebb9998a2e None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:44.424275 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ec6ee-be7e-4bb5-8494-cfebb9998a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:44.473288 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-0e1ec6ee-be7e-4bb5-8494-cfebb9998a2e None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:44.474587 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0e1ec6ee-be7e-4bb5-8494-cfebb9998a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:44.557214 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1049/2110] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:44:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:44:44.565096 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadff175-20fe-4e1e-83d6-4d55b2eeb42a None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:44.565384 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadff175-20fe-4e1e-83d6-4d55b2eeb42a None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:44.565751 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadff175-20fe-4e1e-83d6-4d55b2eeb42a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:44.583380 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-cadff175-20fe-4e1e-83d6-4d55b2eeb42a None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:44.584626 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-cadff175-20fe-4e1e-83d6-4d55b2eeb42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:44.592584 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1062/2111] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:44:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:44:44.597578 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ec6ee-be7e-4bb5-8494-cfebb9998a2e None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:44.607487 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ec6ee-be7e-4bb5-8494-cfebb9998a2e None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:44.612050 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb464e0c-4b83-495a-86f6-418ccb997f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:44.613428 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb464e0c-4b83-495a-86f6-418ccb997f78 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:44.613884 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb464e0c-4b83-495a-86f6-418ccb997f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:44.614167 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb464e0c-4b83-495a-86f6-418ccb997f78 admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:44.614895 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb464e0c-4b83-495a-86f6-418ccb997f78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:44:44.615203 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb464e0c-4b83-495a-86f6-418ccb997f78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:44.616821 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb464e0c-4b83-495a-86f6-418ccb997f78 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:44.629047 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1050/2112] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Apr 11 16:44:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:44:44.633417 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadff175-20fe-4e1e-83d6-4d55b2eeb42a None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:44.642542 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadff175-20fe-4e1e-83d6-4d55b2eeb42a None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:44.648097 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b1488-21d2-4c21-b507-a2ea4780065d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:44.648757 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b1488-21d2-4c21-b507-a2ea4780065d admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:44.649045 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b1488-21d2-4c21-b507-a2ea4780065d admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:44.649325 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b1488-21d2-4c21-b507-a2ea4780065d admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:44.650026 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403b1488-21d2-4c21-b507-a2ea4780065d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:44.651955 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403b1488-21d2-4c21-b507-a2ea4780065d admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:44.795693 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1063/2113] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:44:44 2022] POST /identity/v3/projects => generated 401 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:44:44.800201 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb464e0c-4b83-495a-86f6-418ccb997f78 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:44.811148 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb464e0c-4b83-495a-86f6-418ccb997f78 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:44.875127 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a308ad3-46dc-4990-b1b5-7444afdc0b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:44.875938 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a308ad3-46dc-4990-b1b5-7444afdc0b50 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:44.876222 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a308ad3-46dc-4990-b1b5-7444afdc0b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:44.876502 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a308ad3-46dc-4990-b1b5-7444afdc0b50 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:44.877392 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a308ad3-46dc-4990-b1b5-7444afdc0b50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:44.879232 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a308ad3-46dc-4990-b1b5-7444afdc0b50 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:44.980396 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1051/2114] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:44:44 2022] POST /identity/v3/users => generated 301 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:44:44.987005 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b1488-21d2-4c21-b507-a2ea4780065d admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:44.995390 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b1488-21d2-4c21-b507-a2ea4780065d admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:45.000187 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb9d36-1511-4f16-95c9-d4617084bd45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:45.001057 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb9d36-1511-4f16-95c9-d4617084bd45 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:45.001353 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb9d36-1511-4f16-95c9-d4617084bd45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:45.001769 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb9d36-1511-4f16-95c9-d4617084bd45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:45.002514 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcb9d36-1511-4f16-95c9-d4617084bd45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:45.005754 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcb9d36-1511-4f16-95c9-d4617084bd45 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:45.018544 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1064/2115] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:44:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:44:45.021711 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a308ad3-46dc-4990-b1b5-7444afdc0b50 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:45.033833 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a308ad3-46dc-4990-b1b5-7444afdc0b50 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:45.038858 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd62a97-db1a-40e4-8bd2-f7a9b40f0da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:45.039552 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd62a97-db1a-40e4-8bd2-f7a9b40f0da9 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:45.039841 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd62a97-db1a-40e4-8bd2-f7a9b40f0da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:45.040771 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd62a97-db1a-40e4-8bd2-f7a9b40f0da9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:45.040901 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd62a97-db1a-40e4-8bd2-f7a9b40f0da9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:45.042433 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd62a97-db1a-40e4-8bd2-f7a9b40f0da9 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:45.053003 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1052/2116] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:44:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:44:45.057512 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb9d36-1511-4f16-95c9-d4617084bd45 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:45.068404 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb9d36-1511-4f16-95c9-d4617084bd45 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:45.073191 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5980f6cb-64ed-4db2-91ec-df63e92d7642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:45.074092 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5980f6cb-64ed-4db2-91ec-df63e92d7642 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:45.074391 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5980f6cb-64ed-4db2-91ec-df63e92d7642 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:45.074651 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5980f6cb-64ed-4db2-91ec-df63e92d7642 admin admin] PATH_INFO: `/v3/projects/e43b638f968a4a399ff8c7a406fd45c4/users/7d544d2646c84732b00cdb7584c94913/roles/0d41da7bec094450b5bff4e4831be52c` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:45.091199 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5980f6cb-64ed-4db2-91ec-df63e92d7642 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e43b638f968a4a399ff8c7a406fd45c4, user_id=7d544d2646c84732b00cdb7584c94913, role_id=0d41da7bec094450b5bff4e4831be52c)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:45.094027 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5980f6cb-64ed-4db2-91ec-df63e92d7642 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:45.235840 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1065/2117] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:44:45 2022] PUT /identity/v3/projects/e43b638f968a4a399ff8c7a406fd45c4/users/7d544d2646c84732b00cdb7584c94913/roles/0d41da7bec094450b5bff4e4831be52c => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:44:45.249483 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf682c0-3418-4c97-ae63-362e01ee490e None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:45.249684 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf682c0-3418-4c97-ae63-362e01ee490e None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:45.249973 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf682c0-3418-4c97-ae63-362e01ee490e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:45.292774 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-dbf682c0-3418-4c97-ae63-362e01ee490e None None] MFA Rules not processed for user `7d544d2646c84732b00cdb7584c94913`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:45.292774 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-dbf682c0-3418-4c97-ae63-362e01ee490e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:45.369986 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1053/2118] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:44:45 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:44:45.374284 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5980f6cb-64ed-4db2-91ec-df63e92d7642 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:45.450690 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5980f6cb-64ed-4db2-91ec-df63e92d7642 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:45.457856 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0bb9af-2432-4fef-b45a-228e080d5871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:45.458632 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0bb9af-2432-4fef-b45a-228e080d5871 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:45.458915 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0bb9af-2432-4fef-b45a-228e080d5871 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:45.459193 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0bb9af-2432-4fef-b45a-228e080d5871 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:45.459953 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0bb9af-2432-4fef-b45a-228e080d5871 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:45.462069 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0bb9af-2432-4fef-b45a-228e080d5871 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:45.593430 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1066/2119] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:44:45 2022] POST /identity/v3/projects => generated 399 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:44:45.598567 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf682c0-3418-4c97-ae63-362e01ee490e None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:45.611108 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf682c0-3418-4c97-ae63-362e01ee490e None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:45.685004 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb09636-21e6-4aa7-bba2-2b5ae02379e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:45.685771 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb09636-21e6-4aa7-bba2-2b5ae02379e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:45.686308 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb09636-21e6-4aa7-bba2-2b5ae02379e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:45.686658 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb09636-21e6-4aa7-bba2-2b5ae02379e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:45.687476 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb09636-21e6-4aa7-bba2-2b5ae02379e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:45.689611 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb09636-21e6-4aa7-bba2-2b5ae02379e6 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:45.780413 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1054/2120] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:44:45 2022] POST /identity/v3/users => generated 306 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:44:45.781917 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0bb9af-2432-4fef-b45a-228e080d5871 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:45.793366 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0bb9af-2432-4fef-b45a-228e080d5871 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:45.798447 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d1192b-6b70-4fbe-ac2c-54fdf5da7bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:45.799123 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d1192b-6b70-4fbe-ac2c-54fdf5da7bbb admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:45.799416 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d1192b-6b70-4fbe-ac2c-54fdf5da7bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:45.799730 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d1192b-6b70-4fbe-ac2c-54fdf5da7bbb admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:45.801057 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d1192b-6b70-4fbe-ac2c-54fdf5da7bbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:45.802690 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d1192b-6b70-4fbe-ac2c-54fdf5da7bbb admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:45.814404 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1067/2121] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:44:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:44:45.819451 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb09636-21e6-4aa7-bba2-2b5ae02379e6 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:45.829796 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb09636-21e6-4aa7-bba2-2b5ae02379e6 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:45.835349 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d27940-4db5-4973-9ee7-879468a80ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:45.836396 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d27940-4db5-4973-9ee7-879468a80ed8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:45.836746 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d27940-4db5-4973-9ee7-879468a80ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:45.837112 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d27940-4db5-4973-9ee7-879468a80ed8 admin admin] PATH_INFO: `/v3/projects/cd7f5c56e97c41b98fb25c9f3cb26391/users/d4bf95d532524541835edc1f54cdc824/roles/702e5e78b5d744529384b96a390ae92f` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:45.853468 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d27940-4db5-4973-9ee7-879468a80ed8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd7f5c56e97c41b98fb25c9f3cb26391, user_id=d4bf95d532524541835edc1f54cdc824, role_id=702e5e78b5d744529384b96a390ae92f)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:45.856350 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d27940-4db5-4973-9ee7-879468a80ed8 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:45.972540 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1055/2122] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:44:45 2022] PUT /identity/v3/projects/cd7f5c56e97c41b98fb25c9f3cb26391/users/d4bf95d532524541835edc1f54cdc824/roles/702e5e78b5d744529384b96a390ae92f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:44:45.976804 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d1192b-6b70-4fbe-ac2c-54fdf5da7bbb admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:45.989933 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d1192b-6b70-4fbe-ac2c-54fdf5da7bbb admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:46.052156 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed2a983-346e-41b9-924d-6c13eec937aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:46.052833 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2a983-346e-41b9-924d-6c13eec937aa admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:46.053190 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2a983-346e-41b9-924d-6c13eec937aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:46.053379 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2a983-346e-41b9-924d-6c13eec937aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:46.054143 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed2a983-346e-41b9-924d-6c13eec937aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:46.056089 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed2a983-346e-41b9-924d-6c13eec937aa admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:46.068033 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1068/2123] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:44:45 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:44:46.072438 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d27940-4db5-4973-9ee7-879468a80ed8 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:46.085002 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d27940-4db5-4973-9ee7-879468a80ed8 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:46.092235 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6c8d7b-5ed5-427f-9965-0bd1e556813f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:46.093459 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c8d7b-5ed5-427f-9965-0bd1e556813f admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:46.093648 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c8d7b-5ed5-427f-9965-0bd1e556813f admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:46.094245 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c8d7b-5ed5-427f-9965-0bd1e556813f admin admin] PATH_INFO: `/v3/projects/cd7f5c56e97c41b98fb25c9f3cb26391/users/d4bf95d532524541835edc1f54cdc824/roles/702e5e78b5d744529384b96a390ae92f` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:46.097868 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6c8d7b-5ed5-427f-9965-0bd1e556813f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd7f5c56e97c41b98fb25c9f3cb26391, user_id=d4bf95d532524541835edc1f54cdc824, role_id=702e5e78b5d744529384b96a390ae92f)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:46.102727 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6c8d7b-5ed5-427f-9965-0bd1e556813f admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:46.118113 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1056/2124] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:44:46 2022] PUT /identity/v3/projects/cd7f5c56e97c41b98fb25c9f3cb26391/users/d4bf95d532524541835edc1f54cdc824/roles/702e5e78b5d744529384b96a390ae92f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:44:46.129814 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da80459-cbb1-4a6f-88e0-3614cfee16c3 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:46.130256 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da80459-cbb1-4a6f-88e0-3614cfee16c3 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:46.130574 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da80459-cbb1-4a6f-88e0-3614cfee16c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:46.160490 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-6da80459-cbb1-4a6f-88e0-3614cfee16c3 None None] MFA Rules not processed for user `d4bf95d532524541835edc1f54cdc824`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:46.161835 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-6da80459-cbb1-4a6f-88e0-3614cfee16c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:46.252059 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1069/2125] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:44:46 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:44:46.263457 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6c8d7b-5ed5-427f-9965-0bd1e556813f admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:46.265170 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-3e6c8d7b-5ed5-427f-9965-0bd1e556813f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:46.349589 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6c8d7b-5ed5-427f-9965-0bd1e556813f admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:46.358681 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4aca96-5d8c-4863-8a33-2c3ffb2b9782 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '950b5b5f690d41509ead753065a0b793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:46.358681 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4aca96-5d8c-4863-8a33-2c3ffb2b9782 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:46.358971 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4aca96-5d8c-4863-8a33-2c3ffb2b9782 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:46.359254 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4aca96-5d8c-4863-8a33-2c3ffb2b9782 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:46.370103 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4aca96-5d8c-4863-8a33-2c3ffb2b9782 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:46.371561 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4aca96-5d8c-4863-8a33-2c3ffb2b9782 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:46.388702 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1057/2126] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:44:46 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 16:44:46.663442 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da80459-cbb1-4a6f-88e0-3614cfee16c3 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:46.678947 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da80459-cbb1-4a6f-88e0-3614cfee16c3 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:46.684380 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa0393-297f-434f-8fb6-48f09fc27d75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '950b5b5f690d41509ead753065a0b793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:46.685376 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa0393-297f-434f-8fb6-48f09fc27d75 service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:46.685981 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa0393-297f-434f-8fb6-48f09fc27d75 service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:46.686581 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa0393-297f-434f-8fb6-48f09fc27d75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:46.797243 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fa0393-297f-434f-8fb6-48f09fc27d75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:46.798944 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fa0393-297f-434f-8fb6-48f09fc27d75 service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:46.810602 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1070/2127] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:44:46 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:44:54.627485 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4aca96-5d8c-4863-8a33-2c3ffb2b9782 service cinder] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:54.629661 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-6a4aca96-5d8c-4863-8a33-2c3ffb2b9782 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:54.723136 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4aca96-5d8c-4863-8a33-2c3ffb2b9782 service cinder] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:54.728047 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3188384-1d7f-4413-b6de-be319214bd08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:54.731837 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3188384-1d7f-4413-b6de-be319214bd08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:54.731837 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3188384-1d7f-4413-b6de-be319214bd08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:54.731837 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3188384-1d7f-4413-b6de-be319214bd08 admin admin] PATH_INFO: `/v3/users/fc07771cdf534f61b39a95d1d4369a42` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:54.731837 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3188384-1d7f-4413-b6de-be319214bd08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc07771cdf534f61b39a95d1d4369a42)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:54.732668 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3188384-1d7f-4413-b6de-be319214bd08 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:54.907999 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a3188384-1d7f-4413-b6de-be319214bd08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc07771cdf534f61b39a95d1d4369a42'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:54.908672 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a3188384-1d7f-4413-b6de-be319214bd08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc07771cdf534f61b39a95d1d4369a42'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:54.982122 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a3188384-1d7f-4413-b6de-be319214bd08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc07771cdf534f61b39a95d1d4369a42'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:54.991615 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a3188384-1d7f-4413-b6de-be319214bd08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc07771cdf534f61b39a95d1d4369a42'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:55.006208 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a3188384-1d7f-4413-b6de-be319214bd08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc07771cdf534f61b39a95d1d4369a42'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:55.013310 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1058/2128] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:44:54 2022] DELETE /identity/v3/users/fc07771cdf534f61b39a95d1d4369a42 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:44:55.017192 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e2d107-353a-4ee3-bdbb-0c6d92a24a9c None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:55.018066 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e2d107-353a-4ee3-bdbb-0c6d92a24a9c None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:55.018754 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e2d107-353a-4ee3-bdbb-0c6d92a24a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:55.043072 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-49e2d107-353a-4ee3-bdbb-0c6d92a24a9c None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:55.044479 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-49e2d107-353a-4ee3-bdbb-0c6d92a24a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:55.108578 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1071/2129] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:44:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:44:55.121771 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3188384-1d7f-4413-b6de-be319214bd08 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:55.123282 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a3188384-1d7f-4413-b6de-be319214bd08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:55.209171 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3188384-1d7f-4413-b6de-be319214bd08 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:55.213079 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa79b5d-b6c6-4898-a1ce-4524efff50c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:55.213807 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa79b5d-b6c6-4898-a1ce-4524efff50c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:55.216275 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa79b5d-b6c6-4898-a1ce-4524efff50c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:55.216275 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa79b5d-b6c6-4898-a1ce-4524efff50c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:55.227925 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa79b5d-b6c6-4898-a1ce-4524efff50c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:55.229410 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa79b5d-b6c6-4898-a1ce-4524efff50c5 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:55.249652 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1059/2130] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:44:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 16:44:55.743687 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e2d107-353a-4ee3-bdbb-0c6d92a24a9c None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:55.751066 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-49e2d107-353a-4ee3-bdbb-0c6d92a24a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:55.771826 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e2d107-353a-4ee3-bdbb-0c6d92a24a9c None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:55.776718 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88fd4b5-5fc5-427c-9f9c-e6b01ac5c496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:55.777649 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88fd4b5-5fc5-427c-9f9c-e6b01ac5c496 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:55.780398 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88fd4b5-5fc5-427c-9f9c-e6b01ac5c496 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:55.780398 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88fd4b5-5fc5-427c-9f9c-e6b01ac5c496 admin admin] PATH_INFO: `/v3/projects/f08efdafbad441c1bd131c0553497193` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:55.780398 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88fd4b5-5fc5-427c-9f9c-e6b01ac5c496 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f08efdafbad441c1bd131c0553497193)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:55.781989 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88fd4b5-5fc5-427c-9f9c-e6b01ac5c496 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:55.932344 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a88fd4b5-5fc5-427c-9f9c-e6b01ac5c496 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f08efdafbad441c1bd131c0553497193', 'request_id': 'req-a88fd4b5-5fc5-427c-9f9c-e6b01ac5c496'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:56.027706 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a88fd4b5-5fc5-427c-9f9c-e6b01ac5c496 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f08efdafbad441c1bd131c0553497193', 'request_id': 'req-a88fd4b5-5fc5-427c-9f9c-e6b01ac5c496'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:56.034648 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a88fd4b5-5fc5-427c-9f9c-e6b01ac5c496 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f08efdafbad441c1bd131c0553497193', 'request_id': 'req-a88fd4b5-5fc5-427c-9f9c-e6b01ac5c496'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:56.046097 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a88fd4b5-5fc5-427c-9f9c-e6b01ac5c496 admin admin] The token cache is being invalidate because project f08efdafbad441c1bd131c0553497193 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:44:56.046376 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a88fd4b5-5fc5-427c-9f9c-e6b01ac5c496 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:56.047064 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a88fd4b5-5fc5-427c-9f9c-e6b01ac5c496 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:56.048859 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1072/2131] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:44:55 2022] DELETE /identity/v3/projects/f08efdafbad441c1bd131c0553497193 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:44:56.054814 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440307ec-1a2f-4b01-be60-66e88506ae53 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:56.055286 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440307ec-1a2f-4b01-be60-66e88506ae53 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:56.055366 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440307ec-1a2f-4b01-be60-66e88506ae53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:56.090652 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-440307ec-1a2f-4b01-be60-66e88506ae53 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:56.090652 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-440307ec-1a2f-4b01-be60-66e88506ae53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:56.181187 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1060/2132] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:44:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:44:56.188925 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a0234-400e-4415-ad1a-7da85ad8de85 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:56.189215 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a0234-400e-4415-ad1a-7da85ad8de85 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:56.189502 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a0234-400e-4415-ad1a-7da85ad8de85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:56.217818 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-401a0234-400e-4415-ad1a-7da85ad8de85 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:56.219057 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-401a0234-400e-4415-ad1a-7da85ad8de85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:56.236117 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1073/2133] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:44:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:44:56.238869 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440307ec-1a2f-4b01-be60-66e88506ae53 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:56.249716 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440307ec-1a2f-4b01-be60-66e88506ae53 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:56.254901 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e3edd8-a949-4bf7-9352-122507bfce30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:56.255990 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e3edd8-a949-4bf7-9352-122507bfce30 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:56.256277 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e3edd8-a949-4bf7-9352-122507bfce30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:56.256555 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e3edd8-a949-4bf7-9352-122507bfce30 admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:56.257745 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e3edd8-a949-4bf7-9352-122507bfce30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:44:56.257745 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e3edd8-a949-4bf7-9352-122507bfce30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:56.259240 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e3edd8-a949-4bf7-9352-122507bfce30 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:56.276278 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1061/2134] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Apr 11 16:44:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:44:56.280318 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a0234-400e-4415-ad1a-7da85ad8de85 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:56.290335 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a0234-400e-4415-ad1a-7da85ad8de85 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:56.296496 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7a9030-32b9-4655-96ab-ed25fb0e1ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:56.303191 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a9030-32b9-4655-96ab-ed25fb0e1ef0 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:56.303191 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a9030-32b9-4655-96ab-ed25fb0e1ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:56.303191 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a9030-32b9-4655-96ab-ed25fb0e1ef0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:56.303191 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7a9030-32b9-4655-96ab-ed25fb0e1ef0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:56.303191 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7a9030-32b9-4655-96ab-ed25fb0e1ef0 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:56.419739 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1074/2135] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:44:56 2022] POST /identity/v3/projects => generated 375 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:44:56.421175 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e3edd8-a949-4bf7-9352-122507bfce30 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:56.432428 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e3edd8-a949-4bf7-9352-122507bfce30 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:56.494189 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbaaba1-44e6-4d9b-af5a-f8afdd0a34c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:56.494896 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbaaba1-44e6-4d9b-af5a-f8afdd0a34c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:56.495193 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbaaba1-44e6-4d9b-af5a-f8afdd0a34c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:56.495542 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbaaba1-44e6-4d9b-af5a-f8afdd0a34c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:56.496248 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbaaba1-44e6-4d9b-af5a-f8afdd0a34c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:56.498254 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbaaba1-44e6-4d9b-af5a-f8afdd0a34c9 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:56.570628 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1062/2136] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:44:56 2022] POST /identity/v3/users => generated 288 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:44:56.574980 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7a9030-32b9-4655-96ab-ed25fb0e1ef0 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:56.586634 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7a9030-32b9-4655-96ab-ed25fb0e1ef0 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:56.591486 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a50e3-1c50-4ad1-b8b8-4a26a2e12cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:56.592212 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a50e3-1c50-4ad1-b8b8-4a26a2e12cb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:56.592724 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a50e3-1c50-4ad1-b8b8-4a26a2e12cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:56.592996 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a50e3-1c50-4ad1-b8b8-4a26a2e12cb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:56.593726 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9a50e3-1c50-4ad1-b8b8-4a26a2e12cb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:56.596015 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9a50e3-1c50-4ad1-b8b8-4a26a2e12cb9 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:56.607596 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1075/2137] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:44:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:44:56.614545 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbaaba1-44e6-4d9b-af5a-f8afdd0a34c9 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:56.624701 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbaaba1-44e6-4d9b-af5a-f8afdd0a34c9 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:56.630049 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e8ca1-6702-4748-bf2c-f556680c7e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:56.630716 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e8ca1-6702-4748-bf2c-f556680c7e62 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:56.630999 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e8ca1-6702-4748-bf2c-f556680c7e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:56.631280 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e8ca1-6702-4748-bf2c-f556680c7e62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:56.632060 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5e8ca1-6702-4748-bf2c-f556680c7e62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:56.633650 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5e8ca1-6702-4748-bf2c-f556680c7e62 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:56.644476 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1063/2138] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:44:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:44:56.648742 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a50e3-1c50-4ad1-b8b8-4a26a2e12cb9 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:56.658859 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a50e3-1c50-4ad1-b8b8-4a26a2e12cb9 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:56.664106 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b914377-cbe1-44f0-9ced-ea45ef5fa559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:56.665042 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b914377-cbe1-44f0-9ced-ea45ef5fa559 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:56.669150 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b914377-cbe1-44f0-9ced-ea45ef5fa559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:56.669150 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b914377-cbe1-44f0-9ced-ea45ef5fa559 admin admin] PATH_INFO: `/v3/projects/5900cce1db854b03a120aa56edbfe3dc/users/7e87df745505432fbde74ba5fb1c8806/roles/0d41da7bec094450b5bff4e4831be52c` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:56.681126 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b914377-cbe1-44f0-9ced-ea45ef5fa559 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5900cce1db854b03a120aa56edbfe3dc, user_id=7e87df745505432fbde74ba5fb1c8806, role_id=0d41da7bec094450b5bff4e4831be52c)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:56.683825 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b914377-cbe1-44f0-9ced-ea45ef5fa559 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:56.777534 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1076/2139] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:44:56 2022] PUT /identity/v3/projects/5900cce1db854b03a120aa56edbfe3dc/users/7e87df745505432fbde74ba5fb1c8806/roles/0d41da7bec094450b5bff4e4831be52c => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:44:56.790965 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41c91d-c6e0-415f-83da-c3947dfac4ef None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:56.791406 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41c91d-c6e0-415f-83da-c3947dfac4ef None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:56.791932 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41c91d-c6e0-415f-83da-c3947dfac4ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:56.820123 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-ab41c91d-c6e0-415f-83da-c3947dfac4ef None None] MFA Rules not processed for user `7e87df745505432fbde74ba5fb1c8806`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:56.821350 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ab41c91d-c6e0-415f-83da-c3947dfac4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:56.884411 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1064/2140] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:44:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:44:56.889118 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b914377-cbe1-44f0-9ced-ea45ef5fa559 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:56.954000 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b914377-cbe1-44f0-9ced-ea45ef5fa559 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:56.959994 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de70e89-96d6-4669-b5b1-2afcfefdb252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:56.960666 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de70e89-96d6-4669-b5b1-2afcfefdb252 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:56.961188 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de70e89-96d6-4669-b5b1-2afcfefdb252 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:56.961467 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de70e89-96d6-4669-b5b1-2afcfefdb252 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:56.962177 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de70e89-96d6-4669-b5b1-2afcfefdb252 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:56.964231 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de70e89-96d6-4669-b5b1-2afcfefdb252 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:57.085062 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1077/2141] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:44:56 2022] POST /identity/v3/projects => generated 375 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:44:57.088992 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab41c91d-c6e0-415f-83da-c3947dfac4ef None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:57.100036 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab41c91d-c6e0-415f-83da-c3947dfac4ef None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:57.168644 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d564c70a-b0d2-4d6f-9355-e289ea3cd79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:57.169604 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d564c70a-b0d2-4d6f-9355-e289ea3cd79f admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:57.169604 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d564c70a-b0d2-4d6f-9355-e289ea3cd79f admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:57.170030 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d564c70a-b0d2-4d6f-9355-e289ea3cd79f admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:57.170794 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d564c70a-b0d2-4d6f-9355-e289ea3cd79f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:57.172877 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d564c70a-b0d2-4d6f-9355-e289ea3cd79f admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:57.291114 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1065/2142] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:44:57 2022] POST /identity/v3/users => generated 288 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:44:57.295109 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de70e89-96d6-4669-b5b1-2afcfefdb252 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:57.306814 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de70e89-96d6-4669-b5b1-2afcfefdb252 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:57.311281 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2136e4-4e3c-42bc-8e7c-e23ffa88b42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:57.312158 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2136e4-4e3c-42bc-8e7c-e23ffa88b42a admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:57.312487 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2136e4-4e3c-42bc-8e7c-e23ffa88b42a admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:57.312965 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2136e4-4e3c-42bc-8e7c-e23ffa88b42a admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:57.313699 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2136e4-4e3c-42bc-8e7c-e23ffa88b42a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:57.315981 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2136e4-4e3c-42bc-8e7c-e23ffa88b42a admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:57.330083 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1078/2143] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:44:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:44:57.333107 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d564c70a-b0d2-4d6f-9355-e289ea3cd79f admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:57.344674 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d564c70a-b0d2-4d6f-9355-e289ea3cd79f admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:57.354812 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c14463c-10d1-4d89-89e9-73d4bdb943d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:57.358658 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c14463c-10d1-4d89-89e9-73d4bdb943d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:57.358658 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c14463c-10d1-4d89-89e9-73d4bdb943d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:57.358658 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c14463c-10d1-4d89-89e9-73d4bdb943d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:57.358658 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c14463c-10d1-4d89-89e9-73d4bdb943d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:57.358658 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c14463c-10d1-4d89-89e9-73d4bdb943d9 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:57.383609 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1066/2144] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:44:57 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:44:57.387861 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2136e4-4e3c-42bc-8e7c-e23ffa88b42a admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:57.406258 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2136e4-4e3c-42bc-8e7c-e23ffa88b42a admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:57.418218 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be4c05-b4d1-4c5c-8567-4734507356e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:57.421723 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be4c05-b4d1-4c5c-8567-4734507356e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:57.421723 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be4c05-b4d1-4c5c-8567-4734507356e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:57.421723 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be4c05-b4d1-4c5c-8567-4734507356e9 admin admin] PATH_INFO: `/v3/projects/29caea87487d497e813751879b347f2b/users/6c5d1f8f8be14a7bbe8310842304bec2/roles/0d41da7bec094450b5bff4e4831be52c` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:57.445462 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75be4c05-b4d1-4c5c-8567-4734507356e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29caea87487d497e813751879b347f2b, user_id=6c5d1f8f8be14a7bbe8310842304bec2, role_id=0d41da7bec094450b5bff4e4831be52c)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:57.450482 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75be4c05-b4d1-4c5c-8567-4734507356e9 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:57.527101 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c14463c-10d1-4d89-89e9-73d4bdb943d9 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:57.529037 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-6c14463c-10d1-4d89-89e9-73d4bdb943d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:57.544212 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c14463c-10d1-4d89-89e9-73d4bdb943d9 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:57.544383 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1079/2145] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:44:57 2022] PUT /identity/v3/projects/29caea87487d497e813751879b347f2b/users/6c5d1f8f8be14a7bbe8310842304bec2/roles/0d41da7bec094450b5bff4e4831be52c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:44:57.557434 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f0ab5-f482-46c2-8412-a2362120fe7a None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:57.558086 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f0ab5-f482-46c2-8412-a2362120fe7a None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:57.558291 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f0ab5-f482-46c2-8412-a2362120fe7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:57.597944 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-4a5f0ab5-f482-46c2-8412-a2362120fe7a None None] MFA Rules not processed for user `6c5d1f8f8be14a7bbe8310842304bec2`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:57.600097 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-4a5f0ab5-f482-46c2-8412-a2362120fe7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:57.637694 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537bb958-8740-48db-8c08-d6ab203cb385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:57.641820 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537bb958-8740-48db-8c08-d6ab203cb385 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:57.641820 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537bb958-8740-48db-8c08-d6ab203cb385 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:57.641820 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537bb958-8740-48db-8c08-d6ab203cb385 admin admin] PATH_INFO: `/v3/users/33ac5e78a7ae4edfa21dae5584649523` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:57.641820 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537bb958-8740-48db-8c08-d6ab203cb385 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33ac5e78a7ae4edfa21dae5584649523)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:57.642364 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537bb958-8740-48db-8c08-d6ab203cb385 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:57.696747 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1080/2146] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:44:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:44:57.701262 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5f0ab5-f482-46c2-8412-a2362120fe7a None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:57.712505 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5f0ab5-f482-46c2-8412-a2362120fe7a None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:57.717498 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafb6ef7-31e3-4bf6-8594-bb93096083cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:57.718159 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb6ef7-31e3-4bf6-8594-bb93096083cd admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:57.718457 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb6ef7-31e3-4bf6-8594-bb93096083cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:57.718766 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb6ef7-31e3-4bf6-8594-bb93096083cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:57.719459 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafb6ef7-31e3-4bf6-8594-bb93096083cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:57.722476 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafb6ef7-31e3-4bf6-8594-bb93096083cd admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:57.814818 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1081/2147] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:44:57 2022] POST /identity/v3/projects => generated 375 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:44:57.816640 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafb6ef7-31e3-4bf6-8594-bb93096083cd admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:57.820768 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-fafb6ef7-31e3-4bf6-8594-bb93096083cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:57.888310 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-537bb958-8740-48db-8c08-d6ab203cb385 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33ac5e78a7ae4edfa21dae5584649523'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:57.889452 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-537bb958-8740-48db-8c08-d6ab203cb385 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33ac5e78a7ae4edfa21dae5584649523'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:57.891174 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafb6ef7-31e3-4bf6-8594-bb93096083cd admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:57.897340 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e866e6-d849-41a1-95f7-9d3e4bd8a814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:57.898226 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e866e6-d849-41a1-95f7-9d3e4bd8a814 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:57.898513 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e866e6-d849-41a1-95f7-9d3e4bd8a814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:57.898794 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e866e6-d849-41a1-95f7-9d3e4bd8a814 admin admin] PATH_INFO: `/v3/users/7d544d2646c84732b00cdb7584c94913` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:57.900238 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e866e6-d849-41a1-95f7-9d3e4bd8a814 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d544d2646c84732b00cdb7584c94913)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:57.902236 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e866e6-d849-41a1-95f7-9d3e4bd8a814 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:58.045041 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-537bb958-8740-48db-8c08-d6ab203cb385 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33ac5e78a7ae4edfa21dae5584649523'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:58.052529 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-537bb958-8740-48db-8c08-d6ab203cb385 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33ac5e78a7ae4edfa21dae5584649523'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:58.063929 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-537bb958-8740-48db-8c08-d6ab203cb385 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33ac5e78a7ae4edfa21dae5584649523'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:58.069984 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1067/2148] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:44:57 2022] DELETE /identity/v3/users/33ac5e78a7ae4edfa21dae5584649523 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:44:58.070769 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537bb958-8740-48db-8c08-d6ab203cb385 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:58.072354 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-537bb958-8740-48db-8c08-d6ab203cb385 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:58.140839 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537bb958-8740-48db-8c08-d6ab203cb385 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:58.147312 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca32da0-5101-411a-b294-314066125087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:58.148047 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca32da0-5101-411a-b294-314066125087 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:58.148333 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca32da0-5101-411a-b294-314066125087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:58.148612 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca32da0-5101-411a-b294-314066125087 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:58.149312 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca32da0-5101-411a-b294-314066125087 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:58.151217 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca32da0-5101-411a-b294-314066125087 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:58.167316 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c5e866e6-d849-41a1-95f7-9d3e4bd8a814 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d544d2646c84732b00cdb7584c94913'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:58.245038 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c5e866e6-d849-41a1-95f7-9d3e4bd8a814 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d544d2646c84732b00cdb7584c94913'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:58.251958 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1068/2149] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:44:58 2022] POST /identity/v3/users => generated 294 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:44:58.254371 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e424207-e686-428e-98d1-4f19c6bc8c5f None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:58.254371 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e424207-e686-428e-98d1-4f19c6bc8c5f None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:58.254679 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e424207-e686-428e-98d1-4f19c6bc8c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:58.255198 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c5e866e6-d849-41a1-95f7-9d3e4bd8a814 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d544d2646c84732b00cdb7584c94913'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:58.256188 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c5e866e6-d849-41a1-95f7-9d3e4bd8a814 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d544d2646c84732b00cdb7584c94913'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:58.270898 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c5e866e6-d849-41a1-95f7-9d3e4bd8a814 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d544d2646c84732b00cdb7584c94913'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:58.276173 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-7e424207-e686-428e-98d1-4f19c6bc8c5f None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:58.277330 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-7e424207-e686-428e-98d1-4f19c6bc8c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:58.277440 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1082/2150] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:44:57 2022] DELETE /identity/v3/users/7d544d2646c84732b00cdb7584c94913 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:44:58.280593 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e866e6-d849-41a1-95f7-9d3e4bd8a814 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:58.280593 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-c5e866e6-d849-41a1-95f7-9d3e4bd8a814 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:58.342109 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1069/2151] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:44:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:44:58.342953 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e424207-e686-428e-98d1-4f19c6bc8c5f None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:58.344221 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-7e424207-e686-428e-98d1-4f19c6bc8c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:58.351093 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e866e6-d849-41a1-95f7-9d3e4bd8a814 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:58.356023 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72407f5-d25d-41ec-ab86-926569b7da10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:58.356761 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e424207-e686-428e-98d1-4f19c6bc8c5f None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:58.356909 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72407f5-d25d-41ec-ab86-926569b7da10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:58.357196 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72407f5-d25d-41ec-ab86-926569b7da10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:58.357640 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72407f5-d25d-41ec-ab86-926569b7da10 admin admin] PATH_INFO: `/v3/users/8f859f7968de4023b1113461a9dc7228` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:58.366143 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72407f5-d25d-41ec-ab86-926569b7da10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f859f7968de4023b1113461a9dc7228)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:58.366143 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72407f5-d25d-41ec-ab86-926569b7da10 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:58.366356 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d7e10-a853-4510-9da7-480db069c165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:58.366356 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d7e10-a853-4510-9da7-480db069c165 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:58.366356 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d7e10-a853-4510-9da7-480db069c165 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:58.366356 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d7e10-a853-4510-9da7-480db069c165 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:58.366713 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96d7e10-a853-4510-9da7-480db069c165 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:58.366713 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96d7e10-a853-4510-9da7-480db069c165 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:58.375435 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1070/2152] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:44:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:44:58.376923 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c71c63-1b31-4a75-a5fb-906b89c40e24 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:58.377214 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c71c63-1b31-4a75-a5fb-906b89c40e24 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:58.378066 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c71c63-1b31-4a75-a5fb-906b89c40e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:58.395904 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-33c71c63-1b31-4a75-a5fb-906b89c40e24 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:58.397139 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-33c71c63-1b31-4a75-a5fb-906b89c40e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:58.405202 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1071/2153] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:44:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:44:58.406140 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c71c63-1b31-4a75-a5fb-906b89c40e24 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:58.407385 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-33c71c63-1b31-4a75-a5fb-906b89c40e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:58.464409 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c71c63-1b31-4a75-a5fb-906b89c40e24 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:58.468046 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d00a201-ae8b-4d41-81c8-8643bb929b47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:58.468727 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00a201-ae8b-4d41-81c8-8643bb929b47 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:58.469409 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00a201-ae8b-4d41-81c8-8643bb929b47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:58.469409 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00a201-ae8b-4d41-81c8-8643bb929b47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:58.479076 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d00a201-ae8b-4d41-81c8-8643bb929b47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:58.480626 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d00a201-ae8b-4d41-81c8-8643bb929b47 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:58.490552 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1072/2154] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:44:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:44:58.491345 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d00a201-ae8b-4d41-81c8-8643bb929b47 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:58.500693 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d00a201-ae8b-4d41-81c8-8643bb929b47 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:58.507090 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586b01ad-9748-4e71-8988-8cc22081d2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:58.508029 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b01ad-9748-4e71-8988-8cc22081d2fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:58.514474 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b01ad-9748-4e71-8988-8cc22081d2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:58.514474 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b01ad-9748-4e71-8988-8cc22081d2fd admin admin] PATH_INFO: `/v3/projects/fe5699fcc57246ef8d3436e0efa45845/users/01449aae3fcb48ffa7d2f57d6bb132ae/roles/702e5e78b5d744529384b96a390ae92f` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:58.528261 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586b01ad-9748-4e71-8988-8cc22081d2fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe5699fcc57246ef8d3436e0efa45845, user_id=01449aae3fcb48ffa7d2f57d6bb132ae, role_id=702e5e78b5d744529384b96a390ae92f)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:58.532320 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586b01ad-9748-4e71-8988-8cc22081d2fd admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:58.550858 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c72407f5-d25d-41ec-ab86-926569b7da10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f859f7968de4023b1113461a9dc7228'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:58.610679 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1073/2155] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:44:58 2022] PUT /identity/v3/projects/fe5699fcc57246ef8d3436e0efa45845/users/01449aae3fcb48ffa7d2f57d6bb132ae/roles/702e5e78b5d744529384b96a390ae92f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:44:58.614238 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586b01ad-9748-4e71-8988-8cc22081d2fd admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:58.632349 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c72407f5-d25d-41ec-ab86-926569b7da10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f859f7968de4023b1113461a9dc7228'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:58.656385 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c72407f5-d25d-41ec-ab86-926569b7da10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f859f7968de4023b1113461a9dc7228'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:58.658289 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c72407f5-d25d-41ec-ab86-926569b7da10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f859f7968de4023b1113461a9dc7228'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:58.677062 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c72407f5-d25d-41ec-ab86-926569b7da10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f859f7968de4023b1113461a9dc7228'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:58.682485 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586b01ad-9748-4e71-8988-8cc22081d2fd admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:58.685654 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1083/2156] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:44:58 2022] DELETE /identity/v3/users/8f859f7968de4023b1113461a9dc7228 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:44:58.692317 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72407f5-d25d-41ec-ab86-926569b7da10 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:58.692432 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e81fb8-0fcb-4616-b4e6-e2c346c70062 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:58.692531 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-c72407f5-d25d-41ec-ab86-926569b7da10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:58.692609 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e81fb8-0fcb-4616-b4e6-e2c346c70062 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:58.692609 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e81fb8-0fcb-4616-b4e6-e2c346c70062 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:58.692609 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e81fb8-0fcb-4616-b4e6-e2c346c70062 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:58.692609 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-f2e81fb8-0fcb-4616-b4e6-e2c346c70062 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:58.771105 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e81fb8-0fcb-4616-b4e6-e2c346c70062 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:58.771458 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72407f5-d25d-41ec-ab86-926569b7da10 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:58.773106 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e81fb8-0fcb-4616-b4e6-e2c346c70062 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:58.777113 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aec942f-ab32-437d-b0e9-1f86375db1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:58.777807 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec942f-ab32-437d-b0e9-1f86375db1f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:58.778275 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec942f-ab32-437d-b0e9-1f86375db1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:58.778561 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec942f-ab32-437d-b0e9-1f86375db1f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:58.779473 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aec942f-ab32-437d-b0e9-1f86375db1f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:58.781141 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aec942f-ab32-437d-b0e9-1f86375db1f5 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:58.785200 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1074/2157] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:44:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:44:58.797094 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1084/2158] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:44:58 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:44:58.799041 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e81fb8-0fcb-4616-b4e6-e2c346c70062 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:58.813819 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e81fb8-0fcb-4616-b4e6-e2c346c70062 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:58.821176 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3d66ec-0116-4568-a65b-3951603876de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:58.822085 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d66ec-0116-4568-a65b-3951603876de admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:58.822371 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d66ec-0116-4568-a65b-3951603876de admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:58.822648 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d66ec-0116-4568-a65b-3951603876de admin admin] PATH_INFO: `/v3/projects/fe5699fcc57246ef8d3436e0efa45845/users/01449aae3fcb48ffa7d2f57d6bb132ae/roles/702e5e78b5d744529384b96a390ae92f` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:58.824707 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3d66ec-0116-4568-a65b-3951603876de admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe5699fcc57246ef8d3436e0efa45845, user_id=01449aae3fcb48ffa7d2f57d6bb132ae, role_id=702e5e78b5d744529384b96a390ae92f)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:58.827562 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3d66ec-0116-4568-a65b-3951603876de admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:58.839579 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1075/2159] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:44:58 2022] PUT /identity/v3/projects/fe5699fcc57246ef8d3436e0efa45845/users/01449aae3fcb48ffa7d2f57d6bb132ae/roles/702e5e78b5d744529384b96a390ae92f => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:44:58.852735 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92992114-9cbe-4d48-bd3d-15fb44237f14 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:58.854923 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92992114-9cbe-4d48-bd3d-15fb44237f14 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:58.854923 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92992114-9cbe-4d48-bd3d-15fb44237f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:58.887433 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-92992114-9cbe-4d48-bd3d-15fb44237f14 None None] MFA Rules not processed for user `01449aae3fcb48ffa7d2f57d6bb132ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:58.888769 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-92992114-9cbe-4d48-bd3d-15fb44237f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:58.978743 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1085/2160] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:44:58 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:44:58.991012 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3d66ec-0116-4568-a65b-3951603876de admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:58.993035 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-3d3d66ec-0116-4568-a65b-3951603876de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:59.060387 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3d66ec-0116-4568-a65b-3951603876de admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:59.064304 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70370ca-0090-42ed-8336-e0e6e02b3a19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '950b5b5f690d41509ead753065a0b793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:59.065639 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70370ca-0090-42ed-8336-e0e6e02b3a19 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:59.066121 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70370ca-0090-42ed-8336-e0e6e02b3a19 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:59.066435 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70370ca-0090-42ed-8336-e0e6e02b3a19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:59.068395 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-d70370ca-0090-42ed-8336-e0e6e02b3a19 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:59.135160 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92992114-9cbe-4d48-bd3d-15fb44237f14 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:59.139969 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-92992114-9cbe-4d48-bd3d-15fb44237f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:59.177112 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70370ca-0090-42ed-8336-e0e6e02b3a19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:59.180511 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70370ca-0090-42ed-8336-e0e6e02b3a19 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:59.199648 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1076/2161] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:44:58 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:44:59.235997 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92992114-9cbe-4d48-bd3d-15fb44237f14 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:59.277058 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a586b1f-53df-47bc-9dc4-60ab9d3e54a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:59.278674 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a586b1f-53df-47bc-9dc4-60ab9d3e54a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:59.279119 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a586b1f-53df-47bc-9dc4-60ab9d3e54a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:59.279403 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a586b1f-53df-47bc-9dc4-60ab9d3e54a1 admin admin] PATH_INFO: `/v3/projects/531e23876eb3483fb661dbb4c8a5a9ce` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:59.282288 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a586b1f-53df-47bc-9dc4-60ab9d3e54a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=531e23876eb3483fb661dbb4c8a5a9ce)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:59.291649 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a586b1f-53df-47bc-9dc4-60ab9d3e54a1 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:59.356223 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70370ca-0090-42ed-8336-e0e6e02b3a19 service cinder] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:59.357868 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-d70370ca-0090-42ed-8336-e0e6e02b3a19 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:59.376203 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70370ca-0090-42ed-8336-e0e6e02b3a19 service cinder] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:59.384144 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c12c6-b202-48a3-a558-1164db1ff86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:59.385041 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c12c6-b202-48a3-a558-1164db1ff86f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:59.385329 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c12c6-b202-48a3-a558-1164db1ff86f admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:59.385811 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c12c6-b202-48a3-a558-1164db1ff86f admin admin] PATH_INFO: `/v3/projects/71264cc4e2534798b9599b37f5c1b626` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:59.387840 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6c12c6-b202-48a3-a558-1164db1ff86f admin admin] RBAC: Authorizing `identity:delete_project(project_id=71264cc4e2534798b9599b37f5c1b626)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:59.389711 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6c12c6-b202-48a3-a558-1164db1ff86f admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:59.431202 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-5a586b1f-53df-47bc-9dc4-60ab9d3e54a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '531e23876eb3483fb661dbb4c8a5a9ce', 'request_id': 'req-5a586b1f-53df-47bc-9dc4-60ab9d3e54a1'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:59.535495 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-9c6c12c6-b202-48a3-a558-1164db1ff86f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71264cc4e2534798b9599b37f5c1b626', 'request_id': 'req-9c6c12c6-b202-48a3-a558-1164db1ff86f'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:59.536917 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-5a586b1f-53df-47bc-9dc4-60ab9d3e54a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '531e23876eb3483fb661dbb4c8a5a9ce', 'request_id': 'req-5a586b1f-53df-47bc-9dc4-60ab9d3e54a1'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:59.542581 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-9c6c12c6-b202-48a3-a558-1164db1ff86f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71264cc4e2534798b9599b37f5c1b626', 'request_id': 'req-9c6c12c6-b202-48a3-a558-1164db1ff86f'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:59.548151 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-5a586b1f-53df-47bc-9dc4-60ab9d3e54a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '531e23876eb3483fb661dbb4c8a5a9ce', 'request_id': 'req-5a586b1f-53df-47bc-9dc4-60ab9d3e54a1'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:59.556366 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-5a586b1f-53df-47bc-9dc4-60ab9d3e54a1 admin admin] The token cache is being invalidate because project 531e23876eb3483fb661dbb4c8a5a9ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:44:59.556655 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-5a586b1f-53df-47bc-9dc4-60ab9d3e54a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:59.557306 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-5a586b1f-53df-47bc-9dc4-60ab9d3e54a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:59.558899 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1086/2162] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:44:59 2022] DELETE /identity/v3/projects/531e23876eb3483fb661dbb4c8a5a9ce => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:44:59.562845 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a586b1f-53df-47bc-9dc4-60ab9d3e54a1 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:59.564203 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-5a586b1f-53df-47bc-9dc4-60ab9d3e54a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:59.625743 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a586b1f-53df-47bc-9dc4-60ab9d3e54a1 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:59.650553 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-9c6c12c6-b202-48a3-a558-1164db1ff86f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71264cc4e2534798b9599b37f5c1b626', 'request_id': 'req-9c6c12c6-b202-48a3-a558-1164db1ff86f'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:59.662203 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-9c6c12c6-b202-48a3-a558-1164db1ff86f admin admin] The token cache is being invalidate because project 71264cc4e2534798b9599b37f5c1b626 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:44:59.662906 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-9c6c12c6-b202-48a3-a558-1164db1ff86f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:59.663340 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-9c6c12c6-b202-48a3-a558-1164db1ff86f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:59.664920 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1077/2163] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:44:59 2022] DELETE /identity/v3/projects/71264cc4e2534798b9599b37f5c1b626 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:44:59.666222 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf1bb2-3965-44c3-8454-d08f045f3f76 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:59.666508 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf1bb2-3965-44c3-8454-d08f045f3f76 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:59.666782 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf1bb2-3965-44c3-8454-d08f045f3f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:59.685780 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-69bf1bb2-3965-44c3-8454-d08f045f3f76 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:59.691802 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-69bf1bb2-3965-44c3-8454-d08f045f3f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:59.693321 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584054f3-7dfa-4f2d-a68d-2b2e09530bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:59.694188 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584054f3-7dfa-4f2d-a68d-2b2e09530bd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:59.694471 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584054f3-7dfa-4f2d-a68d-2b2e09530bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:59.694804 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584054f3-7dfa-4f2d-a68d-2b2e09530bd5 admin admin] PATH_INFO: `/v3/projects/e43b638f968a4a399ff8c7a406fd45c4` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:59.696022 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584054f3-7dfa-4f2d-a68d-2b2e09530bd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e43b638f968a4a399ff8c7a406fd45c4)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:59.697967 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584054f3-7dfa-4f2d-a68d-2b2e09530bd5 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:59.744564 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1078/2164] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:44:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:44:59.745872 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c8176-2b15-486f-808c-19bc7b97de7a None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:59.746144 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c8176-2b15-486f-808c-19bc7b97de7a None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:59.746418 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c8176-2b15-486f-808c-19bc7b97de7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:59.765994 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-e74c8176-2b15-486f-808c-19bc7b97de7a None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:59.767288 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e74c8176-2b15-486f-808c-19bc7b97de7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:59.775787 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1079/2165] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:44:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:44:59.777077 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e471b-47ac-4af6-a0c3-5190caf2c9f6 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:59.777367 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e471b-47ac-4af6-a0c3-5190caf2c9f6 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:59.777642 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e471b-47ac-4af6-a0c3-5190caf2c9f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:59.795794 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-367e471b-47ac-4af6-a0c3-5190caf2c9f6 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:59.796988 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-367e471b-47ac-4af6-a0c3-5190caf2c9f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:59.805310 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1080/2166] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:44:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:44:59.806656 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d87cb8-ad37-4db9-8f81-07bec4f726fc None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:59.806960 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d87cb8-ad37-4db9-8f81-07bec4f726fc None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:59.807261 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d87cb8-ad37-4db9-8f81-07bec4f726fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:59.829636 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-e3d87cb8-ad37-4db9-8f81-07bec4f726fc None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:59.833573 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e3d87cb8-ad37-4db9-8f81-07bec4f726fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:59.834935 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-584054f3-7dfa-4f2d-a68d-2b2e09530bd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e43b638f968a4a399ff8c7a406fd45c4', 'request_id': 'req-584054f3-7dfa-4f2d-a68d-2b2e09530bd5'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:59.888182 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1081/2167] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:44:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:44:59.889055 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d87cb8-ad37-4db9-8f81-07bec4f726fc None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:59.898018 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d87cb8-ad37-4db9-8f81-07bec4f726fc None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:59.914125 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a50729d-cd0b-47e0-a6e1-d928b9563a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:59.914125 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50729d-cd0b-47e0-a6e1-d928b9563a9e admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:59.914125 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50729d-cd0b-47e0-a6e1-d928b9563a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:59.914125 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50729d-cd0b-47e0-a6e1-d928b9563a9e admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:59.914986 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a50729d-cd0b-47e0-a6e1-d928b9563a9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:44:59.914986 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a50729d-cd0b-47e0-a6e1-d928b9563a9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:59.914986 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a50729d-cd0b-47e0-a6e1-d928b9563a9e admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:59.923387 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1082/2168] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Apr 11 16:44:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:44:59.923387 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a50729d-cd0b-47e0-a6e1-d928b9563a9e admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:59.933016 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a50729d-cd0b-47e0-a6e1-d928b9563a9e admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:59.938174 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec94254-4fca-42f4-841e-09b4906a1266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:59.938821 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec94254-4fca-42f4-841e-09b4906a1266 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:59.939104 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec94254-4fca-42f4-841e-09b4906a1266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:59.939381 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec94254-4fca-42f4-841e-09b4906a1266 admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:59.940196 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec94254-4fca-42f4-841e-09b4906a1266 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:44:59.940631 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec94254-4fca-42f4-841e-09b4906a1266 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:59.942898 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec94254-4fca-42f4-841e-09b4906a1266 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:59.948309 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-584054f3-7dfa-4f2d-a68d-2b2e09530bd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e43b638f968a4a399ff8c7a406fd45c4', 'request_id': 'req-584054f3-7dfa-4f2d-a68d-2b2e09530bd5'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:59.965773 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1083/2169] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Apr 11 16:44:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:44:59.965878 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-584054f3-7dfa-4f2d-a68d-2b2e09530bd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e43b638f968a4a399ff8c7a406fd45c4', 'request_id': 'req-584054f3-7dfa-4f2d-a68d-2b2e09530bd5'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:59.965968 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec94254-4fca-42f4-841e-09b4906a1266 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:59.968965 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-584054f3-7dfa-4f2d-a68d-2b2e09530bd5 admin admin] The token cache is being invalidate because project e43b638f968a4a399ff8c7a406fd45c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:44:59.969256 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-584054f3-7dfa-4f2d-a68d-2b2e09530bd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:59.969802 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec94254-4fca-42f4-841e-09b4906a1266 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:59.970011 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-584054f3-7dfa-4f2d-a68d-2b2e09530bd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:44:59.976823 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1087/2170] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:44:59 2022] DELETE /identity/v3/projects/e43b638f968a4a399ff8c7a406fd45c4 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:44:59.976823 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584054f3-7dfa-4f2d-a68d-2b2e09530bd5 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:59.976823 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-584054f3-7dfa-4f2d-a68d-2b2e09530bd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:59.978951 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e232a5-c186-4dcd-8914-0755b318d69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:59.979832 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e232a5-c186-4dcd-8914-0755b318d69f admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:59.980185 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e232a5-c186-4dcd-8914-0755b318d69f admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:59.980565 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e232a5-c186-4dcd-8914-0755b318d69f admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:59.981304 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e232a5-c186-4dcd-8914-0755b318d69f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:59.983296 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e232a5-c186-4dcd-8914-0755b318d69f admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:59.989970 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584054f3-7dfa-4f2d-a68d-2b2e09530bd5 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:59.998276 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70207641-3d4f-4d26-814b-17b31617299d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:59.998276 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70207641-3d4f-4d26-814b-17b31617299d admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:59.998276 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70207641-3d4f-4d26-814b-17b31617299d admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:59.998276 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70207641-3d4f-4d26-814b-17b31617299d admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:59.998662 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70207641-3d4f-4d26-814b-17b31617299d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:59.998852 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70207641-3d4f-4d26-814b-17b31617299d admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:00.148768 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1084/2172] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:44:59 2022] POST /identity/v3/projects => generated 371 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:45:00.148957 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1088/2172] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:44:59 2022] POST /identity/v3/projects => generated 403 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:45:00.150064 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70207641-3d4f-4d26-814b-17b31617299d admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:00.151850 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-70207641-3d4f-4d26-814b-17b31617299d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:00.152704 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e232a5-c186-4dcd-8914-0755b318d69f admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:00.215849 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e232a5-c186-4dcd-8914-0755b318d69f admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:00.217319 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70207641-3d4f-4d26-814b-17b31617299d admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:00.221146 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef66f6-afe7-42ed-9cda-e6714951c39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:00.222634 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef66f6-afe7-42ed-9cda-e6714951c39b admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:00.223015 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef66f6-afe7-42ed-9cda-e6714951c39b admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:00.223429 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef66f6-afe7-42ed-9cda-e6714951c39b admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:00.224161 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ef66f6-afe7-42ed-9cda-e6714951c39b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:00.224738 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02982197-123f-41a5-ad3f-7e05bb5386cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:00.225617 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02982197-123f-41a5-ad3f-7e05bb5386cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:00.225899 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02982197-123f-41a5-ad3f-7e05bb5386cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:00.226108 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ef66f6-afe7-42ed-9cda-e6714951c39b admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:00.226202 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02982197-123f-41a5-ad3f-7e05bb5386cd admin admin] PATH_INFO: `/v3/users/d4bf95d532524541835edc1f54cdc824` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:00.227465 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02982197-123f-41a5-ad3f-7e05bb5386cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4bf95d532524541835edc1f54cdc824)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:00.229678 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02982197-123f-41a5-ad3f-7e05bb5386cd admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:00.403827 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1085/2173] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:45:00 2022] POST /identity/v3/users => generated 302 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:45:00.404785 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef66f6-afe7-42ed-9cda-e6714951c39b admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:00.406519 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-85ef66f6-afe7-42ed-9cda-e6714951c39b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:00.419879 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef66f6-afe7-42ed-9cda-e6714951c39b admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:00.424987 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2225f1d5-bf4b-4ed5-acad-631776a1907b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:00.425654 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2225f1d5-bf4b-4ed5-acad-631776a1907b admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:00.425936 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2225f1d5-bf4b-4ed5-acad-631776a1907b admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:00.426220 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2225f1d5-bf4b-4ed5-acad-631776a1907b admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:00.426913 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2225f1d5-bf4b-4ed5-acad-631776a1907b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:00.428914 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2225f1d5-bf4b-4ed5-acad-631776a1907b admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:00.542586 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-02982197-123f-41a5-ad3f-7e05bb5386cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4bf95d532524541835edc1f54cdc824'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:00.580412 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1086/2174] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:45:00 2022] POST /identity/v3/users => generated 286 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:45:00.581249 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2225f1d5-bf4b-4ed5-acad-631776a1907b admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:00.590481 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2225f1d5-bf4b-4ed5-acad-631776a1907b admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:00.595007 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa4a3d0-a9e8-4419-b5d5-84b5efa398d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:00.595669 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa4a3d0-a9e8-4419-b5d5-84b5efa398d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:00.595953 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa4a3d0-a9e8-4419-b5d5-84b5efa398d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:00.596847 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa4a3d0-a9e8-4419-b5d5-84b5efa398d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:00.597563 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa4a3d0-a9e8-4419-b5d5-84b5efa398d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:00.599131 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-02982197-123f-41a5-ad3f-7e05bb5386cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4bf95d532524541835edc1f54cdc824'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:00.599273 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa4a3d0-a9e8-4419-b5d5-84b5efa398d7 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:00.606486 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-02982197-123f-41a5-ad3f-7e05bb5386cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4bf95d532524541835edc1f54cdc824'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:00.613424 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-02982197-123f-41a5-ad3f-7e05bb5386cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4bf95d532524541835edc1f54cdc824'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:00.613549 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1087/2175] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:45:00 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:45:00.613549 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa4a3d0-a9e8-4419-b5d5-84b5efa398d7 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:00.614691 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-4fa4a3d0-a9e8-4419-b5d5-84b5efa398d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:00.620206 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-02982197-123f-41a5-ad3f-7e05bb5386cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4bf95d532524541835edc1f54cdc824'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:00.626118 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1089/2176] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:45:00 2022] DELETE /identity/v3/users/d4bf95d532524541835edc1f54cdc824 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:45:00.626891 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02982197-123f-41a5-ad3f-7e05bb5386cd admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:00.627391 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa4a3d0-a9e8-4419-b5d5-84b5efa398d7 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:00.628477 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-02982197-123f-41a5-ad3f-7e05bb5386cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:00.687761 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069d2ae7-5edf-4856-a5db-926fc4065929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:00.689437 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d2ae7-5edf-4856-a5db-926fc4065929 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:00.690048 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d2ae7-5edf-4856-a5db-926fc4065929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:00.690666 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d2ae7-5edf-4856-a5db-926fc4065929 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:00.692232 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069d2ae7-5edf-4856-a5db-926fc4065929 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:00.694776 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069d2ae7-5edf-4856-a5db-926fc4065929 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:00.703077 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02982197-123f-41a5-ad3f-7e05bb5386cd admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:00.709810 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1088/2177] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:45:00 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:45:00.710010 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceae448f-0a34-4a67-81df-af920c0d8026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:00.710010 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae448f-0a34-4a67-81df-af920c0d8026 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:00.710010 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae448f-0a34-4a67-81df-af920c0d8026 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:00.710010 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae448f-0a34-4a67-81df-af920c0d8026 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:00.710444 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceae448f-0a34-4a67-81df-af920c0d8026 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:00.711121 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069d2ae7-5edf-4856-a5db-926fc4065929 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:00.711998 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceae448f-0a34-4a67-81df-af920c0d8026 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:00.721772 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069d2ae7-5edf-4856-a5db-926fc4065929 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:00.726893 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2792db56-e796-4b1e-b97f-eff8f4e195af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:00.727505 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792db56-e796-4b1e-b97f-eff8f4e195af admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:00.727818 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792db56-e796-4b1e-b97f-eff8f4e195af admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:00.728097 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792db56-e796-4b1e-b97f-eff8f4e195af admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:00.728820 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2792db56-e796-4b1e-b97f-eff8f4e195af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:00.730155 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1090/2178] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:45:00 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:45:00.730418 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2792db56-e796-4b1e-b97f-eff8f4e195af admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:00.734432 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceae448f-0a34-4a67-81df-af920c0d8026 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:00.742380 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1089/2179] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:45:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:45:00.747010 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2792db56-e796-4b1e-b97f-eff8f4e195af admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:00.747156 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceae448f-0a34-4a67-81df-af920c0d8026 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:00.751825 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17587da0-db4d-4da5-a20a-738294c85156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:00.753240 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17587da0-db4d-4da5-a20a-738294c85156 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:00.753533 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17587da0-db4d-4da5-a20a-738294c85156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:00.753820 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17587da0-db4d-4da5-a20a-738294c85156 admin admin] PATH_INFO: `/v3/projects/b1e3b98ea2084d5cbd85aac888e11f63/users/500b3718339b4ac8b63d5777d5ce39e0/roles/0d41da7bec094450b5bff4e4831be52c` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:00.757030 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2792db56-e796-4b1e-b97f-eff8f4e195af admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:00.761642 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b5ca8-0324-41f2-8842-df22bd398449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:00.762529 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b5ca8-0324-41f2-8842-df22bd398449 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:00.762812 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b5ca8-0324-41f2-8842-df22bd398449 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:00.763092 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b5ca8-0324-41f2-8842-df22bd398449 admin admin] PATH_INFO: `/v3/projects/96160937a8c547b0ae0f3ce3a50a91a4/users/95e5461dea804c72be04fe66b221e19c/roles/0d41da7bec094450b5bff4e4831be52c` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:00.771116 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17587da0-db4d-4da5-a20a-738294c85156 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1e3b98ea2084d5cbd85aac888e11f63, user_id=500b3718339b4ac8b63d5777d5ce39e0, role_id=0d41da7bec094450b5bff4e4831be52c)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:00.773895 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17587da0-db4d-4da5-a20a-738294c85156 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:00.778668 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7b5ca8-0324-41f2-8842-df22bd398449 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96160937a8c547b0ae0f3ce3a50a91a4, user_id=95e5461dea804c72be04fe66b221e19c, role_id=0d41da7bec094450b5bff4e4831be52c)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:00.781368 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7b5ca8-0324-41f2-8842-df22bd398449 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:00.859257 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1091/2180] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:45:00 2022] PUT /identity/v3/projects/b1e3b98ea2084d5cbd85aac888e11f63/users/500b3718339b4ac8b63d5777d5ce39e0/roles/0d41da7bec094450b5bff4e4831be52c => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:45:00.864283 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c505ff4d-38ac-49ee-9a99-8812c3200a70 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:00.864577 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c505ff4d-38ac-49ee-9a99-8812c3200a70 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:00.864859 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c505ff4d-38ac-49ee-9a99-8812c3200a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:00.881698 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-c505ff4d-38ac-49ee-9a99-8812c3200a70 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:45:00.883015 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-c505ff4d-38ac-49ee-9a99-8812c3200a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:00.891980 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1090/2181] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:45:00 2022] PUT /identity/v3/projects/96160937a8c547b0ae0f3ce3a50a91a4/users/95e5461dea804c72be04fe66b221e19c/roles/0d41da7bec094450b5bff4e4831be52c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:45:00.903655 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e9344-fef9-4cff-bad0-815daf7976ce None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:00.904138 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e9344-fef9-4cff-bad0-815daf7976ce None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:00.904435 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e9344-fef9-4cff-bad0-815daf7976ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:00.933347 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-712e9344-fef9-4cff-bad0-815daf7976ce None None] MFA Rules not processed for user `95e5461dea804c72be04fe66b221e19c`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:45:00.934570 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-712e9344-fef9-4cff-bad0-815daf7976ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:00.961558 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1092/2182] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:45:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:45:00.972376 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c505ff4d-38ac-49ee-9a99-8812c3200a70 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:00.973781 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-c505ff4d-38ac-49ee-9a99-8812c3200a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:01.016366 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1091/2183] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:45:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:45:01.025862 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712e9344-fef9-4cff-bad0-815daf7976ce None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:01.031588 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-712e9344-fef9-4cff-bad0-815daf7976ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:01.049390 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c505ff4d-38ac-49ee-9a99-8812c3200a70 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:01.103685 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712e9344-fef9-4cff-bad0-815daf7976ce None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:01.107392 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7b5d28-b7fe-41ce-9c90-ddc0465eaf7c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f7cf98d5394b28a475fd67e30fc9c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:01.108124 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b5d28-b7fe-41ce-9c90-ddc0465eaf7c service glance] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:01.108424 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b5d28-b7fe-41ce-9c90-ddc0465eaf7c service glance] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:01.108827 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b5d28-b7fe-41ce-9c90-ddc0465eaf7c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:01.118202 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7b5d28-b7fe-41ce-9c90-ddc0465eaf7c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:01.118366 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca033c7-e7c8-4574-bc6f-a685c3c9889f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:01.118895 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca033c7-e7c8-4574-bc6f-a685c3c9889f service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:01.119180 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca033c7-e7c8-4574-bc6f-a685c3c9889f service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:01.119625 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca033c7-e7c8-4574-bc6f-a685c3c9889f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:01.119721 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7b5d28-b7fe-41ce-9c90-ddc0465eaf7c service glance] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:01.129875 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1092/2184] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:45:01 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 16:45:01.130832 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7b5d28-b7fe-41ce-9c90-ddc0465eaf7c service glance] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:01.134155 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-1b7b5d28-b7fe-41ce-9c90-ddc0465eaf7c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:01.200480 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca033c7-e7c8-4574-bc6f-a685c3c9889f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:01.201915 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca033c7-e7c8-4574-bc6f-a685c3c9889f service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:01.213392 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1093/2185] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:45:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 16:45:01.216745 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7b5d28-b7fe-41ce-9c90-ddc0465eaf7c service glance] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:01.224032 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b2f8b-7d59-4a32-acc2-44671a81d1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:01.224032 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b2f8b-7d59-4a32-acc2-44671a81d1c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:01.224032 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b2f8b-7d59-4a32-acc2-44671a81d1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:01.224032 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b2f8b-7d59-4a32-acc2-44671a81d1c3 admin admin] PATH_INFO: `/v3/projects/cd7f5c56e97c41b98fb25c9f3cb26391` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:01.225240 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0b2f8b-7d59-4a32-acc2-44671a81d1c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd7f5c56e97c41b98fb25c9f3cb26391)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:01.227161 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0b2f8b-7d59-4a32-acc2-44671a81d1c3 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:01.370030 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1f0b2f8b-7d59-4a32-acc2-44671a81d1c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd7f5c56e97c41b98fb25c9f3cb26391', 'request_id': 'req-1f0b2f8b-7d59-4a32-acc2-44671a81d1c3'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:01.375951 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1f0b2f8b-7d59-4a32-acc2-44671a81d1c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd7f5c56e97c41b98fb25c9f3cb26391', 'request_id': 'req-1f0b2f8b-7d59-4a32-acc2-44671a81d1c3'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:01.461951 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1f0b2f8b-7d59-4a32-acc2-44671a81d1c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd7f5c56e97c41b98fb25c9f3cb26391', 'request_id': 'req-1f0b2f8b-7d59-4a32-acc2-44671a81d1c3'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:01.473899 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1f0b2f8b-7d59-4a32-acc2-44671a81d1c3 admin admin] The token cache is being invalidate because project cd7f5c56e97c41b98fb25c9f3cb26391 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:45:01.476185 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1f0b2f8b-7d59-4a32-acc2-44671a81d1c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:01.476185 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1f0b2f8b-7d59-4a32-acc2-44671a81d1c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:01.476966 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1093/2186] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:45:01 2022] DELETE /identity/v3/projects/cd7f5c56e97c41b98fb25c9f3cb26391 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:45:01.481375 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06430bef-4bc4-4131-b8de-c65aac396697 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:01.481983 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06430bef-4bc4-4131-b8de-c65aac396697 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:01.482261 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06430bef-4bc4-4131-b8de-c65aac396697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:01.499850 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-06430bef-4bc4-4131-b8de-c65aac396697 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:45:01.501021 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-06430bef-4bc4-4131-b8de-c65aac396697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:01.560435 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1094/2187] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:45:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:45:01.569025 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140904eb-2ce1-490a-9ded-d48655ab54e2 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:01.569353 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140904eb-2ce1-490a-9ded-d48655ab54e2 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:01.569634 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140904eb-2ce1-490a-9ded-d48655ab54e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:01.595333 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-140904eb-2ce1-490a-9ded-d48655ab54e2 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:45:01.596759 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-140904eb-2ce1-490a-9ded-d48655ab54e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:01.605077 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1094/2188] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:45:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:45:01.609522 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06430bef-4bc4-4131-b8de-c65aac396697 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:01.620057 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06430bef-4bc4-4131-b8de-c65aac396697 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:01.624928 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc25bb05-b05e-46e6-aa59-96a75e559017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:01.625599 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25bb05-b05e-46e6-aa59-96a75e559017 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:01.625887 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25bb05-b05e-46e6-aa59-96a75e559017 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:01.626178 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25bb05-b05e-46e6-aa59-96a75e559017 admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:01.626906 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc25bb05-b05e-46e6-aa59-96a75e559017 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:45:01.627217 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc25bb05-b05e-46e6-aa59-96a75e559017 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:01.629578 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc25bb05-b05e-46e6-aa59-96a75e559017 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:01.641935 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1095/2189] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Apr 11 16:45:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:45:01.646862 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140904eb-2ce1-490a-9ded-d48655ab54e2 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:01.656203 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140904eb-2ce1-490a-9ded-d48655ab54e2 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:01.662218 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0402f0-61e0-402c-801f-4905b8d31d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:01.662475 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0402f0-61e0-402c-801f-4905b8d31d5c admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:01.662764 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0402f0-61e0-402c-801f-4905b8d31d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:01.663039 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0402f0-61e0-402c-801f-4905b8d31d5c admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:01.663757 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0402f0-61e0-402c-801f-4905b8d31d5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:01.665718 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0402f0-61e0-402c-801f-4905b8d31d5c admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:01.792604 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1095/2190] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:45:01 2022] POST /identity/v3/projects => generated 379 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:45:01.793861 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc25bb05-b05e-46e6-aa59-96a75e559017 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:01.806488 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc25bb05-b05e-46e6-aa59-96a75e559017 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:01.865343 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d7b1e-5db1-48c0-a9d6-0877b6b36fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:01.866039 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d7b1e-5db1-48c0-a9d6-0877b6b36fa8 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:01.866328 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d7b1e-5db1-48c0-a9d6-0877b6b36fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:01.866608 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d7b1e-5db1-48c0-a9d6-0877b6b36fa8 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:01.867335 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56d7b1e-5db1-48c0-a9d6-0877b6b36fa8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:01.869280 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56d7b1e-5db1-48c0-a9d6-0877b6b36fa8 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:02.051632 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1096/2191] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:45:01 2022] POST /identity/v3/users => generated 290 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:45:02.060158 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0402f0-61e0-402c-801f-4905b8d31d5c admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:02.066535 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0402f0-61e0-402c-801f-4905b8d31d5c admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:02.071057 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a7c29a-3d03-4b52-8fe6-4448a63782bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:02.071782 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7c29a-3d03-4b52-8fe6-4448a63782bf admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:02.072099 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7c29a-3d03-4b52-8fe6-4448a63782bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:02.072520 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7c29a-3d03-4b52-8fe6-4448a63782bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:02.073287 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a7c29a-3d03-4b52-8fe6-4448a63782bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:02.074953 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a7c29a-3d03-4b52-8fe6-4448a63782bf admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:02.089788 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1096/2192] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:45:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:45:02.091853 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d7b1e-5db1-48c0-a9d6-0877b6b36fa8 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:02.105768 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d7b1e-5db1-48c0-a9d6-0877b6b36fa8 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:02.113282 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7899ba4-a509-4289-82d5-d8bea4509f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:02.114204 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7899ba4-a509-4289-82d5-d8bea4509f16 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:02.121383 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7899ba4-a509-4289-82d5-d8bea4509f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:02.121383 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7899ba4-a509-4289-82d5-d8bea4509f16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:02.121383 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7899ba4-a509-4289-82d5-d8bea4509f16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:02.121383 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7899ba4-a509-4289-82d5-d8bea4509f16 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:02.135206 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1097/2193] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:45:02 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:45:02.136390 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a7c29a-3d03-4b52-8fe6-4448a63782bf admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:02.147264 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a7c29a-3d03-4b52-8fe6-4448a63782bf admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:02.154122 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a0ffcf-958c-43bf-80a7-06f2aa24da2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:02.155051 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0ffcf-958c-43bf-80a7-06f2aa24da2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:02.155400 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0ffcf-958c-43bf-80a7-06f2aa24da2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:02.155749 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0ffcf-958c-43bf-80a7-06f2aa24da2c admin admin] PATH_INFO: `/v3/projects/4a506c89da704221bc2451b8c69ee731/users/4b5ee4bf4b2a4133928c55a6b695009c/roles/0d41da7bec094450b5bff4e4831be52c` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:02.172093 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a0ffcf-958c-43bf-80a7-06f2aa24da2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a506c89da704221bc2451b8c69ee731, user_id=4b5ee4bf4b2a4133928c55a6b695009c, role_id=0d41da7bec094450b5bff4e4831be52c)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:02.175649 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a0ffcf-958c-43bf-80a7-06f2aa24da2c admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:02.262165 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1097/2194] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:45:02 2022] PUT /identity/v3/projects/4a506c89da704221bc2451b8c69ee731/users/4b5ee4bf4b2a4133928c55a6b695009c/roles/0d41da7bec094450b5bff4e4831be52c => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:45:02.275013 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095d463-0d65-443a-988c-8a56b19d6935 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:02.275302 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095d463-0d65-443a-988c-8a56b19d6935 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:02.275722 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095d463-0d65-443a-988c-8a56b19d6935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:02.314706 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-1095d463-0d65-443a-988c-8a56b19d6935 None None] MFA Rules not processed for user `4b5ee4bf4b2a4133928c55a6b695009c`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:45:02.314706 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-1095d463-0d65-443a-988c-8a56b19d6935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:02.372710 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1098/2195] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:45:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:45:02.377199 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a0ffcf-958c-43bf-80a7-06f2aa24da2c admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:02.443647 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a0ffcf-958c-43bf-80a7-06f2aa24da2c admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:02.448407 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c815f5-fb1e-431a-b9ea-7ee92bd58b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:02.449168 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c815f5-fb1e-431a-b9ea-7ee92bd58b5c admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:02.449366 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c815f5-fb1e-431a-b9ea-7ee92bd58b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:02.449646 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c815f5-fb1e-431a-b9ea-7ee92bd58b5c admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:02.450357 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c815f5-fb1e-431a-b9ea-7ee92bd58b5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:02.452303 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c815f5-fb1e-431a-b9ea-7ee92bd58b5c admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:02.590112 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1098/2196] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:45:02 2022] POST /identity/v3/projects => generated 381 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:45:02.593948 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1095d463-0d65-443a-988c-8a56b19d6935 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:02.604974 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1095d463-0d65-443a-988c-8a56b19d6935 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:02.661730 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db1f74-21e7-4122-9be5-6c02d6c2f2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:02.662422 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db1f74-21e7-4122-9be5-6c02d6c2f2de admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:02.662704 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db1f74-21e7-4122-9be5-6c02d6c2f2de admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:02.663552 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db1f74-21e7-4122-9be5-6c02d6c2f2de admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:02.663779 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0db1f74-21e7-4122-9be5-6c02d6c2f2de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:02.665837 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0db1f74-21e7-4122-9be5-6c02d6c2f2de admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:02.765265 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1099/2197] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:45:02 2022] POST /identity/v3/users => generated 297 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:45:02.769832 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c815f5-fb1e-431a-b9ea-7ee92bd58b5c admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:02.781055 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c815f5-fb1e-431a-b9ea-7ee92bd58b5c admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:02.787709 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e265f-9262-403f-ae70-cebae2539bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:02.788195 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e265f-9262-403f-ae70-cebae2539bfa admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:02.788542 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e265f-9262-403f-ae70-cebae2539bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:02.788885 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e265f-9262-403f-ae70-cebae2539bfa admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:02.789760 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058e265f-9262-403f-ae70-cebae2539bfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:02.791715 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058e265f-9262-403f-ae70-cebae2539bfa admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:02.803799 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1099/2198] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:45:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:45:02.807980 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e265f-9262-403f-ae70-cebae2539bfa admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:02.808628 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde266a-4af7-46ed-b539-9c407a1d4952 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:02.808923 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde266a-4af7-46ed-b539-9c407a1d4952 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:02.809205 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde266a-4af7-46ed-b539-9c407a1d4952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:02.819640 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e265f-9262-403f-ae70-cebae2539bfa admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:02.824614 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb44e9f-c1bb-4265-bbf2-b271b6d4756a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:02.825605 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb44e9f-c1bb-4265-bbf2-b271b6d4756a admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:02.826151 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb44e9f-c1bb-4265-bbf2-b271b6d4756a admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:02.826528 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb44e9f-c1bb-4265-bbf2-b271b6d4756a admin admin] PATH_INFO: `/v3/projects/68fa2a11cb7f4fa6b31a65e60479ee3c/users/2f95291e6fd24393bcae5b0526cd9580/roles/702e5e78b5d744529384b96a390ae92f` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:02.838962 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-ccde266a-4af7-46ed-b539-9c407a1d4952 None None] MFA Rules not processed for user `500b3718339b4ac8b63d5777d5ce39e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:45:02.840449 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-ccde266a-4af7-46ed-b539-9c407a1d4952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:02.844419 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb44e9f-c1bb-4265-bbf2-b271b6d4756a admin admin] RBAC: Authorizing `identity:create_grant(project_id=68fa2a11cb7f4fa6b31a65e60479ee3c, user_id=2f95291e6fd24393bcae5b0526cd9580, role_id=702e5e78b5d744529384b96a390ae92f)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:02.848268 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb44e9f-c1bb-4265-bbf2-b271b6d4756a admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:02.907039 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1100/2199] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:45:02 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:45:02.912001 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde266a-4af7-46ed-b539-9c407a1d4952 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:02.913309 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-ccde266a-4af7-46ed-b539-9c407a1d4952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:02.927871 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde266a-4af7-46ed-b539-9c407a1d4952 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:02.934306 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064c1ada-682c-44a6-9afd-ccae220e91e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:02.935415 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c1ada-682c-44a6-9afd-ccae220e91e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:02.935804 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c1ada-682c-44a6-9afd-ccae220e91e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:02.936258 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c1ada-682c-44a6-9afd-ccae220e91e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:02.937436 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064c1ada-682c-44a6-9afd-ccae220e91e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:02.940918 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1100/2200] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:45:02 2022] PUT /identity/v3/projects/68fa2a11cb7f4fa6b31a65e60479ee3c/users/2f95291e6fd24393bcae5b0526cd9580/roles/702e5e78b5d744529384b96a390ae92f => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:45:02.941195 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064c1ada-682c-44a6-9afd-ccae220e91e3 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:02.946593 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb44e9f-c1bb-4265-bbf2-b271b6d4756a admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:03.007681 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb44e9f-c1bb-4265-bbf2-b271b6d4756a admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:03.012962 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17ddd3c-c0f6-4d89-ac3f-f41ab64659d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:03.013738 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17ddd3c-c0f6-4d89-ac3f-f41ab64659d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:03.014033 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17ddd3c-c0f6-4d89-ac3f-f41ab64659d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:03.014317 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17ddd3c-c0f6-4d89-ac3f-f41ab64659d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:03.015620 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17ddd3c-c0f6-4d89-ac3f-f41ab64659d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:03.017233 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17ddd3c-c0f6-4d89-ac3f-f41ab64659d5 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:03.028381 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1101/2201] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:45:02 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 16:45:03.033001 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17ddd3c-c0f6-4d89-ac3f-f41ab64659d5 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:03.043183 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17ddd3c-c0f6-4d89-ac3f-f41ab64659d5 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:03.047887 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c16f98-eef6-43b8-aa1f-4eca1f34948e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:03.048748 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c16f98-eef6-43b8-aa1f-4eca1f34948e admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:03.049148 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c16f98-eef6-43b8-aa1f-4eca1f34948e admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:03.049339 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c16f98-eef6-43b8-aa1f-4eca1f34948e admin admin] PATH_INFO: `/v3/projects/68fa2a11cb7f4fa6b31a65e60479ee3c/users/2f95291e6fd24393bcae5b0526cd9580/roles/702e5e78b5d744529384b96a390ae92f` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:03.051397 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c16f98-eef6-43b8-aa1f-4eca1f34948e admin admin] RBAC: Authorizing `identity:create_grant(project_id=68fa2a11cb7f4fa6b31a65e60479ee3c, user_id=2f95291e6fd24393bcae5b0526cd9580, role_id=702e5e78b5d744529384b96a390ae92f)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:03.054313 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c16f98-eef6-43b8-aa1f-4eca1f34948e admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:03.058463 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1101/2202] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:45:02 2022] POST /identity/v3/projects => generated 403 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:45:03.064805 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1102/2203] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:45:03 2022] PUT /identity/v3/projects/68fa2a11cb7f4fa6b31a65e60479ee3c/users/2f95291e6fd24393bcae5b0526cd9580/roles/702e5e78b5d744529384b96a390ae92f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:45:03.065720 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064c1ada-682c-44a6-9afd-ccae220e91e3 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:03.074631 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f05da-113c-4b6a-8c14-b35a3fc6cc0a None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:03.074923 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f05da-113c-4b6a-8c14-b35a3fc6cc0a None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:03.075205 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f05da-113c-4b6a-8c14-b35a3fc6cc0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:03.104125 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-fb4f05da-113c-4b6a-8c14-b35a3fc6cc0a None None] MFA Rules not processed for user `2f95291e6fd24393bcae5b0526cd9580`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:45:03.105476 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-fb4f05da-113c-4b6a-8c14-b35a3fc6cc0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:03.131870 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064c1ada-682c-44a6-9afd-ccae220e91e3 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:03.191255 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1103/2204] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:45:03 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:45:03.198896 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd4ff57-4fc2-4c95-ad7a-624df7684b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:03.199619 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4ff57-4fc2-4c95-ad7a-624df7684b0c admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:03.199915 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4ff57-4fc2-4c95-ad7a-624df7684b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:03.200200 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4ff57-4fc2-4c95-ad7a-624df7684b0c admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:03.200962 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd4ff57-4fc2-4c95-ad7a-624df7684b0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:03.210353 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4f05da-113c-4b6a-8c14-b35a3fc6cc0a None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:03.210466 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd4ff57-4fc2-4c95-ad7a-624df7684b0c admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:03.210555 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-fb4f05da-113c-4b6a-8c14-b35a3fc6cc0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:03.260235 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4f05da-113c-4b6a-8c14-b35a3fc6cc0a None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:03.263861 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bbd751-6c7b-4876-aa11-1ff6a63d5a1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '950b5b5f690d41509ead753065a0b793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:03.264904 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bbd751-6c7b-4876-aa11-1ff6a63d5a1f service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:03.264904 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bbd751-6c7b-4876-aa11-1ff6a63d5a1f service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:03.265057 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bbd751-6c7b-4876-aa11-1ff6a63d5a1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:03.275421 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bbd751-6c7b-4876-aa11-1ff6a63d5a1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:03.276342 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bbd751-6c7b-4876-aa11-1ff6a63d5a1f service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:03.286143 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1104/2205] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:45:03 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:45:03.319473 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1102/2206] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:45:03 2022] POST /identity/v3/users => generated 308 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:45:03.321725 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bbd751-6c7b-4876-aa11-1ff6a63d5a1f service cinder] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:03.332940 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bbd751-6c7b-4876-aa11-1ff6a63d5a1f service cinder] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:03.338099 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d134748b-5555-4286-8a98-1a733c87d596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:03.341877 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d134748b-5555-4286-8a98-1a733c87d596 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:03.341877 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d134748b-5555-4286-8a98-1a733c87d596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:03.341877 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d134748b-5555-4286-8a98-1a733c87d596 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:03.341877 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d134748b-5555-4286-8a98-1a733c87d596 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:03.341877 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d134748b-5555-4286-8a98-1a733c87d596 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:03.353286 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1105/2207] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:45:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:45:03.357417 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd4ff57-4fc2-4c95-ad7a-624df7684b0c admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:03.368579 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd4ff57-4fc2-4c95-ad7a-624df7684b0c admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:03.373780 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300470f6-a07c-45dc-9909-3669a0890af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:03.374705 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300470f6-a07c-45dc-9909-3669a0890af3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:03.374995 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300470f6-a07c-45dc-9909-3669a0890af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:03.375273 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300470f6-a07c-45dc-9909-3669a0890af3 admin admin] PATH_INFO: `/v3/projects/8382b9130e434918ba658d83d58b4036/users/7c6c1c2e45c04b438ff2df7704de7756/roles/702e5e78b5d744529384b96a390ae92f` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:03.388777 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d134748b-5555-4286-8a98-1a733c87d596 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:03.390582 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-d134748b-5555-4286-8a98-1a733c87d596 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:03.392296 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300470f6-a07c-45dc-9909-3669a0890af3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8382b9130e434918ba658d83d58b4036, user_id=7c6c1c2e45c04b438ff2df7704de7756, role_id=702e5e78b5d744529384b96a390ae92f)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:03.395098 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300470f6-a07c-45dc-9909-3669a0890af3 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:03.403294 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d134748b-5555-4286-8a98-1a733c87d596 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:03.407193 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a8eaa-3173-4207-8ad9-bbda338774cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '950b5b5f690d41509ead753065a0b793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:03.407889 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a8eaa-3173-4207-8ad9-bbda338774cb service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:03.408170 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a8eaa-3173-4207-8ad9-bbda338774cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:03.409174 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a8eaa-3173-4207-8ad9-bbda338774cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:03.465969 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1a8eaa-3173-4207-8ad9-bbda338774cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:03.467401 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1a8eaa-3173-4207-8ad9-bbda338774cb service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:03.477700 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1106/2208] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:45:03 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 16:45:03.491639 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1103/2209] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:45:03 2022] PUT /identity/v3/projects/8382b9130e434918ba658d83d58b4036/users/7c6c1c2e45c04b438ff2df7704de7756/roles/702e5e78b5d744529384b96a390ae92f => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:45:03.496495 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a8eaa-3173-4207-8ad9-bbda338774cb service cinder] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:03.513917 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a8eaa-3173-4207-8ad9-bbda338774cb service cinder] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:03.569994 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8122add6-67c1-49da-ac71-9394ef62792e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:03.570675 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122add6-67c1-49da-ac71-9394ef62792e admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:03.570957 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122add6-67c1-49da-ac71-9394ef62792e admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:03.571231 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122add6-67c1-49da-ac71-9394ef62792e admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:03.572002 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8122add6-67c1-49da-ac71-9394ef62792e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:03.573596 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8122add6-67c1-49da-ac71-9394ef62792e admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:03.590465 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1107/2210] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:45:03 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:45:03.590652 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300470f6-a07c-45dc-9909-3669a0890af3 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:03.602456 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300470f6-a07c-45dc-9909-3669a0890af3 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:03.607546 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6007fc-ef92-4041-b18e-b7f366bb0f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:03.608443 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6007fc-ef92-4041-b18e-b7f366bb0f8f admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:03.608724 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6007fc-ef92-4041-b18e-b7f366bb0f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:03.609100 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6007fc-ef92-4041-b18e-b7f366bb0f8f admin admin] PATH_INFO: `/v3/projects/8382b9130e434918ba658d83d58b4036/users/7c6c1c2e45c04b438ff2df7704de7756/roles/702e5e78b5d744529384b96a390ae92f` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:03.610999 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6007fc-ef92-4041-b18e-b7f366bb0f8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8382b9130e434918ba658d83d58b4036, user_id=7c6c1c2e45c04b438ff2df7704de7756, role_id=702e5e78b5d744529384b96a390ae92f)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:03.614355 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6007fc-ef92-4041-b18e-b7f366bb0f8f admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:03.626841 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1104/2211] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:45:03 2022] PUT /identity/v3/projects/8382b9130e434918ba658d83d58b4036/users/7c6c1c2e45c04b438ff2df7704de7756/roles/702e5e78b5d744529384b96a390ae92f => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:45:05.555930 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93055e99-7847-49b4-9599-05fe0cd756fc None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:05.556598 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93055e99-7847-49b4-9599-05fe0cd756fc None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:05.556598 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93055e99-7847-49b4-9599-05fe0cd756fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:05.588778 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-93055e99-7847-49b4-9599-05fe0cd756fc None None] MFA Rules not processed for user `7c6c1c2e45c04b438ff2df7704de7756`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:45:05.590114 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-93055e99-7847-49b4-9599-05fe0cd756fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:05.676218 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1108/2212] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:45:05 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:45:05.686206 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6007fc-ef92-4041-b18e-b7f366bb0f8f admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:05.764901 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6007fc-ef92-4041-b18e-b7f366bb0f8f admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:05.774857 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1534ede3-07db-4a9f-af99-bb3deba35067 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '950b5b5f690d41509ead753065a0b793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:05.776289 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534ede3-07db-4a9f-af99-bb3deba35067 service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:05.776794 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534ede3-07db-4a9f-af99-bb3deba35067 service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:05.777147 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534ede3-07db-4a9f-af99-bb3deba35067 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:05.779503 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-1534ede3-07db-4a9f-af99-bb3deba35067 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:05.842733 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1534ede3-07db-4a9f-af99-bb3deba35067 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:05.845188 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1534ede3-07db-4a9f-af99-bb3deba35067 service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:05.857308 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1105/2213] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:45:05 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:45:07.312121 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93055e99-7847-49b4-9599-05fe0cd756fc None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:07.397936 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93055e99-7847-49b4-9599-05fe0cd756fc None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:07.403855 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b4d530-0f46-47c1-9c91-861d02c852ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:07.404756 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b4d530-0f46-47c1-9c91-861d02c852ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:07.405179 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b4d530-0f46-47c1-9c91-861d02c852ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:07.405530 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b4d530-0f46-47c1-9c91-861d02c852ef admin admin] PATH_INFO: `/v3/users/500b3718339b4ac8b63d5777d5ce39e0` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:07.406844 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b4d530-0f46-47c1-9c91-861d02c852ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=500b3718339b4ac8b63d5777d5ce39e0)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:07.408917 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b4d530-0f46-47c1-9c91-861d02c852ef admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:07.630569 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-b3b4d530-0f46-47c1-9c91-861d02c852ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '500b3718339b4ac8b63d5777d5ce39e0'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:07.631943 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-b3b4d530-0f46-47c1-9c91-861d02c852ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '500b3718339b4ac8b63d5777d5ce39e0'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:07.698445 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-b3b4d530-0f46-47c1-9c91-861d02c852ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '500b3718339b4ac8b63d5777d5ce39e0'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:07.710676 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-b3b4d530-0f46-47c1-9c91-861d02c852ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '500b3718339b4ac8b63d5777d5ce39e0'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:07.728667 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-b3b4d530-0f46-47c1-9c91-861d02c852ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '500b3718339b4ac8b63d5777d5ce39e0'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:07.744823 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1109/2214] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:45:07 2022] DELETE /identity/v3/users/500b3718339b4ac8b63d5777d5ce39e0 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:45:07.791186 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1534ede3-07db-4a9f-af99-bb3deba35067 service cinder] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:07.801092 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1534ede3-07db-4a9f-af99-bb3deba35067 service cinder] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:07.881405 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52560d68-4b89-4624-8fa1-3735a6d5087f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '950b5b5f690d41509ead753065a0b793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:07.882072 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52560d68-4b89-4624-8fa1-3735a6d5087f service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:07.882546 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52560d68-4b89-4624-8fa1-3735a6d5087f service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:07.882826 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52560d68-4b89-4624-8fa1-3735a6d5087f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:07.884779 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-52560d68-4b89-4624-8fa1-3735a6d5087f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:07.964622 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52560d68-4b89-4624-8fa1-3735a6d5087f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:07.966085 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52560d68-4b89-4624-8fa1-3735a6d5087f service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:07.977211 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1106/2215] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:45:07 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:45:08.109949 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b4d530-0f46-47c1-9c91-861d02c852ef admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:08.112006 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b3b4d530-0f46-47c1-9c91-861d02c852ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:08.193669 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b4d530-0f46-47c1-9c91-861d02c852ef admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:08.198347 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e96395-51d7-4d67-b555-1703ee24b8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:08.199225 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e96395-51d7-4d67-b555-1703ee24b8f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:08.199505 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e96395-51d7-4d67-b555-1703ee24b8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:08.199805 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e96395-51d7-4d67-b555-1703ee24b8f5 admin admin] PATH_INFO: `/v3/projects/b1e3b98ea2084d5cbd85aac888e11f63` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:08.201008 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e96395-51d7-4d67-b555-1703ee24b8f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1e3b98ea2084d5cbd85aac888e11f63)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:08.202923 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e96395-51d7-4d67-b555-1703ee24b8f5 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:08.359872 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-06e96395-51d7-4d67-b555-1703ee24b8f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1e3b98ea2084d5cbd85aac888e11f63', 'request_id': 'req-06e96395-51d7-4d67-b555-1703ee24b8f5'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:08.366125 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-06e96395-51d7-4d67-b555-1703ee24b8f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1e3b98ea2084d5cbd85aac888e11f63', 'request_id': 'req-06e96395-51d7-4d67-b555-1703ee24b8f5'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:08.484819 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-06e96395-51d7-4d67-b555-1703ee24b8f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1e3b98ea2084d5cbd85aac888e11f63', 'request_id': 'req-06e96395-51d7-4d67-b555-1703ee24b8f5'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:08.496934 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-06e96395-51d7-4d67-b555-1703ee24b8f5 admin admin] The token cache is being invalidate because project b1e3b98ea2084d5cbd85aac888e11f63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:45:08.497224 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-06e96395-51d7-4d67-b555-1703ee24b8f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:08.497862 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-06e96395-51d7-4d67-b555-1703ee24b8f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:08.499420 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1110/2216] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:45:08 2022] DELETE /identity/v3/projects/b1e3b98ea2084d5cbd85aac888e11f63 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:45:08.504276 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52560d68-4b89-4624-8fa1-3735a6d5087f service cinder] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:08.514731 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52560d68-4b89-4624-8fa1-3735a6d5087f service cinder] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:08.576475 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece0130e-5001-4f24-9ce6-94500548794c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:08.577446 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0130e-5001-4f24-9ce6-94500548794c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:08.577735 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0130e-5001-4f24-9ce6-94500548794c admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:08.578028 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0130e-5001-4f24-9ce6-94500548794c admin admin] PATH_INFO: `/v3/users/7c6c1c2e45c04b438ff2df7704de7756` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:08.579390 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece0130e-5001-4f24-9ce6-94500548794c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c6c1c2e45c04b438ff2df7704de7756)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:08.581744 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece0130e-5001-4f24-9ce6-94500548794c admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:09.001259 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-ece0130e-5001-4f24-9ce6-94500548794c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c6c1c2e45c04b438ff2df7704de7756'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:09.058433 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e96395-51d7-4d67-b555-1703ee24b8f5 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:09.061512 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-06e96395-51d7-4d67-b555-1703ee24b8f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:09.073591 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e96395-51d7-4d67-b555-1703ee24b8f5 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:09.080601 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17b7087-917a-4450-af0b-4206ffba36d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:09.081509 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b7087-917a-4450-af0b-4206ffba36d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:09.081799 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b7087-917a-4450-af0b-4206ffba36d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:09.082093 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b7087-917a-4450-af0b-4206ffba36d6 admin admin] PATH_INFO: `/v3/users/4b5ee4bf4b2a4133928c55a6b695009c` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:09.083555 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17b7087-917a-4450-af0b-4206ffba36d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b5ee4bf4b2a4133928c55a6b695009c)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:09.085557 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17b7087-917a-4450-af0b-4206ffba36d6 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:09.107398 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-ece0130e-5001-4f24-9ce6-94500548794c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c6c1c2e45c04b438ff2df7704de7756'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:09.117411 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-ece0130e-5001-4f24-9ce6-94500548794c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c6c1c2e45c04b438ff2df7704de7756'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:09.118162 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-ece0130e-5001-4f24-9ce6-94500548794c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c6c1c2e45c04b438ff2df7704de7756'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:09.131757 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-ece0130e-5001-4f24-9ce6-94500548794c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c6c1c2e45c04b438ff2df7704de7756'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:09.136777 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1107/2217] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:45:08 2022] DELETE /identity/v3/users/7c6c1c2e45c04b438ff2df7704de7756 => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:45:09.376776 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a17b7087-917a-4450-af0b-4206ffba36d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b5ee4bf4b2a4133928c55a6b695009c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:09.378498 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a17b7087-917a-4450-af0b-4206ffba36d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b5ee4bf4b2a4133928c55a6b695009c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:09.481881 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece0130e-5001-4f24-9ce6-94500548794c admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:09.481881 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-ece0130e-5001-4f24-9ce6-94500548794c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:09.500098 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a17b7087-917a-4450-af0b-4206ffba36d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b5ee4bf4b2a4133928c55a6b695009c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:09.510207 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a17b7087-917a-4450-af0b-4206ffba36d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b5ee4bf4b2a4133928c55a6b695009c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:09.528053 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a17b7087-917a-4450-af0b-4206ffba36d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b5ee4bf4b2a4133928c55a6b695009c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:09.537180 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1111/2218] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:45:09 2022] DELETE /identity/v3/users/4b5ee4bf4b2a4133928c55a6b695009c => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:45:09.541956 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd95426-46fc-4c9c-b23c-319f5a6356ec None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:09.542331 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd95426-46fc-4c9c-b23c-319f5a6356ec None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:09.542621 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd95426-46fc-4c9c-b23c-319f5a6356ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:09.567381 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-2cd95426-46fc-4c9c-b23c-319f5a6356ec None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:45:09.567381 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-2cd95426-46fc-4c9c-b23c-319f5a6356ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:09.599332 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece0130e-5001-4f24-9ce6-94500548794c admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:09.655420 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1112/2219] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:45:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:45:09.663345 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9047eb6c-4081-47c2-aebb-09f37e8eeeba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:09.664264 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047eb6c-4081-47c2-aebb-09f37e8eeeba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:09.664610 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047eb6c-4081-47c2-aebb-09f37e8eeeba admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:09.664829 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047eb6c-4081-47c2-aebb-09f37e8eeeba admin admin] PATH_INFO: `/v3/projects/8382b9130e434918ba658d83d58b4036` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:09.666035 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9047eb6c-4081-47c2-aebb-09f37e8eeeba admin admin] RBAC: Authorizing `identity:delete_project(project_id=8382b9130e434918ba658d83d58b4036)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:09.667987 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9047eb6c-4081-47c2-aebb-09f37e8eeeba admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:09.671054 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd95426-46fc-4c9c-b23c-319f5a6356ec None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:09.672437 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-2cd95426-46fc-4c9c-b23c-319f5a6356ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:09.746607 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd95426-46fc-4c9c-b23c-319f5a6356ec None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:09.750989 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d7cab1-d633-4b2d-a366-dcb6e37ec385 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:09.751704 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d7cab1-d633-4b2d-a366-dcb6e37ec385 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:09.752319 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d7cab1-d633-4b2d-a366-dcb6e37ec385 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:09.752605 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d7cab1-d633-4b2d-a366-dcb6e37ec385 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:09.763652 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d7cab1-d633-4b2d-a366-dcb6e37ec385 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:09.768314 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d7cab1-d633-4b2d-a366-dcb6e37ec385 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:09.777252 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1113/2220] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:45:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 16:45:09.866970 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-9047eb6c-4081-47c2-aebb-09f37e8eeeba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8382b9130e434918ba658d83d58b4036', 'request_id': 'req-9047eb6c-4081-47c2-aebb-09f37e8eeeba'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:09.963180 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-9047eb6c-4081-47c2-aebb-09f37e8eeeba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8382b9130e434918ba658d83d58b4036', 'request_id': 'req-9047eb6c-4081-47c2-aebb-09f37e8eeeba'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:09.969085 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-9047eb6c-4081-47c2-aebb-09f37e8eeeba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8382b9130e434918ba658d83d58b4036', 'request_id': 'req-9047eb6c-4081-47c2-aebb-09f37e8eeeba'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:09.980531 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-9047eb6c-4081-47c2-aebb-09f37e8eeeba admin admin] The token cache is being invalidate because project 8382b9130e434918ba658d83d58b4036 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:45:09.980820 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-9047eb6c-4081-47c2-aebb-09f37e8eeeba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:09.981487 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-9047eb6c-4081-47c2-aebb-09f37e8eeeba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:09.983036 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1108/2221] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:45:09 2022] DELETE /identity/v3/projects/8382b9130e434918ba658d83d58b4036 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:45:09.988580 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95580c58-222b-4c22-bd0d-4b7b4f63c856 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:09.989502 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95580c58-222b-4c22-bd0d-4b7b4f63c856 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:09.989502 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95580c58-222b-4c22-bd0d-4b7b4f63c856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:10.023837 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-95580c58-222b-4c22-bd0d-4b7b4f63c856 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:45:10.025317 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-95580c58-222b-4c22-bd0d-4b7b4f63c856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:10.090763 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1114/2222] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:45:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:45:10.098541 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd7d8f-e3ec-430d-96d1-d767e69329d4 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:10.099009 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd7d8f-e3ec-430d-96d1-d767e69329d4 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:10.099222 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd7d8f-e3ec-430d-96d1-d767e69329d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:10.122631 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-78dd7d8f-e3ec-430d-96d1-d767e69329d4 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:45:10.123953 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-78dd7d8f-e3ec-430d-96d1-d767e69329d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:10.148317 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1109/2223] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:45:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:45:10.158692 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95580c58-222b-4c22-bd0d-4b7b4f63c856 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:10.172249 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95580c58-222b-4c22-bd0d-4b7b4f63c856 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:10.184922 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660a5ecf-7a83-453d-9eb2-7a428dc4d3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:10.185792 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a5ecf-7a83-453d-9eb2-7a428dc4d3ad admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:10.186080 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a5ecf-7a83-453d-9eb2-7a428dc4d3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:10.186361 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a5ecf-7a83-453d-9eb2-7a428dc4d3ad admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:10.187099 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660a5ecf-7a83-453d-9eb2-7a428dc4d3ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:45:10.187553 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660a5ecf-7a83-453d-9eb2-7a428dc4d3ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:10.189103 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660a5ecf-7a83-453d-9eb2-7a428dc4d3ad admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:10.215172 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1115/2224] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Apr 11 16:45:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:45:10.216071 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dd7d8f-e3ec-430d-96d1-d767e69329d4 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:10.232340 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dd7d8f-e3ec-430d-96d1-d767e69329d4 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:10.238337 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf5cb4a-bf63-4224-9705-c4e17fab2ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:10.239025 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5cb4a-bf63-4224-9705-c4e17fab2ec6 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:10.239319 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5cb4a-bf63-4224-9705-c4e17fab2ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:10.239609 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5cb4a-bf63-4224-9705-c4e17fab2ec6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:10.240333 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf5cb4a-bf63-4224-9705-c4e17fab2ec6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:10.242257 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf5cb4a-bf63-4224-9705-c4e17fab2ec6 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:10.289941 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660a5ecf-7a83-453d-9eb2-7a428dc4d3ad admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:10.291788 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-660a5ecf-7a83-453d-9eb2-7a428dc4d3ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:10.307150 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660a5ecf-7a83-453d-9eb2-7a428dc4d3ad admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:10.312485 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ce65f4-5acd-43a3-b599-a701870ada71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:10.313372 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce65f4-5acd-43a3-b599-a701870ada71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:10.313653 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce65f4-5acd-43a3-b599-a701870ada71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:10.313929 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce65f4-5acd-43a3-b599-a701870ada71 admin admin] PATH_INFO: `/v3/projects/4a506c89da704221bc2451b8c69ee731` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:10.315912 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ce65f4-5acd-43a3-b599-a701870ada71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a506c89da704221bc2451b8c69ee731)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:10.317858 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ce65f4-5acd-43a3-b599-a701870ada71 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:10.360834 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1110/2225] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:45:10 2022] POST /identity/v3/projects => generated 377 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:45:10.362230 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf5cb4a-bf63-4224-9705-c4e17fab2ec6 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:10.363827 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-4bf5cb4a-bf63-4224-9705-c4e17fab2ec6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:10.430327 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf5cb4a-bf63-4224-9705-c4e17fab2ec6 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:10.435323 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77efb861-bcc2-4b41-bd89-48b92ddbdad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:10.436245 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77efb861-bcc2-4b41-bd89-48b92ddbdad5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:10.436526 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77efb861-bcc2-4b41-bd89-48b92ddbdad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:10.436805 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77efb861-bcc2-4b41-bd89-48b92ddbdad5 admin admin] PATH_INFO: `/v3/users/ce8c28566d3e42fa92fc528eee6aa23d` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:10.438089 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77efb861-bcc2-4b41-bd89-48b92ddbdad5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce8c28566d3e42fa92fc528eee6aa23d)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:10.440853 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77efb861-bcc2-4b41-bd89-48b92ddbdad5 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:10.490873 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-49ce65f4-5acd-43a3-b599-a701870ada71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a506c89da704221bc2451b8c69ee731', 'request_id': 'req-49ce65f4-5acd-43a3-b599-a701870ada71'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:10.496542 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-49ce65f4-5acd-43a3-b599-a701870ada71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a506c89da704221bc2451b8c69ee731', 'request_id': 'req-49ce65f4-5acd-43a3-b599-a701870ada71'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:10.575979 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-49ce65f4-5acd-43a3-b599-a701870ada71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a506c89da704221bc2451b8c69ee731', 'request_id': 'req-49ce65f4-5acd-43a3-b599-a701870ada71'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:10.588483 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-49ce65f4-5acd-43a3-b599-a701870ada71 admin admin] The token cache is being invalidate because project 4a506c89da704221bc2451b8c69ee731 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:45:10.588774 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-49ce65f4-5acd-43a3-b599-a701870ada71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:10.589442 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-49ce65f4-5acd-43a3-b599-a701870ada71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:10.591059 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1116/2226] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:45:10 2022] DELETE /identity/v3/projects/4a506c89da704221bc2451b8c69ee731 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:45:10.594112 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ce65f4-5acd-43a3-b599-a701870ada71 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:10.594112 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-49ce65f4-5acd-43a3-b599-a701870ada71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:10.637084 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-77efb861-bcc2-4b41-bd89-48b92ddbdad5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce8c28566d3e42fa92fc528eee6aa23d'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:10.666733 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ce65f4-5acd-43a3-b599-a701870ada71 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:10.671662 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfb627f-169c-45bb-8034-902cb1b0da17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:10.672489 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb627f-169c-45bb-8034-902cb1b0da17 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:10.672787 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb627f-169c-45bb-8034-902cb1b0da17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:10.673067 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb627f-169c-45bb-8034-902cb1b0da17 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:10.673939 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfb627f-169c-45bb-8034-902cb1b0da17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:10.676597 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfb627f-169c-45bb-8034-902cb1b0da17 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:10.711641 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-77efb861-bcc2-4b41-bd89-48b92ddbdad5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce8c28566d3e42fa92fc528eee6aa23d'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:10.719126 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-77efb861-bcc2-4b41-bd89-48b92ddbdad5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce8c28566d3e42fa92fc528eee6aa23d'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:10.719830 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-77efb861-bcc2-4b41-bd89-48b92ddbdad5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce8c28566d3e42fa92fc528eee6aa23d'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:10.732376 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-77efb861-bcc2-4b41-bd89-48b92ddbdad5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce8c28566d3e42fa92fc528eee6aa23d'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:10.739468 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1111/2227] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:45:10 2022] DELETE /identity/v3/users/ce8c28566d3e42fa92fc528eee6aa23d => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:45:10.743381 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77efb861-bcc2-4b41-bd89-48b92ddbdad5 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:10.745144 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-77efb861-bcc2-4b41-bd89-48b92ddbdad5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:10.811962 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1117/2228] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:45:10 2022] POST /identity/v3/users => generated 289 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:45:10.812179 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77efb861-bcc2-4b41-bd89-48b92ddbdad5 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:10.812286 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224e830-8b17-4d92-a52f-65ba5edf294a None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:10.812286 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224e830-8b17-4d92-a52f-65ba5edf294a None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:10.812286 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224e830-8b17-4d92-a52f-65ba5edf294a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:10.815954 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e91b08-1c26-4b0d-9a58-8b5bb2fa1720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:10.816845 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e91b08-1c26-4b0d-9a58-8b5bb2fa1720 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:10.817130 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e91b08-1c26-4b0d-9a58-8b5bb2fa1720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:10.817409 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e91b08-1c26-4b0d-9a58-8b5bb2fa1720 admin admin] PATH_INFO: `/v3/users/2f95291e6fd24393bcae5b0526cd9580` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:10.818924 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e91b08-1c26-4b0d-9a58-8b5bb2fa1720 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f95291e6fd24393bcae5b0526cd9580)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:10.820909 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e91b08-1c26-4b0d-9a58-8b5bb2fa1720 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:10.832039 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-3224e830-8b17-4d92-a52f-65ba5edf294a None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:45:10.833280 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-3224e830-8b17-4d92-a52f-65ba5edf294a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:10.841675 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1118/2229] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:45:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:45:10.842548 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3224e830-8b17-4d92-a52f-65ba5edf294a None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:10.843824 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-3224e830-8b17-4d92-a52f-65ba5edf294a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:10.856382 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3224e830-8b17-4d92-a52f-65ba5edf294a None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:10.861283 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7748c34-f8a8-45c4-bc98-ae7c78f3e3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:10.861991 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7748c34-f8a8-45c4-bc98-ae7c78f3e3b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:10.862277 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7748c34-f8a8-45c4-bc98-ae7c78f3e3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:10.862552 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7748c34-f8a8-45c4-bc98-ae7c78f3e3b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:10.863303 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7748c34-f8a8-45c4-bc98-ae7c78f3e3b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:10.865004 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7748c34-f8a8-45c4-bc98-ae7c78f3e3b1 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:10.875508 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1119/2230] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:45:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:45:10.876316 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7748c34-f8a8-45c4-bc98-ae7c78f3e3b1 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:10.878579 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b7748c34-f8a8-45c4-bc98-ae7c78f3e3b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:10.936482 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7748c34-f8a8-45c4-bc98-ae7c78f3e3b1 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:10.941187 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508b1c98-03c1-4fba-868a-48528aff5f75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:10.941886 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b1c98-03c1-4fba-868a-48528aff5f75 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:10.942171 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b1c98-03c1-4fba-868a-48528aff5f75 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:10.942454 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b1c98-03c1-4fba-868a-48528aff5f75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:10.952392 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508b1c98-03c1-4fba-868a-48528aff5f75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:10.953872 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508b1c98-03c1-4fba-868a-48528aff5f75 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:10.964125 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1120/2231] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:45:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:45:10.964990 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508b1c98-03c1-4fba-868a-48528aff5f75 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:10.974391 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508b1c98-03c1-4fba-868a-48528aff5f75 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:10.981707 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7694f7be-ac88-49ae-aba0-6bbbfe8f0fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:10.981707 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7694f7be-ac88-49ae-aba0-6bbbfe8f0fa5 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:10.981707 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7694f7be-ac88-49ae-aba0-6bbbfe8f0fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:10.981707 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7694f7be-ac88-49ae-aba0-6bbbfe8f0fa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:10.982100 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7694f7be-ac88-49ae-aba0-6bbbfe8f0fa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:10.982748 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7694f7be-ac88-49ae-aba0-6bbbfe8f0fa5 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:10.994019 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1121/2232] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:45:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:45:10.997825 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7694f7be-ac88-49ae-aba0-6bbbfe8f0fa5 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:11.012203 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7694f7be-ac88-49ae-aba0-6bbbfe8f0fa5 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:11.017191 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c23c8-2d25-4d2c-bf01-ef0d805e80d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:11.018132 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c23c8-2d25-4d2c-bf01-ef0d805e80d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:11.018413 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c23c8-2d25-4d2c-bf01-ef0d805e80d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:11.018686 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c23c8-2d25-4d2c-bf01-ef0d805e80d0 admin admin] PATH_INFO: `/v3/projects/f82514ef05df44a6a0e3f5afb4fd3c22/users/891f682cfa5d49aca7ef7864a0fca2e5/roles/0d41da7bec094450b5bff4e4831be52c` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:11.024766 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-58e91b08-1c26-4b0d-9a58-8b5bb2fa1720 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f95291e6fd24393bcae5b0526cd9580'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:11.035418 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005c23c8-2d25-4d2c-bf01-ef0d805e80d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f82514ef05df44a6a0e3f5afb4fd3c22, user_id=891f682cfa5d49aca7ef7864a0fca2e5, role_id=0d41da7bec094450b5bff4e4831be52c)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:11.038243 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005c23c8-2d25-4d2c-bf01-ef0d805e80d0 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:11.117290 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-58e91b08-1c26-4b0d-9a58-8b5bb2fa1720 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f95291e6fd24393bcae5b0526cd9580'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:11.124757 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-58e91b08-1c26-4b0d-9a58-8b5bb2fa1720 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f95291e6fd24393bcae5b0526cd9580'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:11.125436 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-58e91b08-1c26-4b0d-9a58-8b5bb2fa1720 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f95291e6fd24393bcae5b0526cd9580'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:11.138749 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-58e91b08-1c26-4b0d-9a58-8b5bb2fa1720 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f95291e6fd24393bcae5b0526cd9580'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:11.145149 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1112/2233] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:45:10 2022] DELETE /identity/v3/users/2f95291e6fd24393bcae5b0526cd9580 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:45:11.157728 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1122/2234] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:45:10 2022] PUT /identity/v3/projects/f82514ef05df44a6a0e3f5afb4fd3c22/users/891f682cfa5d49aca7ef7864a0fca2e5/roles/0d41da7bec094450b5bff4e4831be52c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:45:11.172382 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee7277-56e2-461b-9bcd-1ca5cc65e46f None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:11.172675 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee7277-56e2-461b-9bcd-1ca5cc65e46f None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:11.172959 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee7277-56e2-461b-9bcd-1ca5cc65e46f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:11.202730 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-c7ee7277-56e2-461b-9bcd-1ca5cc65e46f None None] MFA Rules not processed for user `891f682cfa5d49aca7ef7864a0fca2e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:45:11.204187 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-c7ee7277-56e2-461b-9bcd-1ca5cc65e46f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:11.284027 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1113/2235] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:45:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:45:11.288890 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c23c8-2d25-4d2c-bf01-ef0d805e80d0 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:11.291456 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-005c23c8-2d25-4d2c-bf01-ef0d805e80d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:11.370590 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c23c8-2d25-4d2c-bf01-ef0d805e80d0 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:11.375429 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5df1c99-d378-4ad4-be6c-2cff5c8ff2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:11.376270 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df1c99-d378-4ad4-be6c-2cff5c8ff2c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:11.376546 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df1c99-d378-4ad4-be6c-2cff5c8ff2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:11.376839 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df1c99-d378-4ad4-be6c-2cff5c8ff2c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:11.377728 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5df1c99-d378-4ad4-be6c-2cff5c8ff2c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:11.379715 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5df1c99-d378-4ad4-be6c-2cff5c8ff2c1 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:11.515981 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1123/2236] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:45:11 2022] POST /identity/v3/projects => generated 377 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:45:11.516942 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ee7277-56e2-461b-9bcd-1ca5cc65e46f None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:11.519729 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-c7ee7277-56e2-461b-9bcd-1ca5cc65e46f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:11.525718 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5df1c99-d378-4ad4-be6c-2cff5c8ff2c1 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:11.550019 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ee7277-56e2-461b-9bcd-1ca5cc65e46f None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:11.620667 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5df1c99-d378-4ad4-be6c-2cff5c8ff2c1 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:11.625659 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a1450-3c88-44e7-b05a-2afe17101509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:11.626312 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a1450-3c88-44e7-b05a-2afe17101509 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:11.626604 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a1450-3c88-44e7-b05a-2afe17101509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:11.626897 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a1450-3c88-44e7-b05a-2afe17101509 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:11.627677 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734a1450-3c88-44e7-b05a-2afe17101509 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:11.629602 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734a1450-3c88-44e7-b05a-2afe17101509 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:11.634187 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc07855-4f57-4aa0-a57c-24f67019678d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:11.635114 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc07855-4f57-4aa0-a57c-24f67019678d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:11.635442 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc07855-4f57-4aa0-a57c-24f67019678d admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:11.643189 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc07855-4f57-4aa0-a57c-24f67019678d admin admin] PATH_INFO: `/v3/projects/42394293407a4810b2d0ffe658e5084b` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:11.643189 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc07855-4f57-4aa0-a57c-24f67019678d admin admin] RBAC: Authorizing `identity:delete_project(project_id=42394293407a4810b2d0ffe658e5084b)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:11.643189 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc07855-4f57-4aa0-a57c-24f67019678d admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:11.729945 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1124/2237] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:45:11 2022] POST /identity/v3/users => generated 295 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:45:11.730825 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a1450-3c88-44e7-b05a-2afe17101509 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:11.732684 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-734a1450-3c88-44e7-b05a-2afe17101509 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:11.745771 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a1450-3c88-44e7-b05a-2afe17101509 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:11.753166 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bc1fac-722b-4216-832c-dfb79920af51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:11.754129 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc1fac-722b-4216-832c-dfb79920af51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:11.754415 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc1fac-722b-4216-832c-dfb79920af51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:11.754697 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc1fac-722b-4216-832c-dfb79920af51 admin admin] PATH_INFO: `/v3/projects/68fa2a11cb7f4fa6b31a65e60479ee3c` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:11.756072 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bc1fac-722b-4216-832c-dfb79920af51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68fa2a11cb7f4fa6b31a65e60479ee3c)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:11.758004 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bc1fac-722b-4216-832c-dfb79920af51 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:11.774837 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-cbc07855-4f57-4aa0-a57c-24f67019678d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42394293407a4810b2d0ffe658e5084b', 'request_id': 'req-cbc07855-4f57-4aa0-a57c-24f67019678d'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:11.879594 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-24bc1fac-722b-4216-832c-dfb79920af51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68fa2a11cb7f4fa6b31a65e60479ee3c', 'request_id': 'req-24bc1fac-722b-4216-832c-dfb79920af51'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:11.885936 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-24bc1fac-722b-4216-832c-dfb79920af51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68fa2a11cb7f4fa6b31a65e60479ee3c', 'request_id': 'req-24bc1fac-722b-4216-832c-dfb79920af51'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:11.907193 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-cbc07855-4f57-4aa0-a57c-24f67019678d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42394293407a4810b2d0ffe658e5084b', 'request_id': 'req-cbc07855-4f57-4aa0-a57c-24f67019678d'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:11.913190 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-cbc07855-4f57-4aa0-a57c-24f67019678d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42394293407a4810b2d0ffe658e5084b', 'request_id': 'req-cbc07855-4f57-4aa0-a57c-24f67019678d'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:11.929105 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-cbc07855-4f57-4aa0-a57c-24f67019678d admin admin] The token cache is being invalidate because project 42394293407a4810b2d0ffe658e5084b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:45:11.929406 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-cbc07855-4f57-4aa0-a57c-24f67019678d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:11.930096 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-cbc07855-4f57-4aa0-a57c-24f67019678d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:11.931747 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1114/2238] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:45:11 2022] DELETE /identity/v3/projects/42394293407a4810b2d0ffe658e5084b => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:45:11.932690 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc07855-4f57-4aa0-a57c-24f67019678d admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:11.940172 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-cbc07855-4f57-4aa0-a57c-24f67019678d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:11.993798 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-24bc1fac-722b-4216-832c-dfb79920af51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68fa2a11cb7f4fa6b31a65e60479ee3c', 'request_id': 'req-24bc1fac-722b-4216-832c-dfb79920af51'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:12.001690 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc07855-4f57-4aa0-a57c-24f67019678d admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:12.013940 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-24bc1fac-722b-4216-832c-dfb79920af51 admin admin] The token cache is being invalidate because project 68fa2a11cb7f4fa6b31a65e60479ee3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:45:12.014276 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-24bc1fac-722b-4216-832c-dfb79920af51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:12.014909 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-24bc1fac-722b-4216-832c-dfb79920af51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:12.016487 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1125/2239] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:45:11 2022] DELETE /identity/v3/projects/68fa2a11cb7f4fa6b31a65e60479ee3c => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:45:12.019962 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0925a497-30ff-4e31-9692-c5e44142414b None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:12.019962 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0925a497-30ff-4e31-9692-c5e44142414b None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:12.019962 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0925a497-30ff-4e31-9692-c5e44142414b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:12.038427 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-0925a497-30ff-4e31-9692-c5e44142414b None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:45:12.039605 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0925a497-30ff-4e31-9692-c5e44142414b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:12.061491 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf9722-4399-4b12-901d-73a32de42ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:12.062214 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf9722-4399-4b12-901d-73a32de42ff0 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:12.062501 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf9722-4399-4b12-901d-73a32de42ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:12.062782 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf9722-4399-4b12-901d-73a32de42ff0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:12.063504 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cf9722-4399-4b12-901d-73a32de42ff0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:12.065172 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cf9722-4399-4b12-901d-73a32de42ff0 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:12.075362 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1115/2240] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:45:11 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:45:12.077261 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe176ec1-9ccd-4ab5-93eb-6d5a32c6bff6 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:12.077715 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe176ec1-9ccd-4ab5-93eb-6d5a32c6bff6 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:12.078430 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe176ec1-9ccd-4ab5-93eb-6d5a32c6bff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:12.098868 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-fe176ec1-9ccd-4ab5-93eb-6d5a32c6bff6 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:45:12.099559 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1126/2241] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:45:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:45:12.101304 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-fe176ec1-9ccd-4ab5-93eb-6d5a32c6bff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:12.101421 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0925a497-30ff-4e31-9692-c5e44142414b None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:12.102291 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0925a497-30ff-4e31-9692-c5e44142414b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:12.109489 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1116/2242] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:45:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:45:12.110693 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc602b94-95e5-4120-b0ad-a7ff5a66659d None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:12.110915 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc602b94-95e5-4120-b0ad-a7ff5a66659d None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:12.111221 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc602b94-95e5-4120-b0ad-a7ff5a66659d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:12.114914 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0925a497-30ff-4e31-9692-c5e44142414b None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:12.120281 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d76ad-ae2b-4d46-a7b3-685add942f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:12.121203 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d76ad-ae2b-4d46-a7b3-685add942f65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:12.121538 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d76ad-ae2b-4d46-a7b3-685add942f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:12.121969 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d76ad-ae2b-4d46-a7b3-685add942f65 admin admin] PATH_INFO: `/v3/projects/6432f6a0733349d9a2c49ea5031c4e0c/users/ed792f79b7bf4da393b2210ef4b11799/roles/702e5e78b5d744529384b96a390ae92f` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:12.133327 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-dc602b94-95e5-4120-b0ad-a7ff5a66659d None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:45:12.134544 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-dc602b94-95e5-4120-b0ad-a7ff5a66659d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:12.139159 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86d76ad-ae2b-4d46-a7b3-685add942f65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6432f6a0733349d9a2c49ea5031c4e0c, user_id=ed792f79b7bf4da393b2210ef4b11799, role_id=702e5e78b5d744529384b96a390ae92f)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:12.142043 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86d76ad-ae2b-4d46-a7b3-685add942f65 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:12.142587 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1117/2243] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:45:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:45:12.145979 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b94ee-85a0-4b13-8b3c-1778607a6b5e None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:12.145979 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b94ee-85a0-4b13-8b3c-1778607a6b5e None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:12.145979 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b94ee-85a0-4b13-8b3c-1778607a6b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:12.162874 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-a55b94ee-85a0-4b13-8b3c-1778607a6b5e None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:45:12.164251 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-a55b94ee-85a0-4b13-8b3c-1778607a6b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:12.179244 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1118/2244] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:45:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:45:12.179244 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b94ee-85a0-4b13-8b3c-1778607a6b5e None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:12.187021 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b94ee-85a0-4b13-8b3c-1778607a6b5e None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:12.192684 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6564c716-cfa6-489c-8213-69512079a9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:12.193361 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564c716-cfa6-489c-8213-69512079a9c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:12.193639 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564c716-cfa6-489c-8213-69512079a9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:12.201965 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564c716-cfa6-489c-8213-69512079a9c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:12.201965 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6564c716-cfa6-489c-8213-69512079a9c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:45:12.201965 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6564c716-cfa6-489c-8213-69512079a9c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:12.201965 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6564c716-cfa6-489c-8213-69512079a9c7 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:12.210233 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1119/2245] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Apr 11 16:45:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:45:12.211171 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6564c716-cfa6-489c-8213-69512079a9c7 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:12.221189 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6564c716-cfa6-489c-8213-69512079a9c7 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:12.227905 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1127/2246] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:45:12 2022] PUT /identity/v3/projects/6432f6a0733349d9a2c49ea5031c4e0c/users/ed792f79b7bf4da393b2210ef4b11799/roles/702e5e78b5d744529384b96a390ae92f => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:45:12.230805 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d76ad-ae2b-4d46-a7b3-685add942f65 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:12.284302 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9173c8-9625-4e5f-a624-7d8a65418d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:12.284979 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9173c8-9625-4e5f-a624-7d8a65418d91 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:12.285267 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9173c8-9625-4e5f-a624-7d8a65418d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:12.285554 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9173c8-9625-4e5f-a624-7d8a65418d91 admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:12.286289 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9173c8-9625-4e5f-a624-7d8a65418d91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:45:12.286597 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9173c8-9625-4e5f-a624-7d8a65418d91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:12.288230 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9173c8-9625-4e5f-a624-7d8a65418d91 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:12.296986 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d76ad-ae2b-4d46-a7b3-685add942f65 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:12.302023 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1120/2247] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Apr 11 16:45:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:45:12.309592 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9173c8-9625-4e5f-a624-7d8a65418d91 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:12.309733 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077743cc-4e84-4724-946a-02dcc39388cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:12.309733 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077743cc-4e84-4724-946a-02dcc39388cd admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:12.309733 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077743cc-4e84-4724-946a-02dcc39388cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:12.309733 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077743cc-4e84-4724-946a-02dcc39388cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:12.310095 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077743cc-4e84-4724-946a-02dcc39388cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:12.310198 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077743cc-4e84-4724-946a-02dcc39388cd admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:12.316278 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9173c8-9625-4e5f-a624-7d8a65418d91 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:12.321554 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c2dc9c-8a8a-4bfa-abff-ee598cdb6251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:12.322241 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c2dc9c-8a8a-4bfa-abff-ee598cdb6251 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:12.322606 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c2dc9c-8a8a-4bfa-abff-ee598cdb6251 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:12.322888 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c2dc9c-8a8a-4bfa-abff-ee598cdb6251 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:12.323816 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c2dc9c-8a8a-4bfa-abff-ee598cdb6251 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:12.325455 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c2dc9c-8a8a-4bfa-abff-ee598cdb6251 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:12.338121 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1121/2248] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:45:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:45:12.345661 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c2dc9c-8a8a-4bfa-abff-ee598cdb6251 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:12.354767 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c2dc9c-8a8a-4bfa-abff-ee598cdb6251 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:12.360955 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35e1061-fad7-45f5-bb76-d9556751ae19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:12.361816 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e1061-fad7-45f5-bb76-d9556751ae19 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:12.362185 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e1061-fad7-45f5-bb76-d9556751ae19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:12.362616 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e1061-fad7-45f5-bb76-d9556751ae19 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:12.363392 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35e1061-fad7-45f5-bb76-d9556751ae19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:12.365515 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35e1061-fad7-45f5-bb76-d9556751ae19 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:12.412083 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1128/2249] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:45:12 2022] POST /identity/v3/projects => generated 385 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:45:12.412900 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077743cc-4e84-4724-946a-02dcc39388cd admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:12.475209 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077743cc-4e84-4724-946a-02dcc39388cd admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:12.479895 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c9340a-2456-497a-b0d7-e425604bbaac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:12.480780 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c9340a-2456-497a-b0d7-e425604bbaac admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:12.481062 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c9340a-2456-497a-b0d7-e425604bbaac admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:12.481338 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c9340a-2456-497a-b0d7-e425604bbaac admin admin] PATH_INFO: `/v3/projects/6432f6a0733349d9a2c49ea5031c4e0c/users/ed792f79b7bf4da393b2210ef4b11799/roles/702e5e78b5d744529384b96a390ae92f` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:12.483300 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c9340a-2456-497a-b0d7-e425604bbaac admin admin] RBAC: Authorizing `identity:create_grant(project_id=6432f6a0733349d9a2c49ea5031c4e0c, user_id=ed792f79b7bf4da393b2210ef4b11799, role_id=702e5e78b5d744529384b96a390ae92f)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:12.485944 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c9340a-2456-497a-b0d7-e425604bbaac admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:12.497126 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1129/2250] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:45:12 2022] PUT /identity/v3/projects/6432f6a0733349d9a2c49ea5031c4e0c/users/ed792f79b7bf4da393b2210ef4b11799/roles/702e5e78b5d744529384b96a390ae92f => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:45:12.497901 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c9340a-2456-497a-b0d7-e425604bbaac admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:12.509291 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1122/2251] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:45:12 2022] POST /identity/v3/projects => generated 407 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:45:12.511633 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41191c3a-ef1b-4fb2-80eb-e02e202602fe None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:12.512063 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41191c3a-ef1b-4fb2-80eb-e02e202602fe None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:12.512741 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41191c3a-ef1b-4fb2-80eb-e02e202602fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:12.538967 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-41191c3a-ef1b-4fb2-80eb-e02e202602fe None None] MFA Rules not processed for user `ed792f79b7bf4da393b2210ef4b11799`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:45:12.540222 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-41191c3a-ef1b-4fb2-80eb-e02e202602fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:12.566768 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c9340a-2456-497a-b0d7-e425604bbaac admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:12.612073 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1123/2252] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:45:12 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:45:12.616026 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41191c3a-ef1b-4fb2-80eb-e02e202602fe None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:12.632063 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb029ba8-2db1-496a-bad7-2a0f0f61f1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:12.632812 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb029ba8-2db1-496a-bad7-2a0f0f61f1b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:12.633120 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb029ba8-2db1-496a-bad7-2a0f0f61f1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:12.633402 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb029ba8-2db1-496a-bad7-2a0f0f61f1b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:12.634131 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb029ba8-2db1-496a-bad7-2a0f0f61f1b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:12.640831 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb029ba8-2db1-496a-bad7-2a0f0f61f1b3 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:12.693907 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41191c3a-ef1b-4fb2-80eb-e02e202602fe None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:12.700968 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4473d2bc-b1a1-435b-9688-ccb7757a22c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:12.701730 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473d2bc-b1a1-435b-9688-ccb7757a22c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:12.701960 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473d2bc-b1a1-435b-9688-ccb7757a22c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:12.702236 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473d2bc-b1a1-435b-9688-ccb7757a22c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:12.702944 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4473d2bc-b1a1-435b-9688-ccb7757a22c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:12.704938 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4473d2bc-b1a1-435b-9688-ccb7757a22c7 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:12.743161 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1130/2253] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:45:12 2022] POST /identity/v3/users => generated 293 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:45:12.743161 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb029ba8-2db1-496a-bad7-2a0f0f61f1b3 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:12.744885 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-cb029ba8-2db1-496a-bad7-2a0f0f61f1b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:12.804228 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb029ba8-2db1-496a-bad7-2a0f0f61f1b3 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:12.808116 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62782740-3441-49b6-8876-773029d997d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '950b5b5f690d41509ead753065a0b793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:12.808818 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62782740-3441-49b6-8876-773029d997d4 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:12.809140 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62782740-3441-49b6-8876-773029d997d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:12.809459 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62782740-3441-49b6-8876-773029d997d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:12.811456 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-62782740-3441-49b6-8876-773029d997d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:12.826010 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1124/2254] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:45:12 2022] POST /identity/v3/users => generated 304 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:45:12.827321 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4473d2bc-b1a1-435b-9688-ccb7757a22c7 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:12.844969 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4473d2bc-b1a1-435b-9688-ccb7757a22c7 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:12.850690 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fbd208-85e2-4469-a477-f9f7836a2d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:12.851436 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fbd208-85e2-4469-a477-f9f7836a2d56 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:12.851754 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fbd208-85e2-4469-a477-f9f7836a2d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:12.852024 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fbd208-85e2-4469-a477-f9f7836a2d56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:12.852754 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fbd208-85e2-4469-a477-f9f7836a2d56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:12.854351 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fbd208-85e2-4469-a477-f9f7836a2d56 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:12.865909 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1125/2255] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:45:12 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:45:12.866638 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fbd208-85e2-4469-a477-f9f7836a2d56 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:12.878977 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fbd208-85e2-4469-a477-f9f7836a2d56 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:12.879199 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62782740-3441-49b6-8876-773029d997d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:12.880675 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62782740-3441-49b6-8876-773029d997d4 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:12.885132 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031d0611-9177-4e15-897b-35ddd65015d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:12.885132 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d0611-9177-4e15-897b-35ddd65015d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:12.885398 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d0611-9177-4e15-897b-35ddd65015d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:12.885676 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d0611-9177-4e15-897b-35ddd65015d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:12.886414 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031d0611-9177-4e15-897b-35ddd65015d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:12.888058 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031d0611-9177-4e15-897b-35ddd65015d9 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:12.890339 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1131/2256] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:45:12 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:45:12.891212 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62782740-3441-49b6-8876-773029d997d4 service cinder] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:12.901822 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1126/2257] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:45:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:45:12.902053 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62782740-3441-49b6-8876-773029d997d4 service cinder] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:12.906303 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031d0611-9177-4e15-897b-35ddd65015d9 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:12.906907 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b93d1af-db60-4ddb-a42e-fb311b171977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:12.907631 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b93d1af-db60-4ddb-a42e-fb311b171977 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:12.907915 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b93d1af-db60-4ddb-a42e-fb311b171977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:12.908860 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b93d1af-db60-4ddb-a42e-fb311b171977 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:12.909750 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b93d1af-db60-4ddb-a42e-fb311b171977 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:12.911409 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b93d1af-db60-4ddb-a42e-fb311b171977 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:12.918130 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031d0611-9177-4e15-897b-35ddd65015d9 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:12.927691 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1132/2258] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:45:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:45:12.928259 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc6ca6a-a2c6-4793-b38e-a8c1d9a5b844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:12.928618 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b93d1af-db60-4ddb-a42e-fb311b171977 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:12.929225 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc6ca6a-a2c6-4793-b38e-a8c1d9a5b844 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:12.929508 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc6ca6a-a2c6-4793-b38e-a8c1d9a5b844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:12.929788 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc6ca6a-a2c6-4793-b38e-a8c1d9a5b844 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:12.930814 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc6ca6a-a2c6-4793-b38e-a8c1d9a5b844 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:12.932481 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc6ca6a-a2c6-4793-b38e-a8c1d9a5b844 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:12.939247 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b93d1af-db60-4ddb-a42e-fb311b171977 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:12.946062 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d828d2-e66c-4a6a-85a7-c755405ad260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:12.947063 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d828d2-e66c-4a6a-85a7-c755405ad260 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:12.947277 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d828d2-e66c-4a6a-85a7-c755405ad260 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:12.949081 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d828d2-e66c-4a6a-85a7-c755405ad260 admin admin] PATH_INFO: `/v3/projects/55ea70b432734c2e85f719e2a8fc2fc2/users/acf07e3116e146f6aaf95828f78c92ec/roles/0d41da7bec094450b5bff4e4831be52c` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:12.949538 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1127/2259] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:45:12 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 16:45:12.956997 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc6ca6a-a2c6-4793-b38e-a8c1d9a5b844 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:12.974326 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc6ca6a-a2c6-4793-b38e-a8c1d9a5b844 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:12.988530 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a1ce5-8d8c-4737-b7d1-dce06a24fe88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:12.991468 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a1ce5-8d8c-4737-b7d1-dce06a24fe88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:12.991879 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a1ce5-8d8c-4737-b7d1-dce06a24fe88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:12.992191 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a1ce5-8d8c-4737-b7d1-dce06a24fe88 admin admin] PATH_INFO: `/v3/projects/69ec57643c3740838934c64f98affdf3/users/57d8ff5419884d2c93027c5f1f692511/roles/0d41da7bec094450b5bff4e4831be52c` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:13.008995 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d828d2-e66c-4a6a-85a7-c755405ad260 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55ea70b432734c2e85f719e2a8fc2fc2, user_id=acf07e3116e146f6aaf95828f78c92ec, role_id=0d41da7bec094450b5bff4e4831be52c)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:13.011786 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d828d2-e66c-4a6a-85a7-c755405ad260 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:13.013004 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1a1ce5-8d8c-4737-b7d1-dce06a24fe88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69ec57643c3740838934c64f98affdf3, user_id=57d8ff5419884d2c93027c5f1f692511, role_id=0d41da7bec094450b5bff4e4831be52c)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:13.016106 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1a1ce5-8d8c-4737-b7d1-dce06a24fe88 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:13.093001 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1133/2260] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:45:12 2022] PUT /identity/v3/projects/55ea70b432734c2e85f719e2a8fc2fc2/users/acf07e3116e146f6aaf95828f78c92ec/roles/0d41da7bec094450b5bff4e4831be52c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:45:13.103318 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e80d39-36b5-40ac-8c22-01bc869a441d None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:13.103669 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e80d39-36b5-40ac-8c22-01bc869a441d None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:13.103968 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e80d39-36b5-40ac-8c22-01bc869a441d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:13.123029 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1128/2261] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:45:12 2022] PUT /identity/v3/projects/69ec57643c3740838934c64f98affdf3/users/57d8ff5419884d2c93027c5f1f692511/roles/0d41da7bec094450b5bff4e4831be52c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:45:13.130999 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c8571-d39b-45c0-a496-68018087321c None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:13.131296 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c8571-d39b-45c0-a496-68018087321c None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:13.131606 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c8571-d39b-45c0-a496-68018087321c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:13.139782 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-55e80d39-36b5-40ac-8c22-01bc869a441d None None] MFA Rules not processed for user `acf07e3116e146f6aaf95828f78c92ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:45:13.141081 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-55e80d39-36b5-40ac-8c22-01bc869a441d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:13.164574 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-5e2c8571-d39b-45c0-a496-68018087321c None None] MFA Rules not processed for user `57d8ff5419884d2c93027c5f1f692511`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:45:13.166572 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-5e2c8571-d39b-45c0-a496-68018087321c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:13.214431 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1134/2262] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:45:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:45:13.245580 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1129/2263] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:45:13 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:45:13.250120 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e80d39-36b5-40ac-8c22-01bc869a441d None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:13.372269 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c8571-d39b-45c0-a496-68018087321c None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:13.373779 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-5e2c8571-d39b-45c0-a496-68018087321c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:13.440695 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c8571-d39b-45c0-a496-68018087321c None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:13.444430 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14440cd0-8a70-4e26-91f2-8d6fda51b5da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '950b5b5f690d41509ead753065a0b793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:13.450117 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14440cd0-8a70-4e26-91f2-8d6fda51b5da service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:13.450117 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14440cd0-8a70-4e26-91f2-8d6fda51b5da service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:13.450117 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14440cd0-8a70-4e26-91f2-8d6fda51b5da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:13.451797 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e80d39-36b5-40ac-8c22-01bc869a441d None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:13.457801 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e43fa0-697e-4744-bbce-fc1662caf773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:13.458493 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e43fa0-697e-4744-bbce-fc1662caf773 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:13.458773 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e43fa0-697e-4744-bbce-fc1662caf773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:13.459057 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e43fa0-697e-4744-bbce-fc1662caf773 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:13.459808 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e43fa0-697e-4744-bbce-fc1662caf773 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:13.460587 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14440cd0-8a70-4e26-91f2-8d6fda51b5da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:13.462998 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e43fa0-697e-4744-bbce-fc1662caf773 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:13.463122 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14440cd0-8a70-4e26-91f2-8d6fda51b5da service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:13.473354 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1130/2264] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:45:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 16:45:13.547323 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1135/2265] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:45:13 2022] POST /identity/v3/projects => generated 409 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:45:13.551641 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14440cd0-8a70-4e26-91f2-8d6fda51b5da service cinder] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:13.562932 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14440cd0-8a70-4e26-91f2-8d6fda51b5da service cinder] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:13.621176 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a5e570-172f-44a8-80af-d2b1d5cbef04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:13.621765 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a5e570-172f-44a8-80af-d2b1d5cbef04 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:13.622126 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a5e570-172f-44a8-80af-d2b1d5cbef04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:13.622412 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a5e570-172f-44a8-80af-d2b1d5cbef04 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:13.623146 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a5e570-172f-44a8-80af-d2b1d5cbef04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:13.625194 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a5e570-172f-44a8-80af-d2b1d5cbef04 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:13.803047 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1131/2266] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:45:13 2022] POST /identity/v3/users => generated 311 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:45:13.808691 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e43fa0-697e-4744-bbce-fc1662caf773 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:13.819934 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e43fa0-697e-4744-bbce-fc1662caf773 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:13.824598 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7006aab7-fb45-4ad5-ad77-7c28cccb0dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:13.825288 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7006aab7-fb45-4ad5-ad77-7c28cccb0dd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:13.825631 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7006aab7-fb45-4ad5-ad77-7c28cccb0dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:13.825848 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7006aab7-fb45-4ad5-ad77-7c28cccb0dd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:13.826578 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7006aab7-fb45-4ad5-ad77-7c28cccb0dd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:13.828201 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7006aab7-fb45-4ad5-ad77-7c28cccb0dd5 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:13.839765 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1136/2267] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:45:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:45:13.844142 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a5e570-172f-44a8-80af-d2b1d5cbef04 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:13.858502 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a5e570-172f-44a8-80af-d2b1d5cbef04 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:13.865612 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fdedd9-ef8f-4824-ac98-19249b82330f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:13.866516 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fdedd9-ef8f-4824-ac98-19249b82330f admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:13.866801 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fdedd9-ef8f-4824-ac98-19249b82330f admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:13.867079 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fdedd9-ef8f-4824-ac98-19249b82330f admin admin] PATH_INFO: `/v3/projects/db2578437068425db25793b646410dfa/users/bc22609f0b694bdcabd5884b806d27e3/roles/702e5e78b5d744529384b96a390ae92f` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:13.886286 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fdedd9-ef8f-4824-ac98-19249b82330f admin admin] RBAC: Authorizing `identity:create_grant(project_id=db2578437068425db25793b646410dfa, user_id=bc22609f0b694bdcabd5884b806d27e3, role_id=702e5e78b5d744529384b96a390ae92f)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:13.886286 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fdedd9-ef8f-4824-ac98-19249b82330f admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:14.005421 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1132/2268] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:45:13 2022] PUT /identity/v3/projects/db2578437068425db25793b646410dfa/users/bc22609f0b694bdcabd5884b806d27e3/roles/702e5e78b5d744529384b96a390ae92f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:45:14.009847 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7006aab7-fb45-4ad5-ad77-7c28cccb0dd5 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:14.020423 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7006aab7-fb45-4ad5-ad77-7c28cccb0dd5 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:14.077710 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adf9296-2f03-4e27-b33a-e8d8cfb3f61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:14.078376 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf9296-2f03-4e27-b33a-e8d8cfb3f61c admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:14.078660 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf9296-2f03-4e27-b33a-e8d8cfb3f61c admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:14.078934 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf9296-2f03-4e27-b33a-e8d8cfb3f61c admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:14.079689 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adf9296-2f03-4e27-b33a-e8d8cfb3f61c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:14.081308 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adf9296-2f03-4e27-b33a-e8d8cfb3f61c admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:14.090803 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1137/2269] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:45:14 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:45:14.095082 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fdedd9-ef8f-4824-ac98-19249b82330f admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:14.106146 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fdedd9-ef8f-4824-ac98-19249b82330f admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:14.111726 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a0e44b-aaaf-48de-b528-ae7c6d0c0814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:14.112639 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0e44b-aaaf-48de-b528-ae7c6d0c0814 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:14.113000 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0e44b-aaaf-48de-b528-ae7c6d0c0814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:14.113335 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0e44b-aaaf-48de-b528-ae7c6d0c0814 admin admin] PATH_INFO: `/v3/projects/db2578437068425db25793b646410dfa/users/bc22609f0b694bdcabd5884b806d27e3/roles/702e5e78b5d744529384b96a390ae92f` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:14.115302 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a0e44b-aaaf-48de-b528-ae7c6d0c0814 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db2578437068425db25793b646410dfa, user_id=bc22609f0b694bdcabd5884b806d27e3, role_id=702e5e78b5d744529384b96a390ae92f)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:14.118338 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a0e44b-aaaf-48de-b528-ae7c6d0c0814 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:14.130349 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1133/2270] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:45:14 2022] PUT /identity/v3/projects/db2578437068425db25793b646410dfa/users/bc22609f0b694bdcabd5884b806d27e3/roles/702e5e78b5d744529384b96a390ae92f => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:45:14.141263 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4917ee47-9d36-4891-a4af-847ceca7a83a None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:14.141479 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4917ee47-9d36-4891-a4af-847ceca7a83a None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:14.141816 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4917ee47-9d36-4891-a4af-847ceca7a83a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:14.168087 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-4917ee47-9d36-4891-a4af-847ceca7a83a None None] MFA Rules not processed for user `bc22609f0b694bdcabd5884b806d27e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:45:14.169274 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-4917ee47-9d36-4891-a4af-847ceca7a83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:14.247224 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1138/2271] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:45:14 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:45:14.255552 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a0e44b-aaaf-48de-b528-ae7c6d0c0814 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:14.319101 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a0e44b-aaaf-48de-b528-ae7c6d0c0814 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:14.322908 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6b536f-933a-4665-a0a5-68dd7ed59095 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '950b5b5f690d41509ead753065a0b793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:14.323588 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b536f-933a-4665-a0a5-68dd7ed59095 service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:14.323880 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b536f-933a-4665-a0a5-68dd7ed59095 service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:14.324161 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b536f-933a-4665-a0a5-68dd7ed59095 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:14.334447 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6b536f-933a-4665-a0a5-68dd7ed59095 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:14.335942 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6b536f-933a-4665-a0a5-68dd7ed59095 service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:14.346368 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1134/2272] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:45:14 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 16:45:14.746175 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4917ee47-9d36-4891-a4af-847ceca7a83a None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:14.759690 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4917ee47-9d36-4891-a4af-847ceca7a83a None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:14.767631 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b52dec-fa8f-44c8-8549-5d9858c65a8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '950b5b5f690d41509ead753065a0b793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:14.768307 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b52dec-fa8f-44c8-8549-5d9858c65a8b service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:14.768593 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b52dec-fa8f-44c8-8549-5d9858c65a8b service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:14.768866 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b52dec-fa8f-44c8-8549-5d9858c65a8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:14.834942 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b52dec-fa8f-44c8-8549-5d9858c65a8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:14.836603 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b52dec-fa8f-44c8-8549-5d9858c65a8b service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:14.848099 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1139/2273] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:45:14 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:45:14.893484 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6b536f-933a-4665-a0a5-68dd7ed59095 service cinder] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:14.894158 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-ca6b536f-933a-4665-a0a5-68dd7ed59095 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:14.978492 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6b536f-933a-4665-a0a5-68dd7ed59095 service cinder] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:14.983156 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f150b7fd-c8fb-437f-8af8-6db8eabd4a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:14.984000 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150b7fd-c8fb-437f-8af8-6db8eabd4a21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:14.984279 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150b7fd-c8fb-437f-8af8-6db8eabd4a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:14.984549 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150b7fd-c8fb-437f-8af8-6db8eabd4a21 admin admin] PATH_INFO: `/v3/users/7e87df745505432fbde74ba5fb1c8806` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:14.985774 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f150b7fd-c8fb-437f-8af8-6db8eabd4a21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e87df745505432fbde74ba5fb1c8806)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:14.988699 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f150b7fd-c8fb-437f-8af8-6db8eabd4a21 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:15.302884 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f150b7fd-c8fb-437f-8af8-6db8eabd4a21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e87df745505432fbde74ba5fb1c8806'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:15.507231 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f150b7fd-c8fb-437f-8af8-6db8eabd4a21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e87df745505432fbde74ba5fb1c8806'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:15.514957 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f150b7fd-c8fb-437f-8af8-6db8eabd4a21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e87df745505432fbde74ba5fb1c8806'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:15.515579 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f150b7fd-c8fb-437f-8af8-6db8eabd4a21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e87df745505432fbde74ba5fb1c8806'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:15.533617 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f150b7fd-c8fb-437f-8af8-6db8eabd4a21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e87df745505432fbde74ba5fb1c8806'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:15.543887 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1135/2274] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:45:14 2022] DELETE /identity/v3/users/7e87df745505432fbde74ba5fb1c8806 => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:45:15.557943 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a4b072-48e4-4502-8392-6d2656760fe2 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:15.558450 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a4b072-48e4-4502-8392-6d2656760fe2 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:15.558956 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a4b072-48e4-4502-8392-6d2656760fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:15.579828 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-58a4b072-48e4-4502-8392-6d2656760fe2 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:45:15.582275 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-58a4b072-48e4-4502-8392-6d2656760fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:15.642975 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1140/2275] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:45:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:45:15.653434 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f150b7fd-c8fb-437f-8af8-6db8eabd4a21 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:15.654860 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-f150b7fd-c8fb-437f-8af8-6db8eabd4a21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:15.724689 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f150b7fd-c8fb-437f-8af8-6db8eabd4a21 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:15.734990 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e3d15-9274-43f2-843e-c3a31e494352 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:15.738471 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e3d15-9274-43f2-843e-c3a31e494352 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:15.738471 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e3d15-9274-43f2-843e-c3a31e494352 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:15.738471 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e3d15-9274-43f2-843e-c3a31e494352 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:15.748380 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977e3d15-9274-43f2-843e-c3a31e494352 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:15.749829 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977e3d15-9274-43f2-843e-c3a31e494352 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:15.760983 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1136/2276] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:45:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:45:16.170455 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a4b072-48e4-4502-8392-6d2656760fe2 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:16.171976 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-58a4b072-48e4-4502-8392-6d2656760fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:16.186917 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a4b072-48e4-4502-8392-6d2656760fe2 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:16.192850 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7187ab3c-9cb5-43bf-8922-4f80d8a30b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:16.193757 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187ab3c-9cb5-43bf-8922-4f80d8a30b90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:16.194054 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187ab3c-9cb5-43bf-8922-4f80d8a30b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:16.194314 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187ab3c-9cb5-43bf-8922-4f80d8a30b90 admin admin] PATH_INFO: `/v3/projects/5900cce1db854b03a120aa56edbfe3dc` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:16.195572 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7187ab3c-9cb5-43bf-8922-4f80d8a30b90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5900cce1db854b03a120aa56edbfe3dc)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:16.202539 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7187ab3c-9cb5-43bf-8922-4f80d8a30b90 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:16.335900 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-7187ab3c-9cb5-43bf-8922-4f80d8a30b90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5900cce1db854b03a120aa56edbfe3dc', 'request_id': 'req-7187ab3c-9cb5-43bf-8922-4f80d8a30b90'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:16.341144 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-7187ab3c-9cb5-43bf-8922-4f80d8a30b90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5900cce1db854b03a120aa56edbfe3dc', 'request_id': 'req-7187ab3c-9cb5-43bf-8922-4f80d8a30b90'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:16.427788 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-7187ab3c-9cb5-43bf-8922-4f80d8a30b90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5900cce1db854b03a120aa56edbfe3dc', 'request_id': 'req-7187ab3c-9cb5-43bf-8922-4f80d8a30b90'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:16.440559 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-7187ab3c-9cb5-43bf-8922-4f80d8a30b90 admin admin] The token cache is being invalidate because project 5900cce1db854b03a120aa56edbfe3dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:45:16.440856 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-7187ab3c-9cb5-43bf-8922-4f80d8a30b90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:16.441507 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-7187ab3c-9cb5-43bf-8922-4f80d8a30b90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:16.443073 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1141/2277] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:45:16 2022] DELETE /identity/v3/projects/5900cce1db854b03a120aa56edbfe3dc => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:45:16.447330 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e3d15-9274-43f2-843e-c3a31e494352 service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:16.457848 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e3d15-9274-43f2-843e-c3a31e494352 service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:16.522070 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514055f2-08f0-46b7-adf4-ef58dc9dd199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:16.523077 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514055f2-08f0-46b7-adf4-ef58dc9dd199 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:16.523367 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514055f2-08f0-46b7-adf4-ef58dc9dd199 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:16.523752 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514055f2-08f0-46b7-adf4-ef58dc9dd199 admin admin] PATH_INFO: `/v3/users/6c5d1f8f8be14a7bbe8310842304bec2` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:16.525077 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514055f2-08f0-46b7-adf4-ef58dc9dd199 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c5d1f8f8be14a7bbe8310842304bec2)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:16.534164 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514055f2-08f0-46b7-adf4-ef58dc9dd199 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:16.782799 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-514055f2-08f0-46b7-adf4-ef58dc9dd199 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c5d1f8f8be14a7bbe8310842304bec2'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:16.890229 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-514055f2-08f0-46b7-adf4-ef58dc9dd199 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c5d1f8f8be14a7bbe8310842304bec2'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:16.898258 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-514055f2-08f0-46b7-adf4-ef58dc9dd199 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c5d1f8f8be14a7bbe8310842304bec2'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:16.898977 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-514055f2-08f0-46b7-adf4-ef58dc9dd199 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c5d1f8f8be14a7bbe8310842304bec2'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:16.913376 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-514055f2-08f0-46b7-adf4-ef58dc9dd199 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c5d1f8f8be14a7bbe8310842304bec2'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:16.926702 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1137/2278] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:45:16 2022] DELETE /identity/v3/users/6c5d1f8f8be14a7bbe8310842304bec2 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:45:17.492068 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7187ab3c-9cb5-43bf-8922-4f80d8a30b90 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:17.493623 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-7187ab3c-9cb5-43bf-8922-4f80d8a30b90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:17.507041 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7187ab3c-9cb5-43bf-8922-4f80d8a30b90 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:17.577850 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668261cd-ee04-4cf4-82d8-33bfa96c43cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:17.578702 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668261cd-ee04-4cf4-82d8-33bfa96c43cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:17.578980 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668261cd-ee04-4cf4-82d8-33bfa96c43cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:17.579250 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668261cd-ee04-4cf4-82d8-33bfa96c43cc admin admin] PATH_INFO: `/v3/projects/29caea87487d497e813751879b347f2b` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:17.580998 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668261cd-ee04-4cf4-82d8-33bfa96c43cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=29caea87487d497e813751879b347f2b)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:17.582890 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668261cd-ee04-4cf4-82d8-33bfa96c43cc admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:17.701109 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-668261cd-ee04-4cf4-82d8-33bfa96c43cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29caea87487d497e813751879b347f2b', 'request_id': 'req-668261cd-ee04-4cf4-82d8-33bfa96c43cc'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:17.706985 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-668261cd-ee04-4cf4-82d8-33bfa96c43cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29caea87487d497e813751879b347f2b', 'request_id': 'req-668261cd-ee04-4cf4-82d8-33bfa96c43cc'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:17.770448 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-668261cd-ee04-4cf4-82d8-33bfa96c43cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29caea87487d497e813751879b347f2b', 'request_id': 'req-668261cd-ee04-4cf4-82d8-33bfa96c43cc'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:17.781986 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-668261cd-ee04-4cf4-82d8-33bfa96c43cc admin admin] The token cache is being invalidate because project 29caea87487d497e813751879b347f2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:45:17.782278 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-668261cd-ee04-4cf4-82d8-33bfa96c43cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:17.783044 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-668261cd-ee04-4cf4-82d8-33bfa96c43cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:17.784987 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1142/2279] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:45:17 2022] DELETE /identity/v3/projects/29caea87487d497e813751879b347f2b => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:45:17.788990 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514055f2-08f0-46b7-adf4-ef58dc9dd199 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:17.790446 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-514055f2-08f0-46b7-adf4-ef58dc9dd199 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:17.806028 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514055f2-08f0-46b7-adf4-ef58dc9dd199 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:17.870787 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12cbb57-21a9-4f3e-9327-0cae7c2d2200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:17.871703 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12cbb57-21a9-4f3e-9327-0cae7c2d2200 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:17.871989 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12cbb57-21a9-4f3e-9327-0cae7c2d2200 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:17.872320 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12cbb57-21a9-4f3e-9327-0cae7c2d2200 admin admin] PATH_INFO: `/v3/users/01449aae3fcb48ffa7d2f57d6bb132ae` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:17.873533 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12cbb57-21a9-4f3e-9327-0cae7c2d2200 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01449aae3fcb48ffa7d2f57d6bb132ae)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:17.875454 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12cbb57-21a9-4f3e-9327-0cae7c2d2200 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:18.126362 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a12cbb57-21a9-4f3e-9327-0cae7c2d2200 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01449aae3fcb48ffa7d2f57d6bb132ae'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:18.202641 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a12cbb57-21a9-4f3e-9327-0cae7c2d2200 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01449aae3fcb48ffa7d2f57d6bb132ae'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:18.211167 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a12cbb57-21a9-4f3e-9327-0cae7c2d2200 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01449aae3fcb48ffa7d2f57d6bb132ae'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:18.212014 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a12cbb57-21a9-4f3e-9327-0cae7c2d2200 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01449aae3fcb48ffa7d2f57d6bb132ae'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:18.225521 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a12cbb57-21a9-4f3e-9327-0cae7c2d2200 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01449aae3fcb48ffa7d2f57d6bb132ae'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:18.231833 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1138/2280] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:45:17 2022] DELETE /identity/v3/users/01449aae3fcb48ffa7d2f57d6bb132ae => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:45:18.659720 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668261cd-ee04-4cf4-82d8-33bfa96c43cc admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:18.662307 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-668261cd-ee04-4cf4-82d8-33bfa96c43cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:18.675962 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668261cd-ee04-4cf4-82d8-33bfa96c43cc admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:18.740591 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f0a914-fcae-46dc-9ded-4a169d398a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:18.741451 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0a914-fcae-46dc-9ded-4a169d398a2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:18.741739 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0a914-fcae-46dc-9ded-4a169d398a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:18.742012 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0a914-fcae-46dc-9ded-4a169d398a2a admin admin] PATH_INFO: `/v3/projects/fe5699fcc57246ef8d3436e0efa45845` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:18.743217 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f0a914-fcae-46dc-9ded-4a169d398a2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe5699fcc57246ef8d3436e0efa45845)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:18.745208 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f0a914-fcae-46dc-9ded-4a169d398a2a admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:18.867096 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-91f0a914-fcae-46dc-9ded-4a169d398a2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe5699fcc57246ef8d3436e0efa45845', 'request_id': 'req-91f0a914-fcae-46dc-9ded-4a169d398a2a'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:18.872820 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-91f0a914-fcae-46dc-9ded-4a169d398a2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe5699fcc57246ef8d3436e0efa45845', 'request_id': 'req-91f0a914-fcae-46dc-9ded-4a169d398a2a'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:18.962483 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-91f0a914-fcae-46dc-9ded-4a169d398a2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe5699fcc57246ef8d3436e0efa45845', 'request_id': 'req-91f0a914-fcae-46dc-9ded-4a169d398a2a'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:18.976247 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-91f0a914-fcae-46dc-9ded-4a169d398a2a admin admin] The token cache is being invalidate because project fe5699fcc57246ef8d3436e0efa45845 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:45:18.976570 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-91f0a914-fcae-46dc-9ded-4a169d398a2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:18.977245 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-91f0a914-fcae-46dc-9ded-4a169d398a2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:18.980279 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1143/2281] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:45:18 2022] DELETE /identity/v3/projects/fe5699fcc57246ef8d3436e0efa45845 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:45:18.984963 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa3764a-45c3-44e3-b192-e0724e166d9a None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:18.985403 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa3764a-45c3-44e3-b192-e0724e166d9a None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:18.985557 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa3764a-45c3-44e3-b192-e0724e166d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:19.004323 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-eaa3764a-45c3-44e3-b192-e0724e166d9a None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:45:19.005546 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-eaa3764a-45c3-44e3-b192-e0724e166d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:19.067772 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1139/2282] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:45:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:45:19.075619 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3fe45c-b404-480f-898a-7104bd883cde None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:19.075917 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3fe45c-b404-480f-898a-7104bd883cde None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:19.076199 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3fe45c-b404-480f-898a-7104bd883cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:19.100115 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-cf3fe45c-b404-480f-898a-7104bd883cde None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:45:19.101360 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-cf3fe45c-b404-480f-898a-7104bd883cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:19.109706 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1144/2283] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:45:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:45:19.114682 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa3764a-45c3-44e3-b192-e0724e166d9a None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:19.127588 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa3764a-45c3-44e3-b192-e0724e166d9a None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:19.132564 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2260443b-774c-4ceb-bcda-285ce3510549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:19.133236 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260443b-774c-4ceb-bcda-285ce3510549 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:19.133547 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260443b-774c-4ceb-bcda-285ce3510549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:19.133830 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260443b-774c-4ceb-bcda-285ce3510549 admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:19.134568 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2260443b-774c-4ceb-bcda-285ce3510549 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:45:19.134875 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2260443b-774c-4ceb-bcda-285ce3510549 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:19.136506 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2260443b-774c-4ceb-bcda-285ce3510549 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:19.149663 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1140/2284] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Apr 11 16:45:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:45:19.154359 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3fe45c-b404-480f-898a-7104bd883cde None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:19.164605 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3fe45c-b404-480f-898a-7104bd883cde None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:19.169314 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8668d66-fdd3-4cfc-9d4d-c754aafadd71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:19.169977 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8668d66-fdd3-4cfc-9d4d-c754aafadd71 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:19.170268 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8668d66-fdd3-4cfc-9d4d-c754aafadd71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:19.170547 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8668d66-fdd3-4cfc-9d4d-c754aafadd71 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:19.171258 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8668d66-fdd3-4cfc-9d4d-c754aafadd71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:19.173228 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8668d66-fdd3-4cfc-9d4d-c754aafadd71 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:19.371904 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1145/2285] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:45:19 2022] POST /identity/v3/projects => generated 375 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:45:19.376014 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2260443b-774c-4ceb-bcda-285ce3510549 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:19.386809 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2260443b-774c-4ceb-bcda-285ce3510549 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:19.444152 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49196c7e-f871-4448-8068-c5afb3eafc0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:19.444800 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49196c7e-f871-4448-8068-c5afb3eafc0f admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:19.445116 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49196c7e-f871-4448-8068-c5afb3eafc0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:19.445393 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49196c7e-f871-4448-8068-c5afb3eafc0f admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:19.446129 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49196c7e-f871-4448-8068-c5afb3eafc0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:19.448258 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49196c7e-f871-4448-8068-c5afb3eafc0f admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:19.534966 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1141/2286] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:45:19 2022] POST /identity/v3/users => generated 288 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:45:19.539308 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8668d66-fdd3-4cfc-9d4d-c754aafadd71 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:19.550421 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8668d66-fdd3-4cfc-9d4d-c754aafadd71 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:19.555368 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a642f144-7bb5-4f51-a020-215a4b00f24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:19.556059 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a642f144-7bb5-4f51-a020-215a4b00f24c admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:19.556343 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a642f144-7bb5-4f51-a020-215a4b00f24c admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:19.556620 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a642f144-7bb5-4f51-a020-215a4b00f24c admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:19.557348 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a642f144-7bb5-4f51-a020-215a4b00f24c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:19.558927 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a642f144-7bb5-4f51-a020-215a4b00f24c admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:19.570171 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1146/2287] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:45:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 16:45:19.574477 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49196c7e-f871-4448-8068-c5afb3eafc0f admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:19.585029 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49196c7e-f871-4448-8068-c5afb3eafc0f admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:19.590214 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddf5da8-209e-4b00-811c-2e473798624e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:19.590877 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf5da8-209e-4b00-811c-2e473798624e admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:19.591161 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf5da8-209e-4b00-811c-2e473798624e admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:19.591474 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf5da8-209e-4b00-811c-2e473798624e admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:19.592241 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddf5da8-209e-4b00-811c-2e473798624e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:19.593830 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddf5da8-209e-4b00-811c-2e473798624e admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:19.603996 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1142/2288] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:45:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 16:45:19.608232 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a642f144-7bb5-4f51-a020-215a4b00f24c admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:19.618608 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a642f144-7bb5-4f51-a020-215a4b00f24c admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:19.623186 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a8c01-9490-4d45-9c36-f0d9652a8060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:19.624089 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a8c01-9490-4d45-9c36-f0d9652a8060 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:19.624368 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a8c01-9490-4d45-9c36-f0d9652a8060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:19.624639 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a8c01-9490-4d45-9c36-f0d9652a8060 admin admin] PATH_INFO: `/v3/projects/8eeae39feb8d4b91b8844451a84dc066/users/1a4787f9e28641e7b893c80ffde3612d/roles/0d41da7bec094450b5bff4e4831be52c` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:19.639320 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29a8c01-9490-4d45-9c36-f0d9652a8060 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8eeae39feb8d4b91b8844451a84dc066, user_id=1a4787f9e28641e7b893c80ffde3612d, role_id=0d41da7bec094450b5bff4e4831be52c)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:19.641989 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29a8c01-9490-4d45-9c36-f0d9652a8060 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:19.690506 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1147/2289] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:45:19 2022] PUT /identity/v3/projects/8eeae39feb8d4b91b8844451a84dc066/users/1a4787f9e28641e7b893c80ffde3612d/roles/0d41da7bec094450b5bff4e4831be52c => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:45:19.701476 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b517c-64db-44f1-a9a8-87e89667ef0a None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:19.701476 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b517c-64db-44f1-a9a8-87e89667ef0a None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:19.701476 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b517c-64db-44f1-a9a8-87e89667ef0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:19.729931 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-ce7b517c-64db-44f1-a9a8-87e89667ef0a None None] MFA Rules not processed for user `1a4787f9e28641e7b893c80ffde3612d`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:45:19.731254 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-ce7b517c-64db-44f1-a9a8-87e89667ef0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:19.794812 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1143/2290] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:45:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:45:19.806549 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a8c01-9490-4d45-9c36-f0d9652a8060 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:19.808246 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e29a8c01-9490-4d45-9c36-f0d9652a8060 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:19.864471 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a8c01-9490-4d45-9c36-f0d9652a8060 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:19.868147 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6805bf59-018f-4984-9bbf-c60b8dd1b24b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '950b5b5f690d41509ead753065a0b793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:19.868822 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805bf59-018f-4984-9bbf-c60b8dd1b24b service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:19.869139 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805bf59-018f-4984-9bbf-c60b8dd1b24b service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:19.869425 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805bf59-018f-4984-9bbf-c60b8dd1b24b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:19.880294 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6805bf59-018f-4984-9bbf-c60b8dd1b24b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:19.881736 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6805bf59-018f-4984-9bbf-c60b8dd1b24b service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:19.890652 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1148/2291] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:45:19 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:45:22.604052 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b517c-64db-44f1-a9a8-87e89667ef0a None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:22.605563 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-ce7b517c-64db-44f1-a9a8-87e89667ef0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:22.631758 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b517c-64db-44f1-a9a8-87e89667ef0a None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:22.635414 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a6ac2f-5287-44ab-b83f-9168f1d53396 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '950b5b5f690d41509ead753065a0b793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:22.636175 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6ac2f-5287-44ab-b83f-9168f1d53396 service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:22.636494 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6ac2f-5287-44ab-b83f-9168f1d53396 service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:22.636770 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6ac2f-5287-44ab-b83f-9168f1d53396 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:22.638597 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-82a6ac2f-5287-44ab-b83f-9168f1d53396 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:22.701266 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a6ac2f-5287-44ab-b83f-9168f1d53396 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:22.702618 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a6ac2f-5287-44ab-b83f-9168f1d53396 service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:22.712113 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1144/2292] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:45:22 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:45:23.844187 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83925826-022e-40af-8618-742f3186fb32 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:23.844765 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83925826-022e-40af-8618-742f3186fb32 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:23.844854 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83925826-022e-40af-8618-742f3186fb32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:23.863389 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-83925826-022e-40af-8618-742f3186fb32 None None] MFA Rules not processed for user `1a4787f9e28641e7b893c80ffde3612d`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:45:23.864682 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-83925826-022e-40af-8618-742f3186fb32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:23.871760 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1149/2293] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:45:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:45:24.555912 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a6ac2f-5287-44ab-b83f-9168f1d53396 service cinder] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:24.557506 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-82a6ac2f-5287-44ab-b83f-9168f1d53396 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:24.628186 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a6ac2f-5287-44ab-b83f-9168f1d53396 service cinder] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:24.632732 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a98e8-4cca-4cc7-80b8-21e6e8325eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:24.634116 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a98e8-4cca-4cc7-80b8-21e6e8325eba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:24.634116 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a98e8-4cca-4cc7-80b8-21e6e8325eba admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:24.634289 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a98e8-4cca-4cc7-80b8-21e6e8325eba admin admin] PATH_INFO: `/v3/users/acf07e3116e146f6aaf95828f78c92ec` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:24.635350 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946a98e8-4cca-4cc7-80b8-21e6e8325eba admin admin] RBAC: Authorizing `identity:delete_user(user_id=acf07e3116e146f6aaf95828f78c92ec)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:24.637287 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946a98e8-4cca-4cc7-80b8-21e6e8325eba admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:24.988962 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-946a98e8-4cca-4cc7-80b8-21e6e8325eba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acf07e3116e146f6aaf95828f78c92ec'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:25.078715 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-946a98e8-4cca-4cc7-80b8-21e6e8325eba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acf07e3116e146f6aaf95828f78c92ec'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:25.087215 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-946a98e8-4cca-4cc7-80b8-21e6e8325eba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acf07e3116e146f6aaf95828f78c92ec'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:25.087940 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-946a98e8-4cca-4cc7-80b8-21e6e8325eba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acf07e3116e146f6aaf95828f78c92ec'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:25.100606 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-946a98e8-4cca-4cc7-80b8-21e6e8325eba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acf07e3116e146f6aaf95828f78c92ec'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:25.106674 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1145/2294] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:45:24 2022] DELETE /identity/v3/users/acf07e3116e146f6aaf95828f78c92ec => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:45:25.111787 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2785214-58cb-4607-9d94-1d9faca16cc9 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:25.112280 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2785214-58cb-4607-9d94-1d9faca16cc9 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:25.112373 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2785214-58cb-4607-9d94-1d9faca16cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:25.130289 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-b2785214-58cb-4607-9d94-1d9faca16cc9 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:45:25.131499 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b2785214-58cb-4607-9d94-1d9faca16cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:25.195507 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1150/2295] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:45:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:45:25.202662 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a98e8-4cca-4cc7-80b8-21e6e8325eba admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:25.204150 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-946a98e8-4cca-4cc7-80b8-21e6e8325eba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:25.264437 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a98e8-4cca-4cc7-80b8-21e6e8325eba admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:25.268782 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983bd27e-34db-4ea0-abd8-f8202c908913 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:25.269437 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983bd27e-34db-4ea0-abd8-f8202c908913 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:25.269720 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983bd27e-34db-4ea0-abd8-f8202c908913 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:25.269994 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983bd27e-34db-4ea0-abd8-f8202c908913 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:25.279118 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983bd27e-34db-4ea0-abd8-f8202c908913 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:25.281200 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983bd27e-34db-4ea0-abd8-f8202c908913 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:25.292322 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1146/2296] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:45:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:45:25.754945 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2785214-58cb-4607-9d94-1d9faca16cc9 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:25.756580 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b2785214-58cb-4607-9d94-1d9faca16cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:25.769398 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2785214-58cb-4607-9d94-1d9faca16cc9 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:25.774144 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d335be-d219-482b-96e8-fa11112f224e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:25.775021 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d335be-d219-482b-96e8-fa11112f224e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:25.775301 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d335be-d219-482b-96e8-fa11112f224e admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:25.775602 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d335be-d219-482b-96e8-fa11112f224e admin admin] PATH_INFO: `/v3/projects/55ea70b432734c2e85f719e2a8fc2fc2` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:25.776810 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d335be-d219-482b-96e8-fa11112f224e admin admin] RBAC: Authorizing `identity:delete_project(project_id=55ea70b432734c2e85f719e2a8fc2fc2)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:25.778730 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d335be-d219-482b-96e8-fa11112f224e admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:25.906272 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-72d335be-d219-482b-96e8-fa11112f224e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55ea70b432734c2e85f719e2a8fc2fc2', 'request_id': 'req-72d335be-d219-482b-96e8-fa11112f224e'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:25.912539 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-72d335be-d219-482b-96e8-fa11112f224e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55ea70b432734c2e85f719e2a8fc2fc2', 'request_id': 'req-72d335be-d219-482b-96e8-fa11112f224e'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:26.003183 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-72d335be-d219-482b-96e8-fa11112f224e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55ea70b432734c2e85f719e2a8fc2fc2', 'request_id': 'req-72d335be-d219-482b-96e8-fa11112f224e'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:26.014719 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-72d335be-d219-482b-96e8-fa11112f224e admin admin] The token cache is being invalidate because project 55ea70b432734c2e85f719e2a8fc2fc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:45:26.015012 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-72d335be-d219-482b-96e8-fa11112f224e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:26.015693 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-72d335be-d219-482b-96e8-fa11112f224e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:26.018146 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1151/2297] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:45:25 2022] DELETE /identity/v3/projects/55ea70b432734c2e85f719e2a8fc2fc2 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:45:26.023021 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fa21d1-9ab4-4085-9758-3e2cebddb295 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:26.023552 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fa21d1-9ab4-4085-9758-3e2cebddb295 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:26.023644 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fa21d1-9ab4-4085-9758-3e2cebddb295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:26.041168 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-02fa21d1-9ab4-4085-9758-3e2cebddb295 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:45:26.042383 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-02fa21d1-9ab4-4085-9758-3e2cebddb295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:26.105058 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1147/2298] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:45:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:45:26.113669 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94517665-c06d-413b-87f9-8165b9f67c0a None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:26.114162 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94517665-c06d-413b-87f9-8165b9f67c0a None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:26.114279 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94517665-c06d-413b-87f9-8165b9f67c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:26.133923 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-94517665-c06d-413b-87f9-8165b9f67c0a None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:45:26.135134 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-94517665-c06d-413b-87f9-8165b9f67c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:26.143805 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1152/2299] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:45:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:45:26.148013 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fa21d1-9ab4-4085-9758-3e2cebddb295 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:26.158677 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fa21d1-9ab4-4085-9758-3e2cebddb295 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:26.163397 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68344d7-f3c4-4e0d-b8af-f93caa30d3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:26.164161 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68344d7-f3c4-4e0d-b8af-f93caa30d3cc admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:26.164452 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68344d7-f3c4-4e0d-b8af-f93caa30d3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:26.164735 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68344d7-f3c4-4e0d-b8af-f93caa30d3cc admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:26.165473 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68344d7-f3c4-4e0d-b8af-f93caa30d3cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:45:26.165788 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68344d7-f3c4-4e0d-b8af-f93caa30d3cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:26.167377 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68344d7-f3c4-4e0d-b8af-f93caa30d3cc admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:26.180025 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1148/2300] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Apr 11 16:45:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:45:26.184363 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94517665-c06d-413b-87f9-8165b9f67c0a None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:26.194160 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94517665-c06d-413b-87f9-8165b9f67c0a None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:26.198692 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4248e8da-a836-4dad-a082-20afba4fbb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:26.199347 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4248e8da-a836-4dad-a082-20afba4fbb6b admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:26.199665 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4248e8da-a836-4dad-a082-20afba4fbb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:26.199942 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4248e8da-a836-4dad-a082-20afba4fbb6b admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:26.200643 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4248e8da-a836-4dad-a082-20afba4fbb6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:26.202513 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4248e8da-a836-4dad-a082-20afba4fbb6b admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:26.325427 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1153/2301] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:45:26 2022] POST /identity/v3/projects => generated 371 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:45:26.330180 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68344d7-f3c4-4e0d-b8af-f93caa30d3cc admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:26.344491 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68344d7-f3c4-4e0d-b8af-f93caa30d3cc admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:26.400661 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a45d7f-23c3-45d9-819e-3371c83a4906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:26.401331 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a45d7f-23c3-45d9-819e-3371c83a4906 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:26.401614 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a45d7f-23c3-45d9-819e-3371c83a4906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:26.401890 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a45d7f-23c3-45d9-819e-3371c83a4906 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:26.402585 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a45d7f-23c3-45d9-819e-3371c83a4906 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:26.404943 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a45d7f-23c3-45d9-819e-3371c83a4906 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:26.478665 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1149/2302] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:45:26 2022] POST /identity/v3/users => generated 286 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:45:26.482761 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4248e8da-a836-4dad-a082-20afba4fbb6b admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:26.494227 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4248e8da-a836-4dad-a082-20afba4fbb6b admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:26.498954 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6aaa72-33f8-4c47-ac25-f6d98e29e2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:26.499651 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6aaa72-33f8-4c47-ac25-f6d98e29e2f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:26.499973 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6aaa72-33f8-4c47-ac25-f6d98e29e2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:26.500247 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6aaa72-33f8-4c47-ac25-f6d98e29e2f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:26.500986 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6aaa72-33f8-4c47-ac25-f6d98e29e2f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:26.503837 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6aaa72-33f8-4c47-ac25-f6d98e29e2f4 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:26.514585 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1154/2303] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:45:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:45:26.518932 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a45d7f-23c3-45d9-819e-3371c83a4906 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:26.528791 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a45d7f-23c3-45d9-819e-3371c83a4906 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:26.533613 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea406150-70f7-44df-9ddb-4c19eceb95f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:26.534267 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea406150-70f7-44df-9ddb-4c19eceb95f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:26.534550 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea406150-70f7-44df-9ddb-4c19eceb95f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:26.534827 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea406150-70f7-44df-9ddb-4c19eceb95f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:26.535574 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea406150-70f7-44df-9ddb-4c19eceb95f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:26.537153 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea406150-70f7-44df-9ddb-4c19eceb95f8 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:26.547853 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1150/2304] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:45:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:45:26.552653 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6aaa72-33f8-4c47-ac25-f6d98e29e2f4 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:26.562853 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6aaa72-33f8-4c47-ac25-f6d98e29e2f4 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:26.568456 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b78e4b8-fba9-42af-9681-c17c1125b2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:26.569330 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b78e4b8-fba9-42af-9681-c17c1125b2a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:26.569616 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b78e4b8-fba9-42af-9681-c17c1125b2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:26.569887 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b78e4b8-fba9-42af-9681-c17c1125b2a2 admin admin] PATH_INFO: `/v3/projects/8a0f38453c124777894b621c349bfeea/users/314f3aa73ca3498faf4269d6e0416d36/roles/0d41da7bec094450b5bff4e4831be52c` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:26.584210 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b78e4b8-fba9-42af-9681-c17c1125b2a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a0f38453c124777894b621c349bfeea, user_id=314f3aa73ca3498faf4269d6e0416d36, role_id=0d41da7bec094450b5bff4e4831be52c)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:26.586754 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b78e4b8-fba9-42af-9681-c17c1125b2a2 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:26.655627 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1155/2305] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:45:26 2022] PUT /identity/v3/projects/8a0f38453c124777894b621c349bfeea/users/314f3aa73ca3498faf4269d6e0416d36/roles/0d41da7bec094450b5bff4e4831be52c => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:45:26.669030 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8539e09d-2925-4829-bd80-8f6d00c30187 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:26.669406 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8539e09d-2925-4829-bd80-8f6d00c30187 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:26.669758 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8539e09d-2925-4829-bd80-8f6d00c30187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:26.698560 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-8539e09d-2925-4829-bd80-8f6d00c30187 None None] MFA Rules not processed for user `314f3aa73ca3498faf4269d6e0416d36`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:45:26.700018 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-8539e09d-2925-4829-bd80-8f6d00c30187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:26.771204 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1151/2306] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:45:26 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:45:26.782242 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b78e4b8-fba9-42af-9681-c17c1125b2a2 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:26.784742 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-1b78e4b8-fba9-42af-9681-c17c1125b2a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:26.853911 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b78e4b8-fba9-42af-9681-c17c1125b2a2 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:26.857938 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7791fdf-5e74-45c8-b38e-f91c9ceb2510 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '950b5b5f690d41509ead753065a0b793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:26.858615 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7791fdf-5e74-45c8-b38e-f91c9ceb2510 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:26.858925 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7791fdf-5e74-45c8-b38e-f91c9ceb2510 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:26.859204 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7791fdf-5e74-45c8-b38e-f91c9ceb2510 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:26.868560 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7791fdf-5e74-45c8-b38e-f91c9ceb2510 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:26.869951 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7791fdf-5e74-45c8-b38e-f91c9ceb2510 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:26.878631 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1156/2307] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:45:26 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:45:26.903905 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8539e09d-2925-4829-bd80-8f6d00c30187 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:26.966633 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8539e09d-2925-4829-bd80-8f6d00c30187 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:26.972282 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef59f2f1-09ff-4915-a940-4b93cb7423be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:26.973202 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59f2f1-09ff-4915-a940-4b93cb7423be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:26.973514 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59f2f1-09ff-4915-a940-4b93cb7423be admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:26.973792 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59f2f1-09ff-4915-a940-4b93cb7423be admin admin] PATH_INFO: `/v3/users/314f3aa73ca3498faf4269d6e0416d36` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:26.974993 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef59f2f1-09ff-4915-a940-4b93cb7423be admin admin] RBAC: Authorizing `identity:delete_user(user_id=314f3aa73ca3498faf4269d6e0416d36)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:26.976954 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef59f2f1-09ff-4915-a940-4b93cb7423be admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:27.125568 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-ef59f2f1-09ff-4915-a940-4b93cb7423be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '314f3aa73ca3498faf4269d6e0416d36'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:27.227115 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-ef59f2f1-09ff-4915-a940-4b93cb7423be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '314f3aa73ca3498faf4269d6e0416d36'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:27.235306 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-ef59f2f1-09ff-4915-a940-4b93cb7423be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '314f3aa73ca3498faf4269d6e0416d36'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:27.236709 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-ef59f2f1-09ff-4915-a940-4b93cb7423be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '314f3aa73ca3498faf4269d6e0416d36'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:27.248709 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-ef59f2f1-09ff-4915-a940-4b93cb7423be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '314f3aa73ca3498faf4269d6e0416d36'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:27.255450 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1152/2308] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:45:26 2022] DELETE /identity/v3/users/314f3aa73ca3498faf4269d6e0416d36 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:45:27.260114 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc272a9-1dd3-4769-82d9-cf2a63df8d0b None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:27.260583 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc272a9-1dd3-4769-82d9-cf2a63df8d0b None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:27.260675 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc272a9-1dd3-4769-82d9-cf2a63df8d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:27.278186 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-abc272a9-1dd3-4769-82d9-cf2a63df8d0b None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:45:27.279388 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-abc272a9-1dd3-4769-82d9-cf2a63df8d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:27.348688 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1157/2309] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:45:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:45:27.358096 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef59f2f1-09ff-4915-a940-4b93cb7423be admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:27.359535 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-ef59f2f1-09ff-4915-a940-4b93cb7423be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:27.415723 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef59f2f1-09ff-4915-a940-4b93cb7423be admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:27.419234 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6718f8-dfc8-4d03-8f09-7d0d44610926 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:27.419910 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6718f8-dfc8-4d03-8f09-7d0d44610926 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:27.420197 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6718f8-dfc8-4d03-8f09-7d0d44610926 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:27.420471 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6718f8-dfc8-4d03-8f09-7d0d44610926 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:27.430171 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6718f8-dfc8-4d03-8f09-7d0d44610926 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:27.431623 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6718f8-dfc8-4d03-8f09-7d0d44610926 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:27.441078 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1153/2310] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:45:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 16:45:27.863088 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc272a9-1dd3-4769-82d9-cf2a63df8d0b None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:27.865200 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-abc272a9-1dd3-4769-82d9-cf2a63df8d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:27.879313 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc272a9-1dd3-4769-82d9-cf2a63df8d0b None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:27.884661 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79464fd-b82f-4d3b-8788-4b0e1363996c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:27.885520 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79464fd-b82f-4d3b-8788-4b0e1363996c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:27.885804 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79464fd-b82f-4d3b-8788-4b0e1363996c admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:27.886158 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79464fd-b82f-4d3b-8788-4b0e1363996c admin admin] PATH_INFO: `/v3/projects/8a0f38453c124777894b621c349bfeea` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:27.887246 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79464fd-b82f-4d3b-8788-4b0e1363996c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a0f38453c124777894b621c349bfeea)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:27.889214 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79464fd-b82f-4d3b-8788-4b0e1363996c admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:27.987559 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e79464fd-b82f-4d3b-8788-4b0e1363996c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a0f38453c124777894b621c349bfeea', 'request_id': 'req-e79464fd-b82f-4d3b-8788-4b0e1363996c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:27.992740 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e79464fd-b82f-4d3b-8788-4b0e1363996c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a0f38453c124777894b621c349bfeea', 'request_id': 'req-e79464fd-b82f-4d3b-8788-4b0e1363996c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:28.059431 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e79464fd-b82f-4d3b-8788-4b0e1363996c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a0f38453c124777894b621c349bfeea', 'request_id': 'req-e79464fd-b82f-4d3b-8788-4b0e1363996c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:28.070931 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e79464fd-b82f-4d3b-8788-4b0e1363996c admin admin] The token cache is being invalidate because project 8a0f38453c124777894b621c349bfeea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:45:28.071220 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e79464fd-b82f-4d3b-8788-4b0e1363996c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:28.071876 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e79464fd-b82f-4d3b-8788-4b0e1363996c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:28.073398 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1158/2311] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:45:27 2022] DELETE /identity/v3/projects/8a0f38453c124777894b621c349bfeea => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:45:46.112760 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6718f8-dfc8-4d03-8f09-7d0d44610926 service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:46.114156 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-df6718f8-dfc8-4d03-8f09-7d0d44610926 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:46.127490 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6718f8-dfc8-4d03-8f09-7d0d44610926 service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:46.196860 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc7c92d-f926-459c-b880-57db9f681897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:46.197891 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7c92d-f926-459c-b880-57db9f681897 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:46.198449 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7c92d-f926-459c-b880-57db9f681897 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:46.199360 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7c92d-f926-459c-b880-57db9f681897 admin admin] PATH_INFO: `/v3/users/57d8ff5419884d2c93027c5f1f692511` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:46.201122 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc7c92d-f926-459c-b880-57db9f681897 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57d8ff5419884d2c93027c5f1f692511)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:46.203306 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc7c92d-f926-459c-b880-57db9f681897 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:46.401442 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-9cc7c92d-f926-459c-b880-57db9f681897 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57d8ff5419884d2c93027c5f1f692511'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:46.466926 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-9cc7c92d-f926-459c-b880-57db9f681897 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57d8ff5419884d2c93027c5f1f692511'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:46.481064 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-9cc7c92d-f926-459c-b880-57db9f681897 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57d8ff5419884d2c93027c5f1f692511'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:46.486701 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-9cc7c92d-f926-459c-b880-57db9f681897 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57d8ff5419884d2c93027c5f1f692511'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:46.506129 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-9cc7c92d-f926-459c-b880-57db9f681897 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57d8ff5419884d2c93027c5f1f692511'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:46.512303 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1154/2312] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:45:46 2022] DELETE /identity/v3/users/57d8ff5419884d2c93027c5f1f692511 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:45:46.518725 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e685f97-6610-45c2-b12e-717727c9a826 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:46.519287 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e685f97-6610-45c2-b12e-717727c9a826 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:46.519287 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e685f97-6610-45c2-b12e-717727c9a826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:46.539237 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-6e685f97-6610-45c2-b12e-717727c9a826 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:45:46.540441 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-6e685f97-6610-45c2-b12e-717727c9a826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:46.616308 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1159/2313] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:45:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:45:46.628642 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc7c92d-f926-459c-b880-57db9f681897 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:46.630101 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-9cc7c92d-f926-459c-b880-57db9f681897 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:46.704746 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc7c92d-f926-459c-b880-57db9f681897 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:46.710498 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9f4d71-62a3-4418-94fb-6043e5e16033 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:46.711544 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f4d71-62a3-4418-94fb-6043e5e16033 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:46.712038 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f4d71-62a3-4418-94fb-6043e5e16033 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:46.712503 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f4d71-62a3-4418-94fb-6043e5e16033 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:46.725069 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9f4d71-62a3-4418-94fb-6043e5e16033 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:46.727864 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9f4d71-62a3-4418-94fb-6043e5e16033 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:46.740408 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1155/2314] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:45:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:45:47.176093 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e685f97-6610-45c2-b12e-717727c9a826 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:47.178054 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-6e685f97-6610-45c2-b12e-717727c9a826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:47.193966 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e685f97-6610-45c2-b12e-717727c9a826 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:47.199162 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f74287-6001-43f0-b890-d8643dee4e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:47.200077 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f74287-6001-43f0-b890-d8643dee4e1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:47.201148 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f74287-6001-43f0-b890-d8643dee4e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:47.201148 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f74287-6001-43f0-b890-d8643dee4e1a admin admin] PATH_INFO: `/v3/projects/69ec57643c3740838934c64f98affdf3` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:47.202854 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f74287-6001-43f0-b890-d8643dee4e1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=69ec57643c3740838934c64f98affdf3)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:47.205273 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f74287-6001-43f0-b890-d8643dee4e1a admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:47.347495 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-d4f74287-6001-43f0-b890-d8643dee4e1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69ec57643c3740838934c64f98affdf3', 'request_id': 'req-d4f74287-6001-43f0-b890-d8643dee4e1a'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:47.360351 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-d4f74287-6001-43f0-b890-d8643dee4e1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69ec57643c3740838934c64f98affdf3', 'request_id': 'req-d4f74287-6001-43f0-b890-d8643dee4e1a'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:47.432111 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-d4f74287-6001-43f0-b890-d8643dee4e1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69ec57643c3740838934c64f98affdf3', 'request_id': 'req-d4f74287-6001-43f0-b890-d8643dee4e1a'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:47.444287 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-d4f74287-6001-43f0-b890-d8643dee4e1a admin admin] The token cache is being invalidate because project 69ec57643c3740838934c64f98affdf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:45:47.444577 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-d4f74287-6001-43f0-b890-d8643dee4e1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:47.445239 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-d4f74287-6001-43f0-b890-d8643dee4e1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:47.446782 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1160/2315] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:45:47 2022] DELETE /identity/v3/projects/69ec57643c3740838934c64f98affdf3 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:45:47.451314 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9f4d71-62a3-4418-94fb-6043e5e16033 service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:47.463033 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9f4d71-62a3-4418-94fb-6043e5e16033 service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:47.558582 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813dd418-1597-4fcd-a716-b24584b9ae84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:47.559975 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813dd418-1597-4fcd-a716-b24584b9ae84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:47.560391 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813dd418-1597-4fcd-a716-b24584b9ae84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:47.561109 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813dd418-1597-4fcd-a716-b24584b9ae84 admin admin] PATH_INFO: `/v3/users/bc22609f0b694bdcabd5884b806d27e3` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:47.562844 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813dd418-1597-4fcd-a716-b24584b9ae84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc22609f0b694bdcabd5884b806d27e3)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:47.566138 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813dd418-1597-4fcd-a716-b24584b9ae84 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:47.763869 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-813dd418-1597-4fcd-a716-b24584b9ae84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc22609f0b694bdcabd5884b806d27e3'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:47.854626 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-813dd418-1597-4fcd-a716-b24584b9ae84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc22609f0b694bdcabd5884b806d27e3'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:47.867987 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-813dd418-1597-4fcd-a716-b24584b9ae84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc22609f0b694bdcabd5884b806d27e3'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:47.869048 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-813dd418-1597-4fcd-a716-b24584b9ae84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc22609f0b694bdcabd5884b806d27e3'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:47.887366 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-813dd418-1597-4fcd-a716-b24584b9ae84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc22609f0b694bdcabd5884b806d27e3'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:47.896708 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1156/2316] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:45:47 2022] DELETE /identity/v3/users/bc22609f0b694bdcabd5884b806d27e3 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:45:48.424771 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f74287-6001-43f0-b890-d8643dee4e1a admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:48.427087 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-d4f74287-6001-43f0-b890-d8643dee4e1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:48.453390 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f74287-6001-43f0-b890-d8643dee4e1a admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:48.532368 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dcf1e8-d10d-465f-bbfc-4139d2c9604e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:48.532368 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dcf1e8-d10d-465f-bbfc-4139d2c9604e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:48.532368 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dcf1e8-d10d-465f-bbfc-4139d2c9604e admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:48.532799 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dcf1e8-d10d-465f-bbfc-4139d2c9604e admin admin] PATH_INFO: `/v3/projects/db2578437068425db25793b646410dfa` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:48.534143 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dcf1e8-d10d-465f-bbfc-4139d2c9604e admin admin] RBAC: Authorizing `identity:delete_project(project_id=db2578437068425db25793b646410dfa)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:48.536355 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dcf1e8-d10d-465f-bbfc-4139d2c9604e admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:48.689830 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-76dcf1e8-d10d-465f-bbfc-4139d2c9604e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db2578437068425db25793b646410dfa', 'request_id': 'req-76dcf1e8-d10d-465f-bbfc-4139d2c9604e'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:48.695682 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-76dcf1e8-d10d-465f-bbfc-4139d2c9604e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db2578437068425db25793b646410dfa', 'request_id': 'req-76dcf1e8-d10d-465f-bbfc-4139d2c9604e'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:48.788526 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-76dcf1e8-d10d-465f-bbfc-4139d2c9604e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db2578437068425db25793b646410dfa', 'request_id': 'req-76dcf1e8-d10d-465f-bbfc-4139d2c9604e'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:48.801467 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-76dcf1e8-d10d-465f-bbfc-4139d2c9604e admin admin] The token cache is being invalidate because project db2578437068425db25793b646410dfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:45:48.806822 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-76dcf1e8-d10d-465f-bbfc-4139d2c9604e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:48.806822 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-76dcf1e8-d10d-465f-bbfc-4139d2c9604e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:45:48.806822 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1161/2317] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:45:48 2022] DELETE /identity/v3/projects/db2578437068425db25793b646410dfa => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:45:48.812365 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa423c-53ff-47e9-a0bc-b8a5df403ce8 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:48.812995 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa423c-53ff-47e9-a0bc-b8a5df403ce8 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:48.812995 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa423c-53ff-47e9-a0bc-b8a5df403ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:48.834751 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-96aa423c-53ff-47e9-a0bc-b8a5df403ce8 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:45:48.836019 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-96aa423c-53ff-47e9-a0bc-b8a5df403ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:48.901371 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1157/2318] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:45:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:45:48.910496 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb6686-12bb-4399-842a-b53f0356b48c None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:48.910781 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb6686-12bb-4399-842a-b53f0356b48c None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:48.911053 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb6686-12bb-4399-842a-b53f0356b48c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:48.930703 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-5ffb6686-12bb-4399-842a-b53f0356b48c None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:45:48.931960 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-5ffb6686-12bb-4399-842a-b53f0356b48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:48.940117 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1162/2319] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:45:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:45:48.944756 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aa423c-53ff-47e9-a0bc-b8a5df403ce8 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:48.955276 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aa423c-53ff-47e9-a0bc-b8a5df403ce8 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:48.959927 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ca86c8-d565-4c7e-89d2-0077eafbf688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:48.960598 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca86c8-d565-4c7e-89d2-0077eafbf688 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:48.960907 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca86c8-d565-4c7e-89d2-0077eafbf688 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:48.961181 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca86c8-d565-4c7e-89d2-0077eafbf688 admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:48.961923 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ca86c8-d565-4c7e-89d2-0077eafbf688 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:45:48.962222 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ca86c8-d565-4c7e-89d2-0077eafbf688 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:48.963859 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ca86c8-d565-4c7e-89d2-0077eafbf688 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:48.981520 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1158/2320] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Apr 11 16:45:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:45:48.982651 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb6686-12bb-4399-842a-b53f0356b48c None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:48.992644 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb6686-12bb-4399-842a-b53f0356b48c None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:48.999112 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa782018-e30c-4625-953e-33f7d96148f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:48.999494 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa782018-e30c-4625-953e-33f7d96148f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:49.000005 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa782018-e30c-4625-953e-33f7d96148f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:49.000994 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa782018-e30c-4625-953e-33f7d96148f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:49.002491 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa782018-e30c-4625-953e-33f7d96148f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:49.004555 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa782018-e30c-4625-953e-33f7d96148f6 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:49.135636 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1163/2321] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:45:48 2022] POST /identity/v3/projects => generated 365 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:45:49.140106 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ca86c8-d565-4c7e-89d2-0077eafbf688 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:49.152114 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ca86c8-d565-4c7e-89d2-0077eafbf688 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:49.215817 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6728fd-c459-43de-a51d-94c3bf4f4df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:49.215959 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6728fd-c459-43de-a51d-94c3bf4f4df8 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:49.216161 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6728fd-c459-43de-a51d-94c3bf4f4df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:49.216432 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6728fd-c459-43de-a51d-94c3bf4f4df8 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:49.217128 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6728fd-c459-43de-a51d-94c3bf4f4df8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:49.219149 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6728fd-c459-43de-a51d-94c3bf4f4df8 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:49.374067 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1159/2322] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:45:49 2022] POST /identity/v3/users => generated 283 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:45:49.375480 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa782018-e30c-4625-953e-33f7d96148f6 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:49.386483 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa782018-e30c-4625-953e-33f7d96148f6 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:49.391113 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b3dfd3-a9ab-48f5-90e6-c99a8c2e69f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:49.391816 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b3dfd3-a9ab-48f5-90e6-c99a8c2e69f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:49.392102 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b3dfd3-a9ab-48f5-90e6-c99a8c2e69f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:49.392385 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b3dfd3-a9ab-48f5-90e6-c99a8c2e69f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:49.393126 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b3dfd3-a9ab-48f5-90e6-c99a8c2e69f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:49.394727 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b3dfd3-a9ab-48f5-90e6-c99a8c2e69f4 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:49.405639 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1164/2323] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:45:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:45:49.410410 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6728fd-c459-43de-a51d-94c3bf4f4df8 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:49.420816 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6728fd-c459-43de-a51d-94c3bf4f4df8 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:49.426311 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f133c7ad-077a-4bb2-9fbc-752e0f42c238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:49.426986 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f133c7ad-077a-4bb2-9fbc-752e0f42c238 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:49.427275 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f133c7ad-077a-4bb2-9fbc-752e0f42c238 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:49.427593 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f133c7ad-077a-4bb2-9fbc-752e0f42c238 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:49.428587 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f133c7ad-077a-4bb2-9fbc-752e0f42c238 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:49.430197 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f133c7ad-077a-4bb2-9fbc-752e0f42c238 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:49.441646 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1160/2324] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:45:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:45:49.445706 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b3dfd3-a9ab-48f5-90e6-c99a8c2e69f4 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:49.456267 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b3dfd3-a9ab-48f5-90e6-c99a8c2e69f4 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:49.460948 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdd70a9-fd8b-4ca8-9d49-ff28eea97c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:49.461826 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd70a9-fd8b-4ca8-9d49-ff28eea97c7f admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:49.462107 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd70a9-fd8b-4ca8-9d49-ff28eea97c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:49.462384 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd70a9-fd8b-4ca8-9d49-ff28eea97c7f admin admin] PATH_INFO: `/v3/projects/b74e814587c44da6aa5b600dc31d2d47/users/2dd4240a5ee946e8a9cab4878c897380/roles/0d41da7bec094450b5bff4e4831be52c` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:49.478159 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdd70a9-fd8b-4ca8-9d49-ff28eea97c7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b74e814587c44da6aa5b600dc31d2d47, user_id=2dd4240a5ee946e8a9cab4878c897380, role_id=0d41da7bec094450b5bff4e4831be52c)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:49.480834 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdd70a9-fd8b-4ca8-9d49-ff28eea97c7f admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:49.665693 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1165/2325] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:45:49 2022] PUT /identity/v3/projects/b74e814587c44da6aa5b600dc31d2d47/users/2dd4240a5ee946e8a9cab4878c897380/roles/0d41da7bec094450b5bff4e4831be52c => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:45:49.676003 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f5a4cd-0f82-4545-a3e5-31eb801fa695 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:49.683207 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f5a4cd-0f82-4545-a3e5-31eb801fa695 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:49.683207 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f5a4cd-0f82-4545-a3e5-31eb801fa695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:49.702948 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-11f5a4cd-0f82-4545-a3e5-31eb801fa695 None None] MFA Rules not processed for user `2dd4240a5ee946e8a9cab4878c897380`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:45:49.704726 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-11f5a4cd-0f82-4545-a3e5-31eb801fa695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:49.775307 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1161/2326] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:45:49 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:45:49.779950 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdd70a9-fd8b-4ca8-9d49-ff28eea97c7f admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:49.846240 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdd70a9-fd8b-4ca8-9d49-ff28eea97c7f admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:49.852730 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc62a5b-6f80-4659-80a4-4fea0fcbd815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:49.853413 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc62a5b-6f80-4659-80a4-4fea0fcbd815 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:49.853699 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc62a5b-6f80-4659-80a4-4fea0fcbd815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:49.853976 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc62a5b-6f80-4659-80a4-4fea0fcbd815 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:49.854675 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc62a5b-6f80-4659-80a4-4fea0fcbd815 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:49.856613 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc62a5b-6f80-4659-80a4-4fea0fcbd815 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:49.991624 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1166/2327] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:45:49 2022] POST /identity/v3/projects => generated 365 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:45:49.992776 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f5a4cd-0f82-4545-a3e5-31eb801fa695 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:50.005331 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f5a4cd-0f82-4545-a3e5-31eb801fa695 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:50.070111 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa683118-da20-4b53-97fc-68ed839ed3c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:50.070838 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa683118-da20-4b53-97fc-68ed839ed3c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:50.071119 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa683118-da20-4b53-97fc-68ed839ed3c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:50.071392 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa683118-da20-4b53-97fc-68ed839ed3c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:50.072122 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa683118-da20-4b53-97fc-68ed839ed3c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:50.074048 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa683118-da20-4b53-97fc-68ed839ed3c6 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:50.161004 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1162/2328] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:45:49 2022] POST /identity/v3/users => generated 289 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:45:50.165035 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc62a5b-6f80-4659-80a4-4fea0fcbd815 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:50.177047 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc62a5b-6f80-4659-80a4-4fea0fcbd815 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:50.181998 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eaeda2-445d-44b9-bd0e-75791fc527ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:50.182756 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eaeda2-445d-44b9-bd0e-75791fc527ab admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:50.183806 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eaeda2-445d-44b9-bd0e-75791fc527ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:50.183806 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eaeda2-445d-44b9-bd0e-75791fc527ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:50.184232 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eaeda2-445d-44b9-bd0e-75791fc527ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:50.185827 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eaeda2-445d-44b9-bd0e-75791fc527ab admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:50.202048 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1167/2329] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:45:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 16:45:50.203197 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa683118-da20-4b53-97fc-68ed839ed3c6 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:50.214627 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa683118-da20-4b53-97fc-68ed839ed3c6 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:50.220377 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8896cb-06b4-4600-8a6d-9a1753d134c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:50.221704 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8896cb-06b4-4600-8a6d-9a1753d134c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:50.221704 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8896cb-06b4-4600-8a6d-9a1753d134c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:50.222049 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8896cb-06b4-4600-8a6d-9a1753d134c6 admin admin] PATH_INFO: `/v3/projects/be25873455a24e2abf306d6232ea843f/users/92ea9996ef394a2faea679081f25e20e/roles/702e5e78b5d744529384b96a390ae92f` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:50.239656 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8896cb-06b4-4600-8a6d-9a1753d134c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be25873455a24e2abf306d6232ea843f, user_id=92ea9996ef394a2faea679081f25e20e, role_id=702e5e78b5d744529384b96a390ae92f)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:50.243285 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8896cb-06b4-4600-8a6d-9a1753d134c6 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:50.324190 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1163/2330] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:45:50 2022] PUT /identity/v3/projects/be25873455a24e2abf306d6232ea843f/users/92ea9996ef394a2faea679081f25e20e/roles/702e5e78b5d744529384b96a390ae92f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:45:50.328194 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eaeda2-445d-44b9-bd0e-75791fc527ab admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:50.339054 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eaeda2-445d-44b9-bd0e-75791fc527ab admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:50.393736 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f097941e-659c-4e0c-a6af-de148c4b9f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:50.394406 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f097941e-659c-4e0c-a6af-de148c4b9f36 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:50.394687 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f097941e-659c-4e0c-a6af-de148c4b9f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:50.394958 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f097941e-659c-4e0c-a6af-de148c4b9f36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:50.395830 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f097941e-659c-4e0c-a6af-de148c4b9f36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:50.397409 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f097941e-659c-4e0c-a6af-de148c4b9f36 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:50.408842 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1168/2331] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:45:50 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:45:50.413129 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8896cb-06b4-4600-8a6d-9a1753d134c6 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:50.423664 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8896cb-06b4-4600-8a6d-9a1753d134c6 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:50.428783 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f007dd-4232-45c6-826c-d00dd42daae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:50.429679 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f007dd-4232-45c6-826c-d00dd42daae1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:50.429966 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f007dd-4232-45c6-826c-d00dd42daae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:50.430248 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f007dd-4232-45c6-826c-d00dd42daae1 admin admin] PATH_INFO: `/v3/projects/be25873455a24e2abf306d6232ea843f/users/92ea9996ef394a2faea679081f25e20e/roles/702e5e78b5d744529384b96a390ae92f` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:50.432260 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f007dd-4232-45c6-826c-d00dd42daae1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be25873455a24e2abf306d6232ea843f, user_id=92ea9996ef394a2faea679081f25e20e, role_id=702e5e78b5d744529384b96a390ae92f)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:50.434889 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f007dd-4232-45c6-826c-d00dd42daae1 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:50.445713 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1164/2332] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:45:50 2022] PUT /identity/v3/projects/be25873455a24e2abf306d6232ea843f/users/92ea9996ef394a2faea679081f25e20e/roles/702e5e78b5d744529384b96a390ae92f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:45:50.457911 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecfeced-f289-4f6f-9287-4fef0f129289 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:50.458417 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecfeced-f289-4f6f-9287-4fef0f129289 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:50.458417 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecfeced-f289-4f6f-9287-4fef0f129289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:50.486258 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-0ecfeced-f289-4f6f-9287-4fef0f129289 None None] MFA Rules not processed for user `92ea9996ef394a2faea679081f25e20e`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:45:50.487534 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0ecfeced-f289-4f6f-9287-4fef0f129289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:50.571399 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1169/2333] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:45:50 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:45:50.583722 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f007dd-4232-45c6-826c-d00dd42daae1 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:50.585510 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-44f007dd-4232-45c6-826c-d00dd42daae1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:50.640258 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f007dd-4232-45c6-826c-d00dd42daae1 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:50.645160 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5868106b-1624-4e69-8852-bb69305c3f3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '950b5b5f690d41509ead753065a0b793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:50.645844 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5868106b-1624-4e69-8852-bb69305c3f3a service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:50.646128 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5868106b-1624-4e69-8852-bb69305c3f3a service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:50.646405 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5868106b-1624-4e69-8852-bb69305c3f3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:50.655668 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5868106b-1624-4e69-8852-bb69305c3f3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:50.657755 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5868106b-1624-4e69-8852-bb69305c3f3a service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:50.667302 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1165/2334] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:45:50 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:45:50.888691 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecfeced-f289-4f6f-9287-4fef0f129289 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:50.899478 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecfeced-f289-4f6f-9287-4fef0f129289 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:50.903662 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad54767-b198-4643-9f12-696627333c3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '950b5b5f690d41509ead753065a0b793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:50.904422 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad54767-b198-4643-9f12-696627333c3d service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:50.904815 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad54767-b198-4643-9f12-696627333c3d service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:50.913073 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad54767-b198-4643-9f12-696627333c3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:50.962864 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad54767-b198-4643-9f12-696627333c3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:50.964340 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad54767-b198-4643-9f12-696627333c3d service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:50.974059 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1170/2335] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:45:50 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:46:09.527336 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5868106b-1624-4e69-8852-bb69305c3f3a service cinder] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:46:09.600473 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5868106b-1624-4e69-8852-bb69305c3f3a service cinder] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:46:09.605007 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cefcad-439d-4075-9b4f-27f55fe97c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:46:09.605879 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cefcad-439d-4075-9b4f-27f55fe97c37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:09.606160 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cefcad-439d-4075-9b4f-27f55fe97c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:09.606435 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cefcad-439d-4075-9b4f-27f55fe97c37 admin admin] PATH_INFO: `/v3/users/2dd4240a5ee946e8a9cab4878c897380` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:09.607684 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cefcad-439d-4075-9b4f-27f55fe97c37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2dd4240a5ee946e8a9cab4878c897380)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:46:09.609595 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cefcad-439d-4075-9b4f-27f55fe97c37 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:46:09.798991 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-68cefcad-439d-4075-9b4f-27f55fe97c37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2dd4240a5ee946e8a9cab4878c897380'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:46:09.881554 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-68cefcad-439d-4075-9b4f-27f55fe97c37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2dd4240a5ee946e8a9cab4878c897380'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:46:09.889144 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-68cefcad-439d-4075-9b4f-27f55fe97c37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2dd4240a5ee946e8a9cab4878c897380'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:46:09.889817 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-68cefcad-439d-4075-9b4f-27f55fe97c37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2dd4240a5ee946e8a9cab4878c897380'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:46:09.902841 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-68cefcad-439d-4075-9b4f-27f55fe97c37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2dd4240a5ee946e8a9cab4878c897380'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:46:09.909787 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1166/2336] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:46:09 2022] DELETE /identity/v3/users/2dd4240a5ee946e8a9cab4878c897380 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:46:09.914777 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c62441-8622-4ddb-a9b2-a774872bb230 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:09.915352 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c62441-8622-4ddb-a9b2-a774872bb230 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:09.915352 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c62441-8622-4ddb-a9b2-a774872bb230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:09.948816 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-a3c62441-8622-4ddb-a9b2-a774872bb230 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:46:09.950306 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a3c62441-8622-4ddb-a9b2-a774872bb230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:46:10.018228 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1171/2337] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:46:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:46:10.026674 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cefcad-439d-4075-9b4f-27f55fe97c37 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:46:10.028153 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-68cefcad-439d-4075-9b4f-27f55fe97c37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:46:10.093482 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cefcad-439d-4075-9b4f-27f55fe97c37 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:46:10.098607 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9827f53c-931b-44ad-82af-049675e057a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:46:10.099268 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827f53c-931b-44ad-82af-049675e057a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:10.099579 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827f53c-931b-44ad-82af-049675e057a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:10.099909 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827f53c-931b-44ad-82af-049675e057a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:10.110134 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9827f53c-931b-44ad-82af-049675e057a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:46:10.111838 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9827f53c-931b-44ad-82af-049675e057a4 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:46:10.121501 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1167/2338] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:46:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:46:10.724171 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c62441-8622-4ddb-a9b2-a774872bb230 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:46:10.725727 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a3c62441-8622-4ddb-a9b2-a774872bb230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:46:10.776039 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c62441-8622-4ddb-a9b2-a774872bb230 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:46:10.780031 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb0ab96-763f-41c4-a12b-c8d0a440208d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:46:10.780996 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0ab96-763f-41c4-a12b-c8d0a440208d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:10.781379 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0ab96-763f-41c4-a12b-c8d0a440208d admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:10.781744 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0ab96-763f-41c4-a12b-c8d0a440208d admin admin] PATH_INFO: `/v3/projects/b74e814587c44da6aa5b600dc31d2d47` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:10.783723 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb0ab96-763f-41c4-a12b-c8d0a440208d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b74e814587c44da6aa5b600dc31d2d47)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:46:10.785774 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb0ab96-763f-41c4-a12b-c8d0a440208d admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:46:10.934562 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-adb0ab96-763f-41c4-a12b-c8d0a440208d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b74e814587c44da6aa5b600dc31d2d47', 'request_id': 'req-adb0ab96-763f-41c4-a12b-c8d0a440208d'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:46:10.941581 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-adb0ab96-763f-41c4-a12b-c8d0a440208d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b74e814587c44da6aa5b600dc31d2d47', 'request_id': 'req-adb0ab96-763f-41c4-a12b-c8d0a440208d'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:46:11.037171 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-adb0ab96-763f-41c4-a12b-c8d0a440208d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b74e814587c44da6aa5b600dc31d2d47', 'request_id': 'req-adb0ab96-763f-41c4-a12b-c8d0a440208d'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:46:11.055538 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-adb0ab96-763f-41c4-a12b-c8d0a440208d admin admin] The token cache is being invalidate because project b74e814587c44da6aa5b600dc31d2d47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:46:11.055843 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-adb0ab96-763f-41c4-a12b-c8d0a440208d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:46:11.060045 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-adb0ab96-763f-41c4-a12b-c8d0a440208d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:46:11.062832 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1172/2339] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:46:10 2022] DELETE /identity/v3/projects/b74e814587c44da6aa5b600dc31d2d47 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:46:11.068717 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9827f53c-931b-44ad-82af-049675e057a4 service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:46:11.086023 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9827f53c-931b-44ad-82af-049675e057a4 service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:46:11.184365 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2694b7b4-9c4d-46ae-91e6-5289beea2364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:46:11.185604 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2694b7b4-9c4d-46ae-91e6-5289beea2364 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:11.185954 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2694b7b4-9c4d-46ae-91e6-5289beea2364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:11.186317 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2694b7b4-9c4d-46ae-91e6-5289beea2364 admin admin] PATH_INFO: `/v3/users/92ea9996ef394a2faea679081f25e20e` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:11.187723 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2694b7b4-9c4d-46ae-91e6-5289beea2364 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92ea9996ef394a2faea679081f25e20e)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:46:11.190373 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2694b7b4-9c4d-46ae-91e6-5289beea2364 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:46:11.411939 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-2694b7b4-9c4d-46ae-91e6-5289beea2364 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92ea9996ef394a2faea679081f25e20e'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:46:11.518217 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-2694b7b4-9c4d-46ae-91e6-5289beea2364 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92ea9996ef394a2faea679081f25e20e'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:46:11.534529 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-2694b7b4-9c4d-46ae-91e6-5289beea2364 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92ea9996ef394a2faea679081f25e20e'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:46:11.535620 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-2694b7b4-9c4d-46ae-91e6-5289beea2364 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92ea9996ef394a2faea679081f25e20e'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:46:11.554459 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-2694b7b4-9c4d-46ae-91e6-5289beea2364 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92ea9996ef394a2faea679081f25e20e'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:46:11.566394 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1168/2340] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:46:11 2022] DELETE /identity/v3/users/92ea9996ef394a2faea679081f25e20e => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:46:12.127205 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb0ab96-763f-41c4-a12b-c8d0a440208d admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:46:12.128731 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-adb0ab96-763f-41c4-a12b-c8d0a440208d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:46:12.147123 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb0ab96-763f-41c4-a12b-c8d0a440208d admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:46:12.167409 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2694b7b4-9c4d-46ae-91e6-5289beea2364 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:46:12.168974 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-2694b7b4-9c4d-46ae-91e6-5289beea2364 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:46:12.233435 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7742c7ba-cd6c-429a-b046-04e969868dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:46:12.233435 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742c7ba-cd6c-429a-b046-04e969868dce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:12.233435 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742c7ba-cd6c-429a-b046-04e969868dce admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:12.233435 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742c7ba-cd6c-429a-b046-04e969868dce admin admin] PATH_INFO: `/v3/users/891f682cfa5d49aca7ef7864a0fca2e5` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:12.233848 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7742c7ba-cd6c-429a-b046-04e969868dce admin admin] RBAC: Authorizing `identity:delete_user(user_id=891f682cfa5d49aca7ef7864a0fca2e5)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:46:12.233848 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7742c7ba-cd6c-429a-b046-04e969868dce admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:46:12.260029 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2694b7b4-9c4d-46ae-91e6-5289beea2364 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:46:12.267990 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d927c9f-71cc-4a05-a169-cf68344c1d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:46:12.267990 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d927c9f-71cc-4a05-a169-cf68344c1d67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:12.267990 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d927c9f-71cc-4a05-a169-cf68344c1d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:12.267990 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d927c9f-71cc-4a05-a169-cf68344c1d67 admin admin] PATH_INFO: `/v3/projects/be25873455a24e2abf306d6232ea843f` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:12.268534 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d927c9f-71cc-4a05-a169-cf68344c1d67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be25873455a24e2abf306d6232ea843f)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:46:12.269793 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d927c9f-71cc-4a05-a169-cf68344c1d67 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:46:12.485657 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-7742c7ba-cd6c-429a-b046-04e969868dce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '891f682cfa5d49aca7ef7864a0fca2e5'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:46:12.486296 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-3d927c9f-71cc-4a05-a169-cf68344c1d67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be25873455a24e2abf306d6232ea843f', 'request_id': 'req-3d927c9f-71cc-4a05-a169-cf68344c1d67'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:46:12.486412 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-7742c7ba-cd6c-429a-b046-04e969868dce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '891f682cfa5d49aca7ef7864a0fca2e5'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:46:12.574193 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-7742c7ba-cd6c-429a-b046-04e969868dce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '891f682cfa5d49aca7ef7864a0fca2e5'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:46:12.583137 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-7742c7ba-cd6c-429a-b046-04e969868dce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '891f682cfa5d49aca7ef7864a0fca2e5'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:46:12.594708 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-7742c7ba-cd6c-429a-b046-04e969868dce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '891f682cfa5d49aca7ef7864a0fca2e5'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:46:12.601200 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1173/2341] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:46:12 2022] DELETE /identity/v3/users/891f682cfa5d49aca7ef7864a0fca2e5 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:46:12.602623 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19818bf-fe35-4e10-aecc-162a2bd6d119 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:12.602910 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19818bf-fe35-4e10-aecc-162a2bd6d119 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:12.603208 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19818bf-fe35-4e10-aecc-162a2bd6d119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:12.622006 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-d19818bf-fe35-4e10-aecc-162a2bd6d119 None None] MFA Rules not processed for user `975273630f7e4852848335d674693ea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:46:12.623334 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-d19818bf-fe35-4e10-aecc-162a2bd6d119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:46:12.626296 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-3d927c9f-71cc-4a05-a169-cf68344c1d67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be25873455a24e2abf306d6232ea843f', 'request_id': 'req-3d927c9f-71cc-4a05-a169-cf68344c1d67'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:46:12.632731 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-3d927c9f-71cc-4a05-a169-cf68344c1d67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be25873455a24e2abf306d6232ea843f', 'request_id': 'req-3d927c9f-71cc-4a05-a169-cf68344c1d67'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:46:12.645128 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-3d927c9f-71cc-4a05-a169-cf68344c1d67 admin admin] The token cache is being invalidate because project be25873455a24e2abf306d6232ea843f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:46:12.645413 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-3d927c9f-71cc-4a05-a169-cf68344c1d67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:46:12.646141 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-3d927c9f-71cc-4a05-a169-cf68344c1d67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:46:12.647789 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1169/2342] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:46:12 2022] DELETE /identity/v3/projects/be25873455a24e2abf306d6232ea843f => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:46:12.651884 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d927c9f-71cc-4a05-a169-cf68344c1d67 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:46:12.653220 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-3d927c9f-71cc-4a05-a169-cf68344c1d67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:46:12.680880 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1174/2343] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:46:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:46:12.682773 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa67ab-b87c-4175-b90f-e866cfa9df4a None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:12.683226 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa67ab-b87c-4175-b90f-e866cfa9df4a None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:12.683699 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa67ab-b87c-4175-b90f-e866cfa9df4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:12.705991 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-56fa67ab-b87c-4175-b90f-e866cfa9df4a None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:46:12.707230 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-56fa67ab-b87c-4175-b90f-e866cfa9df4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:46:12.726441 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d927c9f-71cc-4a05-a169-cf68344c1d67 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:46:12.778545 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1175/2344] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:46:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:46:12.780032 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d404cef9-d7f5-46c3-989d-ae04c45933eb None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:12.780366 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d404cef9-d7f5-46c3-989d-ae04c45933eb None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:12.780602 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d404cef9-d7f5-46c3-989d-ae04c45933eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:12.820304 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de174f40-d097-45c1-b5e0-116d0e205c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:46:12.821271 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de174f40-d097-45c1-b5e0-116d0e205c63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:12.821560 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de174f40-d097-45c1-b5e0-116d0e205c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:12.821844 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de174f40-d097-45c1-b5e0-116d0e205c63 admin admin] PATH_INFO: `/v3/users/95e5461dea804c72be04fe66b221e19c` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:12.823284 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de174f40-d097-45c1-b5e0-116d0e205c63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95e5461dea804c72be04fe66b221e19c)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:46:12.825513 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de174f40-d097-45c1-b5e0-116d0e205c63 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:46:12.828149 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-d404cef9-d7f5-46c3-989d-ae04c45933eb None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:46:12.829563 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-d404cef9-d7f5-46c3-989d-ae04c45933eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:46:12.838283 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1176/2345] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:46:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:46:12.839119 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d404cef9-d7f5-46c3-989d-ae04c45933eb None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:46:12.840432 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-d404cef9-d7f5-46c3-989d-ae04c45933eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:46:12.899855 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d404cef9-d7f5-46c3-989d-ae04c45933eb None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:46:12.903708 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c883af-d6bb-444f-aca5-866679469174 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:46:12.904483 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c883af-d6bb-444f-aca5-866679469174 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:12.904770 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c883af-d6bb-444f-aca5-866679469174 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:12.905047 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c883af-d6bb-444f-aca5-866679469174 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:12.915459 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c883af-d6bb-444f-aca5-866679469174 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:46:12.916920 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c883af-d6bb-444f-aca5-866679469174 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:46:12.928294 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1177/2346] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:46:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:46:12.930843 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32afda05-c446-4e9b-ac4e-0062c9f0020a None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:12.930843 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32afda05-c446-4e9b-ac4e-0062c9f0020a None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:12.930843 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32afda05-c446-4e9b-ac4e-0062c9f0020a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:12.962303 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-32afda05-c446-4e9b-ac4e-0062c9f0020a None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:46:12.963742 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-32afda05-c446-4e9b-ac4e-0062c9f0020a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:46:12.973377 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1178/2347] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:46:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:46:12.977726 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32afda05-c446-4e9b-ac4e-0062c9f0020a None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:46:12.994274 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32afda05-c446-4e9b-ac4e-0062c9f0020a None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:46:13.000168 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127937b1-1540-446c-ab96-b1800d702c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:46:13.001698 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127937b1-1540-446c-ab96-b1800d702c2b admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:13.002053 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127937b1-1540-446c-ab96-b1800d702c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:13.002393 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127937b1-1540-446c-ab96-b1800d702c2b admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:13.003139 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127937b1-1540-446c-ab96-b1800d702c2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:46:13.003447 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127937b1-1540-446c-ab96-b1800d702c2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:46:13.005106 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127937b1-1540-446c-ab96-b1800d702c2b admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:46:13.020718 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1179/2348] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Apr 11 16:46:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:46:13.025684 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127937b1-1540-446c-ab96-b1800d702c2b admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:46:13.039181 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127937b1-1540-446c-ab96-b1800d702c2b admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:46:13.040938 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-de174f40-d097-45c1-b5e0-116d0e205c63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95e5461dea804c72be04fe66b221e19c'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:46:13.045311 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f471c11-fe44-4729-b346-a98d2044d5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:46:13.045819 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f471c11-fe44-4729-b346-a98d2044d5c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:13.051800 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f471c11-fe44-4729-b346-a98d2044d5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:13.051800 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f471c11-fe44-4729-b346-a98d2044d5c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:13.051800 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f471c11-fe44-4729-b346-a98d2044d5c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:46:13.051800 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f471c11-fe44-4729-b346-a98d2044d5c2 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:46:13.159838 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1180/2349] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:46:13 2022] POST /identity/v3/projects => generated 375 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:46:13.161393 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-de174f40-d097-45c1-b5e0-116d0e205c63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95e5461dea804c72be04fe66b221e19c'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:46:13.162304 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b1f79-e172-41fe-9cc6-cc00a5fa48b5 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:13.163369 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b1f79-e172-41fe-9cc6-cc00a5fa48b5 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:13.163925 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b1f79-e172-41fe-9cc6-cc00a5fa48b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:13.173575 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-de174f40-d097-45c1-b5e0-116d0e205c63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95e5461dea804c72be04fe66b221e19c'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:46:13.177454 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-de174f40-d097-45c1-b5e0-116d0e205c63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95e5461dea804c72be04fe66b221e19c'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:46:13.200986 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-de174f40-d097-45c1-b5e0-116d0e205c63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95e5461dea804c72be04fe66b221e19c'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:46:13.207338 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1170/2350] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:46:12 2022] DELETE /identity/v3/users/95e5461dea804c72be04fe66b221e19c => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:46:13.211252 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de174f40-d097-45c1-b5e0-116d0e205c63 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:46:13.212716 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-de174f40-d097-45c1-b5e0-116d0e205c63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:46:13.260018 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-2f5b1f79-e172-41fe-9cc6-cc00a5fa48b5 None None] MFA Rules not processed for user `3252c48fdd5747a29fe4ba89e7162216`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:46:13.261698 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-2f5b1f79-e172-41fe-9cc6-cc00a5fa48b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:46:13.279834 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de174f40-d097-45c1-b5e0-116d0e205c63 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:46:13.286217 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0073a2-b84d-44f7-9309-ecf6b5f1e0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:46:13.287925 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0073a2-b84d-44f7-9309-ecf6b5f1e0e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:13.288459 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0073a2-b84d-44f7-9309-ecf6b5f1e0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:13.288953 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0073a2-b84d-44f7-9309-ecf6b5f1e0e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:13.289855 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0073a2-b84d-44f7-9309-ecf6b5f1e0e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:46:13.294499 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0073a2-b84d-44f7-9309-ecf6b5f1e0e0 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:46:13.366003 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1181/2351] 10.222.0.43 () {58 vars in 1009 bytes} [Mon Apr 11 16:46:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:46:13.368053 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b2ed32-1d48-4848-91ba-525ea9e3d900 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:13.368409 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b2ed32-1d48-4848-91ba-525ea9e3d900 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:13.369213 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b2ed32-1d48-4848-91ba-525ea9e3d900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:13.389332 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-06b2ed32-1d48-4848-91ba-525ea9e3d900 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:46:13.390110 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-06b2ed32-1d48-4848-91ba-525ea9e3d900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:46:13.398877 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1182/2352] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:46:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:46:13.408281 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b2ed32-1d48-4848-91ba-525ea9e3d900 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:46:13.409655 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-06b2ed32-1d48-4848-91ba-525ea9e3d900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:46:13.437388 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1171/2353] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:46:13 2022] POST /identity/v3/users => generated 288 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:46:13.439001 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0073a2-b84d-44f7-9309-ecf6b5f1e0e0 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:46:13.440693 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-df0073a2-b84d-44f7-9309-ecf6b5f1e0e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:46:13.467427 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b2ed32-1d48-4848-91ba-525ea9e3d900 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:46:13.471427 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aa707a-5636-4e15-b7f6-75508145b7d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:46:13.472117 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa707a-5636-4e15-b7f6-75508145b7d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:13.472403 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa707a-5636-4e15-b7f6-75508145b7d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:13.472679 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa707a-5636-4e15-b7f6-75508145b7d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:13.482405 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aa707a-5636-4e15-b7f6-75508145b7d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:46:13.483879 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aa707a-5636-4e15-b7f6-75508145b7d9 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:46:13.494692 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1183/2354] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:46:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 16:46:13.495325 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aa707a-5636-4e15-b7f6-75508145b7d9 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:46:13.518020 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aa707a-5636-4e15-b7f6-75508145b7d9 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:46:13.524720 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dc1e1c-e4cb-49c7-9a62-0f786ce6cf18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:46:13.527030 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc1e1c-e4cb-49c7-9a62-0f786ce6cf18 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:13.527649 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc1e1c-e4cb-49c7-9a62-0f786ce6cf18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:13.528695 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc1e1c-e4cb-49c7-9a62-0f786ce6cf18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:13.530277 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dc1e1c-e4cb-49c7-9a62-0f786ce6cf18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:46:13.532980 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dc1e1c-e4cb-49c7-9a62-0f786ce6cf18 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:46:13.559735 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0073a2-b84d-44f7-9309-ecf6b5f1e0e0 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:46:13.566644 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158a3a88-9607-4df2-93dc-f486e6a9b66d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb193a1a7abd430fbbcccab970e4f37c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:46:13.567496 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158a3a88-9607-4df2-93dc-f486e6a9b66d service swift] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:13.567819 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158a3a88-9607-4df2-93dc-f486e6a9b66d service swift] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:13.568266 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158a3a88-9607-4df2-93dc-f486e6a9b66d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:13.580777 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1184/2355] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:46:13 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:46:13.582605 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dc1e1c-e4cb-49c7-9a62-0f786ce6cf18 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:46:13.584406 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158a3a88-9607-4df2-93dc-f486e6a9b66d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:46:13.585199 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-12dc1e1c-e4cb-49c7-9a62-0f786ce6cf18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:46:13.586028 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158a3a88-9607-4df2-93dc-f486e6a9b66d service swift] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:46:13.612644 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1172/2356] 10.222.0.43 () {60 vars in 1384 bytes} [Mon Apr 11 16:46:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 11 16:46:13.613430 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158a3a88-9607-4df2-93dc-f486e6a9b66d service swift] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:46:13.623577 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dc1e1c-e4cb-49c7-9a62-0f786ce6cf18 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:46:13.629364 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf9a64c-eacb-4a74-87d7-864f57d97552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:46:13.637011 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf9a64c-eacb-4a74-87d7-864f57d97552 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:13.637011 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf9a64c-eacb-4a74-87d7-864f57d97552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:13.637011 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf9a64c-eacb-4a74-87d7-864f57d97552 admin admin] PATH_INFO: `/v3/projects/f82514ef05df44a6a0e3f5afb4fd3c22` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:13.638775 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf9a64c-eacb-4a74-87d7-864f57d97552 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f82514ef05df44a6a0e3f5afb4fd3c22)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:46:13.641754 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf9a64c-eacb-4a74-87d7-864f57d97552 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:46:13.660198 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158a3a88-9607-4df2-93dc-f486e6a9b66d service swift] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:46:13.668335 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a4d4fc-9517-4892-96d8-1b56f39fc98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:46:13.669813 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4d4fc-9517-4892-96d8-1b56f39fc98a admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:13.670268 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4d4fc-9517-4892-96d8-1b56f39fc98a admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:13.670715 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4d4fc-9517-4892-96d8-1b56f39fc98a admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:13.672757 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a4d4fc-9517-4892-96d8-1b56f39fc98a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:46:13.675282 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a4d4fc-9517-4892-96d8-1b56f39fc98a admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:46:13.689264 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1173/2357] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:46:13 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:46:13.693680 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a4d4fc-9517-4892-96d8-1b56f39fc98a admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:46:13.704781 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a4d4fc-9517-4892-96d8-1b56f39fc98a admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:46:13.712385 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88fddc5-ce99-4e6d-b1b2-a855988be04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:46:13.713297 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88fddc5-ce99-4e6d-b1b2-a855988be04f admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:13.713550 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88fddc5-ce99-4e6d-b1b2-a855988be04f admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:13.713829 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88fddc5-ce99-4e6d-b1b2-a855988be04f admin admin] PATH_INFO: `/v3/projects/cc5c21b2aa334d44bc93d8909899f087/users/21ac41c41e914fb29fa4284b040bc3d5/roles/0d41da7bec094450b5bff4e4831be52c` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:13.733572 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88fddc5-ce99-4e6d-b1b2-a855988be04f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc5c21b2aa334d44bc93d8909899f087, user_id=21ac41c41e914fb29fa4284b040bc3d5, role_id=0d41da7bec094450b5bff4e4831be52c)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:46:13.735890 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88fddc5-ce99-4e6d-b1b2-a855988be04f admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:46:13.872490 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1174/2358] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:46:13 2022] PUT /identity/v3/projects/cc5c21b2aa334d44bc93d8909899f087/users/21ac41c41e914fb29fa4284b040bc3d5/roles/0d41da7bec094450b5bff4e4831be52c => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:46:13.884030 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6473892a-aa08-4dae-8fad-13e126aecd84 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:13.884329 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6473892a-aa08-4dae-8fad-13e126aecd84 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:13.884615 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6473892a-aa08-4dae-8fad-13e126aecd84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:13.894822 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-9cf9a64c-eacb-4a74-87d7-864f57d97552 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f82514ef05df44a6a0e3f5afb4fd3c22', 'request_id': 'req-9cf9a64c-eacb-4a74-87d7-864f57d97552'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:46:13.901576 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-9cf9a64c-eacb-4a74-87d7-864f57d97552 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f82514ef05df44a6a0e3f5afb4fd3c22', 'request_id': 'req-9cf9a64c-eacb-4a74-87d7-864f57d97552'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:46:13.917149 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-6473892a-aa08-4dae-8fad-13e126aecd84 None None] MFA Rules not processed for user `21ac41c41e914fb29fa4284b040bc3d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:46:13.918397 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-6473892a-aa08-4dae-8fad-13e126aecd84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:46:14.026514 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1175/2359] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:46:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:46:14.037761 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6473892a-aa08-4dae-8fad-13e126aecd84 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:46:14.039263 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-6473892a-aa08-4dae-8fad-13e126aecd84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:46:14.066562 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-9cf9a64c-eacb-4a74-87d7-864f57d97552 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f82514ef05df44a6a0e3f5afb4fd3c22', 'request_id': 'req-9cf9a64c-eacb-4a74-87d7-864f57d97552'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:46:14.081139 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-9cf9a64c-eacb-4a74-87d7-864f57d97552 admin admin] The token cache is being invalidate because project f82514ef05df44a6a0e3f5afb4fd3c22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:46:14.081576 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-9cf9a64c-eacb-4a74-87d7-864f57d97552 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:46:14.082468 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-9cf9a64c-eacb-4a74-87d7-864f57d97552 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:46:14.087282 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1185/2360] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:46:13 2022] DELETE /identity/v3/projects/f82514ef05df44a6a0e3f5afb4fd3c22 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:46:14.088614 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf9a64c-eacb-4a74-87d7-864f57d97552 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:46:14.090395 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-9cf9a64c-eacb-4a74-87d7-864f57d97552 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:46:14.192789 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf9a64c-eacb-4a74-87d7-864f57d97552 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:46:14.200070 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7c63f7-7442-4219-a2ee-d5c8b4f7ca8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:46:14.202091 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7c63f7-7442-4219-a2ee-d5c8b4f7ca8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:14.202091 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7c63f7-7442-4219-a2ee-d5c8b4f7ca8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:14.202091 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7c63f7-7442-4219-a2ee-d5c8b4f7ca8e admin admin] PATH_INFO: `/v3/users/ed792f79b7bf4da393b2210ef4b11799` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:14.203753 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7c63f7-7442-4219-a2ee-d5c8b4f7ca8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed792f79b7bf4da393b2210ef4b11799)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:46:14.206129 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6473892a-aa08-4dae-8fad-13e126aecd84 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:46:14.208479 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7c63f7-7442-4219-a2ee-d5c8b4f7ca8e admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:46:14.213270 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8972ca-01cc-4740-a9cb-26d36319c2a9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f7cf98d5394b28a475fd67e30fc9c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:46:14.214262 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8972ca-01cc-4740-a9cb-26d36319c2a9 service glance] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:14.214585 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8972ca-01cc-4740-a9cb-26d36319c2a9 service glance] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:14.214872 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8972ca-01cc-4740-a9cb-26d36319c2a9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:14.216971 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-1a8972ca-01cc-4740-a9cb-26d36319c2a9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:46:14.238910 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8972ca-01cc-4740-a9cb-26d36319c2a9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:46:14.240411 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8972ca-01cc-4740-a9cb-26d36319c2a9 service glance] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:46:14.260255 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1176/2361] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:46:14 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 16:46:14.261838 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8972ca-01cc-4740-a9cb-26d36319c2a9 service glance] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:46:14.263492 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-1a8972ca-01cc-4740-a9cb-26d36319c2a9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:46:14.279008 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8972ca-01cc-4740-a9cb-26d36319c2a9 service glance] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:46:14.287825 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef32fb7-64c4-4405-b39e-cda822cac3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:46:14.289412 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef32fb7-64c4-4405-b39e-cda822cac3f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:14.289996 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef32fb7-64c4-4405-b39e-cda822cac3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:14.290570 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef32fb7-64c4-4405-b39e-cda822cac3f4 admin admin] PATH_INFO: `/v3/projects/96160937a8c547b0ae0f3ce3a50a91a4` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:14.292205 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef32fb7-64c4-4405-b39e-cda822cac3f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96160937a8c547b0ae0f3ce3a50a91a4)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:46:14.294005 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef32fb7-64c4-4405-b39e-cda822cac3f4 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:46:14.399713 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-4c7c63f7-7442-4219-a2ee-d5c8b4f7ca8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed792f79b7bf4da393b2210ef4b11799'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:46:14.400465 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-4c7c63f7-7442-4219-a2ee-d5c8b4f7ca8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed792f79b7bf4da393b2210ef4b11799'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:46:14.434546 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-cef32fb7-64c4-4405-b39e-cda822cac3f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96160937a8c547b0ae0f3ce3a50a91a4', 'request_id': 'req-cef32fb7-64c4-4405-b39e-cda822cac3f4'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:46:14.505977 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-4c7c63f7-7442-4219-a2ee-d5c8b4f7ca8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed792f79b7bf4da393b2210ef4b11799'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:46:14.513761 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-4c7c63f7-7442-4219-a2ee-d5c8b4f7ca8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed792f79b7bf4da393b2210ef4b11799'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:46:14.530700 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-4c7c63f7-7442-4219-a2ee-d5c8b4f7ca8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed792f79b7bf4da393b2210ef4b11799'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:46:14.538255 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1186/2362] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:46:14 2022] DELETE /identity/v3/users/ed792f79b7bf4da393b2210ef4b11799 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:46:14.619718 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-cef32fb7-64c4-4405-b39e-cda822cac3f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96160937a8c547b0ae0f3ce3a50a91a4', 'request_id': 'req-cef32fb7-64c4-4405-b39e-cda822cac3f4'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:46:14.626798 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-cef32fb7-64c4-4405-b39e-cda822cac3f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96160937a8c547b0ae0f3ce3a50a91a4', 'request_id': 'req-cef32fb7-64c4-4405-b39e-cda822cac3f4'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:46:14.643900 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-cef32fb7-64c4-4405-b39e-cda822cac3f4 admin admin] The token cache is being invalidate because project 96160937a8c547b0ae0f3ce3a50a91a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:46:14.644213 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-cef32fb7-64c4-4405-b39e-cda822cac3f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:46:14.645138 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-cef32fb7-64c4-4405-b39e-cda822cac3f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:46:14.647142 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1177/2363] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:46:14 2022] DELETE /identity/v3/projects/96160937a8c547b0ae0f3ce3a50a91a4 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:46:14.652034 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d303f872-ee58-4528-ba1a-3cab1c7b6720 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:14.652290 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d303f872-ee58-4528-ba1a-3cab1c7b6720 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:14.652705 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d303f872-ee58-4528-ba1a-3cab1c7b6720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:14.671774 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-d303f872-ee58-4528-ba1a-3cab1c7b6720 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:46:14.672994 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-d303f872-ee58-4528-ba1a-3cab1c7b6720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:46:14.767012 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1187/2364] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:46:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:46:14.776862 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f7c197-96c8-48c1-a31e-d816da7a2039 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:14.777165 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f7c197-96c8-48c1-a31e-d816da7a2039 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:14.777496 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f7c197-96c8-48c1-a31e-d816da7a2039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:14.812626 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-96f7c197-96c8-48c1-a31e-d816da7a2039 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:46:14.814199 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-96f7c197-96c8-48c1-a31e-d816da7a2039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:46:14.828246 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1178/2365] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:46:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:46:14.829712 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d303f872-ee58-4528-ba1a-3cab1c7b6720 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:46:14.840747 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d303f872-ee58-4528-ba1a-3cab1c7b6720 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:46:14.846475 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe1ed3a-86c2-4ace-942c-88322b81998a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:46:14.847229 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe1ed3a-86c2-4ace-942c-88322b81998a admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:14.847620 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe1ed3a-86c2-4ace-942c-88322b81998a admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:14.847973 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe1ed3a-86c2-4ace-942c-88322b81998a admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:14.848772 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe1ed3a-86c2-4ace-942c-88322b81998a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:46:14.849087 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe1ed3a-86c2-4ace-942c-88322b81998a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:46:14.850700 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe1ed3a-86c2-4ace-942c-88322b81998a admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:46:14.863924 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1188/2366] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Apr 11 16:46:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:46:14.872004 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f7c197-96c8-48c1-a31e-d816da7a2039 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:46:14.881198 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f7c197-96c8-48c1-a31e-d816da7a2039 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:46:14.886322 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1ab04-fd3e-4b8d-a84f-d47c75e923e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:46:14.886971 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1ab04-fd3e-4b8d-a84f-d47c75e923e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:14.887252 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1ab04-fd3e-4b8d-a84f-d47c75e923e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:14.887539 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1ab04-fd3e-4b8d-a84f-d47c75e923e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:14.888244 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce1ab04-fd3e-4b8d-a84f-d47c75e923e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:46:14.890125 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce1ab04-fd3e-4b8d-a84f-d47c75e923e6 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:46:14.948548 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04a215-baed-45be-931a-fcd3ab921f10 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:14.950398 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04a215-baed-45be-931a-fcd3ab921f10 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:14.950398 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04a215-baed-45be-931a-fcd3ab921f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:14.968153 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-4d04a215-baed-45be-931a-fcd3ab921f10 None None] MFA Rules not processed for user `3252c48fdd5747a29fe4ba89e7162216`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:46:14.970129 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-4d04a215-baed-45be-931a-fcd3ab921f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:46:15.024009 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1189/2367] 10.222.0.43 () {58 vars in 967 bytes} [Mon Apr 11 16:46:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:46:15.033203 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d04a215-baed-45be-931a-fcd3ab921f10 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:46:15.036436 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-4d04a215-baed-45be-931a-fcd3ab921f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:46:15.049032 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d04a215-baed-45be-931a-fcd3ab921f10 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:46:15.055624 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693b6ddf-8ce8-44c7-bb72-c45363bbd10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:46:15.056550 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b6ddf-8ce8-44c7-bb72-c45363bbd10c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:15.056825 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b6ddf-8ce8-44c7-bb72-c45363bbd10c admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:15.057107 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b6ddf-8ce8-44c7-bb72-c45363bbd10c admin admin] PATH_INFO: `/v3/projects/6432f6a0733349d9a2c49ea5031c4e0c` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:15.058449 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693b6ddf-8ce8-44c7-bb72-c45363bbd10c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6432f6a0733349d9a2c49ea5031c4e0c)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:46:15.060297 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693b6ddf-8ce8-44c7-bb72-c45363bbd10c admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:46:15.107551 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1179/2368] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:46:14 2022] POST /identity/v3/projects => generated 365 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:46:15.108356 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1ab04-fd3e-4b8d-a84f-d47c75e923e6 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:46:15.110313 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-7ce1ab04-fd3e-4b8d-a84f-d47c75e923e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:46:15.180713 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1ab04-fd3e-4b8d-a84f-d47c75e923e6 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:46:15.185879 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8122b777-f6f3-4fd1-a495-2a1ae752deaf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb193a1a7abd430fbbcccab970e4f37c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:46:15.186568 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122b777-f6f3-4fd1-a495-2a1ae752deaf service swift] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:15.186854 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122b777-f6f3-4fd1-a495-2a1ae752deaf service swift] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:15.187134 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122b777-f6f3-4fd1-a495-2a1ae752deaf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:15.207965 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-693b6ddf-8ce8-44c7-bb72-c45363bbd10c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6432f6a0733349d9a2c49ea5031c4e0c', 'request_id': 'req-693b6ddf-8ce8-44c7-bb72-c45363bbd10c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:46:15.213592 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-693b6ddf-8ce8-44c7-bb72-c45363bbd10c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6432f6a0733349d9a2c49ea5031c4e0c', 'request_id': 'req-693b6ddf-8ce8-44c7-bb72-c45363bbd10c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:46:15.243646 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8122b777-f6f3-4fd1-a495-2a1ae752deaf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:46:15.245234 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8122b777-f6f3-4fd1-a495-2a1ae752deaf service swift] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:46:15.254598 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1180/2369] 10.222.0.43 () {60 vars in 1384 bytes} [Mon Apr 11 16:46:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 11 16:46:15.255404 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8122b777-f6f3-4fd1-a495-2a1ae752deaf service swift] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:46:15.334207 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8122b777-f6f3-4fd1-a495-2a1ae752deaf service swift] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:46:15.389061 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864d9569-8033-426d-8e8c-3790974fa2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:46:15.389757 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d9569-8033-426d-8e8c-3790974fa2ab admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:15.390043 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d9569-8033-426d-8e8c-3790974fa2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:15.390326 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d9569-8033-426d-8e8c-3790974fa2ab admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:15.391047 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864d9569-8033-426d-8e8c-3790974fa2ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:46:15.393138 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864d9569-8033-426d-8e8c-3790974fa2ab admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:46:15.408726 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-693b6ddf-8ce8-44c7-bb72-c45363bbd10c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6432f6a0733349d9a2c49ea5031c4e0c', 'request_id': 'req-693b6ddf-8ce8-44c7-bb72-c45363bbd10c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:46:15.419986 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-693b6ddf-8ce8-44c7-bb72-c45363bbd10c admin admin] The token cache is being invalidate because project 6432f6a0733349d9a2c49ea5031c4e0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:46:15.420255 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-693b6ddf-8ce8-44c7-bb72-c45363bbd10c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:46:15.420872 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-693b6ddf-8ce8-44c7-bb72-c45363bbd10c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:46:15.423071 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1190/2370] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:46:15 2022] DELETE /identity/v3/projects/6432f6a0733349d9a2c49ea5031c4e0c => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:46:15.423862 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693b6ddf-8ce8-44c7-bb72-c45363bbd10c admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:46:15.425125 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-693b6ddf-8ce8-44c7-bb72-c45363bbd10c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:46:15.516602 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1181/2371] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:46:15 2022] POST /identity/v3/users => generated 283 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:46:15.518058 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67456d03-9d30-4dea-a759-4b393e451eb5 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:15.520466 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67456d03-9d30-4dea-a759-4b393e451eb5 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:15.520466 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67456d03-9d30-4dea-a759-4b393e451eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:15.526614 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693b6ddf-8ce8-44c7-bb72-c45363bbd10c admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:46:15.532825 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986bd4e7-78ea-480d-ad52-dfa17dc3bf34 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6589debd41bf496085c7339ab5409666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:46:15.533507 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986bd4e7-78ea-480d-ad52-dfa17dc3bf34 service placement] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:15.533789 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986bd4e7-78ea-480d-ad52-dfa17dc3bf34 service placement] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:15.534063 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986bd4e7-78ea-480d-ad52-dfa17dc3bf34 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:15.535848 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-986bd4e7-78ea-480d-ad52-dfa17dc3bf34 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:46:15.537584 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-67456d03-9d30-4dea-a759-4b393e451eb5 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:46:15.538755 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-67456d03-9d30-4dea-a759-4b393e451eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:46:15.546771 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1182/2372] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:46:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:46:15.548873 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67456d03-9d30-4dea-a759-4b393e451eb5 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:46:15.555209 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986bd4e7-78ea-480d-ad52-dfa17dc3bf34 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:46:15.555345 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-67456d03-9d30-4dea-a759-4b393e451eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:46:15.555442 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986bd4e7-78ea-480d-ad52-dfa17dc3bf34 service placement] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:46:15.561658 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67456d03-9d30-4dea-a759-4b393e451eb5 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:46:15.562062 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1191/2373] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:46:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:46:15.566179 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c199a-b693-46a3-8c06-bf59915d5f0f None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:15.566545 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c199a-b693-46a3-8c06-bf59915d5f0f None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:15.567140 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c199a-b693-46a3-8c06-bf59915d5f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:15.570047 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6238ee-f9c6-46b6-b575-77850e73204a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:46:15.571096 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6238ee-f9c6-46b6-b575-77850e73204a admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:15.571595 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6238ee-f9c6-46b6-b575-77850e73204a admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:15.572037 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6238ee-f9c6-46b6-b575-77850e73204a admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:15.573605 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6238ee-f9c6-46b6-b575-77850e73204a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:46:15.575410 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6238ee-f9c6-46b6-b575-77850e73204a admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:46:15.587238 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1183/2374] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:46:15 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:46:15.587651 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-d05c199a-b693-46a3-8c06-bf59915d5f0f None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:46:15.588978 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-d05c199a-b693-46a3-8c06-bf59915d5f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:46:15.591015 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6238ee-f9c6-46b6-b575-77850e73204a admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:46:15.598411 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1192/2375] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:46:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:46:15.601872 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6238ee-f9c6-46b6-b575-77850e73204a admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:46:15.602723 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c199a-b693-46a3-8c06-bf59915d5f0f None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:46:15.614053 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c199a-b693-46a3-8c06-bf59915d5f0f None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:46:15.615190 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e9a646-7b9f-42fa-aac2-dfc131f37423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:46:15.616122 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9a646-7b9f-42fa-aac2-dfc131f37423 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:15.616488 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9a646-7b9f-42fa-aac2-dfc131f37423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:15.616860 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9a646-7b9f-42fa-aac2-dfc131f37423 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:15.617990 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e9a646-7b9f-42fa-aac2-dfc131f37423 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:46:15.620119 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e9a646-7b9f-42fa-aac2-dfc131f37423 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:46:15.620830 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b8350-2343-4490-b850-028e954c014d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:46:15.621552 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b8350-2343-4490-b850-028e954c014d admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:15.621905 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b8350-2343-4490-b850-028e954c014d admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:15.622179 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b8350-2343-4490-b850-028e954c014d admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:15.622907 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8b8350-2343-4490-b850-028e954c014d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:46:15.623213 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8b8350-2343-4490-b850-028e954c014d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:46:15.624955 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8b8350-2343-4490-b850-028e954c014d admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:46:15.631364 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1184/2376] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:46:15 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 16:46:15.635313 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e9a646-7b9f-42fa-aac2-dfc131f37423 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:46:15.638224 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1193/2377] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Apr 11 16:46:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:46:15.647604 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e9a646-7b9f-42fa-aac2-dfc131f37423 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:46:15.649725 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b8350-2343-4490-b850-028e954c014d admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:46:15.661941 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34229342-e875-4c72-ba7a-8c95c4f61b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:46:15.662303 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b8350-2343-4490-b850-028e954c014d admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:46:15.663187 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34229342-e875-4c72-ba7a-8c95c4f61b3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:15.663475 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34229342-e875-4c72-ba7a-8c95c4f61b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:15.663767 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34229342-e875-4c72-ba7a-8c95c4f61b3e admin admin] PATH_INFO: `/v3/projects/6567af01cd114e04a6cb82b77f775865/users/5c9b34ddcbe64603a81a9fa05c4c3a2a/roles/0d41da7bec094450b5bff4e4831be52c` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:15.668855 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90a46d8-61d7-4cb4-9f27-58f711f8c7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:46:15.669522 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a46d8-61d7-4cb4-9f27-58f711f8c7b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:15.670069 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a46d8-61d7-4cb4-9f27-58f711f8c7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:15.670069 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a46d8-61d7-4cb4-9f27-58f711f8c7b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:15.670811 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90a46d8-61d7-4cb4-9f27-58f711f8c7b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:46:15.673997 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90a46d8-61d7-4cb4-9f27-58f711f8c7b7 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:46:15.680540 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34229342-e875-4c72-ba7a-8c95c4f61b3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6567af01cd114e04a6cb82b77f775865, user_id=5c9b34ddcbe64603a81a9fa05c4c3a2a, role_id=0d41da7bec094450b5bff4e4831be52c)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:46:15.683271 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34229342-e875-4c72-ba7a-8c95c4f61b3e admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:46:15.763174 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1185/2378] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:46:15 2022] PUT /identity/v3/projects/6567af01cd114e04a6cb82b77f775865/users/5c9b34ddcbe64603a81a9fa05c4c3a2a/roles/0d41da7bec094450b5bff4e4831be52c => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:46:15.774900 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1194/2379] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:46:15 2022] POST /identity/v3/projects => generated 371 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:46:15.777211 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34229342-e875-4c72-ba7a-8c95c4f61b3e admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:46:15.785172 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ea88a-dd1b-4693-82d9-6b151907673d None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:15.785497 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ea88a-dd1b-4693-82d9-6b151907673d None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:15.787114 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ea88a-dd1b-4693-82d9-6b151907673d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:15.827439 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-ba7ea88a-dd1b-4693-82d9-6b151907673d None None] MFA Rules not processed for user `5c9b34ddcbe64603a81a9fa05c4c3a2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:46:15.829860 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ba7ea88a-dd1b-4693-82d9-6b151907673d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:46:15.856077 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34229342-e875-4c72-ba7a-8c95c4f61b3e admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:46:15.901246 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1195/2380] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:46:15 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:46:15.915454 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7ea88a-dd1b-4693-82d9-6b151907673d None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:46:15.917041 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ba7ea88a-dd1b-4693-82d9-6b151907673d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:46:15.949057 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e340348e-9eda-4ae4-872e-c0d9418388dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:46:15.949969 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340348e-9eda-4ae4-872e-c0d9418388dc admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:15.950329 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340348e-9eda-4ae4-872e-c0d9418388dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:15.950704 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340348e-9eda-4ae4-872e-c0d9418388dc admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:15.951383 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e340348e-9eda-4ae4-872e-c0d9418388dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:46:15.955648 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e340348e-9eda-4ae4-872e-c0d9418388dc admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:46:15.988064 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7ea88a-dd1b-4693-82d9-6b151907673d None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:46:15.992117 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d39cdc9-4bdf-49d7-aea6-073b034d0e52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '950b5b5f690d41509ead753065a0b793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:46:15.992778 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d39cdc9-4bdf-49d7-aea6-073b034d0e52 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:15.993067 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d39cdc9-4bdf-49d7-aea6-073b034d0e52 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:15.993367 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d39cdc9-4bdf-49d7-aea6-073b034d0e52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:16.002564 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d39cdc9-4bdf-49d7-aea6-073b034d0e52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:46:16.008319 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d39cdc9-4bdf-49d7-aea6-073b034d0e52 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:46:16.013204 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1196/2381] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:46:15 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:46:16.066995 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1186/2382] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:46:15 2022] POST /identity/v3/users => generated 286 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:46:16.067238 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d39cdc9-4bdf-49d7-aea6-073b034d0e52 service cinder] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:46:16.079701 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d39cdc9-4bdf-49d7-aea6-073b034d0e52 service cinder] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:46:16.085728 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6899e9b3-e709-4517-b83d-0d71b797ba2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:46:16.086412 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899e9b3-e709-4517-b83d-0d71b797ba2d admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:16.086624 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899e9b3-e709-4517-b83d-0d71b797ba2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:16.087075 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899e9b3-e709-4517-b83d-0d71b797ba2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:16.087894 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6899e9b3-e709-4517-b83d-0d71b797ba2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:46:16.089487 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6899e9b3-e709-4517-b83d-0d71b797ba2d admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:46:16.104886 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1197/2383] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:46:16 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:46:16.106261 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e340348e-9eda-4ae4-872e-c0d9418388dc admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:46:16.110403 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4077a643-9602-418b-81e3-218423e46214 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:16.110403 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4077a643-9602-418b-81e3-218423e46214 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:16.110403 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4077a643-9602-418b-81e3-218423e46214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:16.124938 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e340348e-9eda-4ae4-872e-c0d9418388dc admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:46:16.131668 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a141fa-1161-4b97-9f28-1b95870f5ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:46:16.132354 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a141fa-1161-4b97-9f28-1b95870f5ace admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:16.140302 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a141fa-1161-4b97-9f28-1b95870f5ace admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:16.140302 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a141fa-1161-4b97-9f28-1b95870f5ace admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:16.140302 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a141fa-1161-4b97-9f28-1b95870f5ace admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:46:16.140302 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a141fa-1161-4b97-9f28-1b95870f5ace admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:46:16.140679 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-4077a643-9602-418b-81e3-218423e46214 None None] MFA Rules not processed for user `3252c48fdd5747a29fe4ba89e7162216`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:46:16.140679 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-4077a643-9602-418b-81e3-218423e46214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:46:16.149567 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1187/2384] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:46:16 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:46:16.153765 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a141fa-1161-4b97-9f28-1b95870f5ace admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:46:16.168122 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a141fa-1161-4b97-9f28-1b95870f5ace admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:46:16.174430 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1e5f33-b934-4e47-889c-b3499d634fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:46:16.175481 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e5f33-b934-4e47-889c-b3499d634fdd admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:16.175795 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e5f33-b934-4e47-889c-b3499d634fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:16.176212 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e5f33-b934-4e47-889c-b3499d634fdd admin admin] PATH_INFO: `/v3/projects/89f8b5098b66454f88c79b581c9836e4/users/cfe598c377a74986b6452e5ea8a1180e/roles/0d41da7bec094450b5bff4e4831be52c` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:16.195322 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1e5f33-b934-4e47-889c-b3499d634fdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=89f8b5098b66454f88c79b581c9836e4, user_id=cfe598c377a74986b6452e5ea8a1180e, role_id=0d41da7bec094450b5bff4e4831be52c)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:46:16.198114 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1e5f33-b934-4e47-889c-b3499d634fdd admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:46:16.212178 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1198/2385] 10.222.0.43 () {58 vars in 1009 bytes} [Mon Apr 11 16:46:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:46:16.224665 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4077a643-9602-418b-81e3-218423e46214 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:46:16.226043 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-4077a643-9602-418b-81e3-218423e46214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:46:16.298407 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4077a643-9602-418b-81e3-218423e46214 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:46:16.303831 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6ef170-5e71-4b80-b765-4f26c8ec6294 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb193a1a7abd430fbbcccab970e4f37c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:46:16.304485 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ef170-5e71-4b80-b765-4f26c8ec6294 service swift] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:16.304765 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ef170-5e71-4b80-b765-4f26c8ec6294 service swift] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:16.305040 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ef170-5e71-4b80-b765-4f26c8ec6294 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:16.313721 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6ef170-5e71-4b80-b765-4f26c8ec6294 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:46:16.315350 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6ef170-5e71-4b80-b765-4f26c8ec6294 service swift] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:46:16.324074 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1199/2386] 10.222.0.43 () {60 vars in 1384 bytes} [Mon Apr 11 16:46:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 11 16:46:16.334772 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1188/2387] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:46:16 2022] PUT /identity/v3/projects/89f8b5098b66454f88c79b581c9836e4/users/cfe598c377a74986b6452e5ea8a1180e/roles/0d41da7bec094450b5bff4e4831be52c => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:46:16.339883 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e6bf55-b023-4721-8945-84c51724bdab None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:16.340186 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e6bf55-b023-4721-8945-84c51724bdab None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:16.340473 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e6bf55-b023-4721-8945-84c51724bdab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:16.358931 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-b8e6bf55-b023-4721-8945-84c51724bdab None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:46:16.360769 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b8e6bf55-b023-4721-8945-84c51724bdab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:46:16.420260 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1200/2388] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:46:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:46:16.431297 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1e5f33-b934-4e47-889c-b3499d634fdd admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:46:16.433513 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-3a1e5f33-b934-4e47-889c-b3499d634fdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:46:16.501322 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1e5f33-b934-4e47-889c-b3499d634fdd admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:46:16.505536 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75079c68-f7cb-4357-a3c8-9296660b4b0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:46:16.506203 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75079c68-f7cb-4357-a3c8-9296660b4b0e service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:16.506487 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75079c68-f7cb-4357-a3c8-9296660b4b0e service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:16.506763 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75079c68-f7cb-4357-a3c8-9296660b4b0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:16.516771 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75079c68-f7cb-4357-a3c8-9296660b4b0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:46:16.518200 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75079c68-f7cb-4357-a3c8-9296660b4b0e service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:46:16.528125 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1189/2389] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:46:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:46:17.100271 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5fb0f4-2ee3-48e6-99da-aec8dccf1b74 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:17.101339 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5fb0f4-2ee3-48e6-99da-aec8dccf1b74 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:17.101339 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5fb0f4-2ee3-48e6-99da-aec8dccf1b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:17.121259 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-be5fb0f4-2ee3-48e6-99da-aec8dccf1b74 None None] MFA Rules not processed for user `3252c48fdd5747a29fe4ba89e7162216`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:46:17.122663 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-be5fb0f4-2ee3-48e6-99da-aec8dccf1b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:46:17.201317 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1201/2390] 10.222.0.43 () {58 vars in 967 bytes} [Mon Apr 11 16:46:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:46:17.218908 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75079c68-f7cb-4357-a3c8-9296660b4b0e service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:46:17.306847 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75079c68-f7cb-4357-a3c8-9296660b4b0e service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:46:17.313075 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bb744f-1655-4f4b-b674-4de894b23a9f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb193a1a7abd430fbbcccab970e4f37c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:46:17.314233 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb744f-1655-4f4b-b674-4de894b23a9f service swift] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:17.314530 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb744f-1655-4f4b-b674-4de894b23a9f service swift] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:17.314819 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb744f-1655-4f4b-b674-4de894b23a9f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:17.323819 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bb744f-1655-4f4b-b674-4de894b23a9f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:46:17.325672 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bb744f-1655-4f4b-b674-4de894b23a9f service swift] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:46:17.335056 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1190/2391] 10.222.0.43 () {60 vars in 1384 bytes} [Mon Apr 11 16:46:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 11 16:46:18.824786 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbdc7c-1cfb-49ed-aff1-8183127b5964 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:18.825266 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbdc7c-1cfb-49ed-aff1-8183127b5964 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:18.825589 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbdc7c-1cfb-49ed-aff1-8183127b5964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:18.870484 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-12fbdc7c-1cfb-49ed-aff1-8183127b5964 None None] MFA Rules not processed for user `cfe598c377a74986b6452e5ea8a1180e`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:46:18.872570 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-12fbdc7c-1cfb-49ed-aff1-8183127b5964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:46:18.973521 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1202/2392] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:46:18 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:46:18.991650 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bb744f-1655-4f4b-b674-4de894b23a9f service swift] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:46:18.993833 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-78bb744f-1655-4f4b-b674-4de894b23a9f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:46:19.059849 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bb744f-1655-4f4b-b674-4de894b23a9f service swift] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:46:19.064747 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7d3395-f71e-466c-9238-05810410b895 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '950b5b5f690d41509ead753065a0b793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:46:19.065412 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d3395-f71e-466c-9238-05810410b895 service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:19.065701 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d3395-f71e-466c-9238-05810410b895 service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:19.065979 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d3395-f71e-466c-9238-05810410b895 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:19.075071 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7d3395-f71e-466c-9238-05810410b895 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:46:19.076527 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7d3395-f71e-466c-9238-05810410b895 service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:46:19.092520 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1191/2393] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:46:18 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:46:21.440651 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fbdc7c-1cfb-49ed-aff1-8183127b5964 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:46:21.442049 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-12fbdc7c-1cfb-49ed-aff1-8183127b5964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:46:21.455692 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fbdc7c-1cfb-49ed-aff1-8183127b5964 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:46:21.461182 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc168b7-ff17-4579-8e7c-d225a7b1e1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:46:21.462167 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc168b7-ff17-4579-8e7c-d225a7b1e1d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:21.462463 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc168b7-ff17-4579-8e7c-d225a7b1e1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:21.462732 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc168b7-ff17-4579-8e7c-d225a7b1e1d7 admin admin] PATH_INFO: `/v3/users/1a4787f9e28641e7b893c80ffde3612d` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:21.464150 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc168b7-ff17-4579-8e7c-d225a7b1e1d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a4787f9e28641e7b893c80ffde3612d)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:46:21.466091 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc168b7-ff17-4579-8e7c-d225a7b1e1d7 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:46:21.646489 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-cfc168b7-ff17-4579-8e7c-d225a7b1e1d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a4787f9e28641e7b893c80ffde3612d'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:46:21.647149 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-cfc168b7-ff17-4579-8e7c-d225a7b1e1d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a4787f9e28641e7b893c80ffde3612d'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:46:21.705658 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-cfc168b7-ff17-4579-8e7c-d225a7b1e1d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a4787f9e28641e7b893c80ffde3612d'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:46:21.712863 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-cfc168b7-ff17-4579-8e7c-d225a7b1e1d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a4787f9e28641e7b893c80ffde3612d'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:46:21.725429 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-cfc168b7-ff17-4579-8e7c-d225a7b1e1d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a4787f9e28641e7b893c80ffde3612d'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:46:21.731955 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1203/2394] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:46:21 2022] DELETE /identity/v3/users/1a4787f9e28641e7b893c80ffde3612d => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:46:21.736743 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42e122-7307-424c-af41-22cdc3627c2e None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:21.737211 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42e122-7307-424c-af41-22cdc3627c2e None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:21.737303 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42e122-7307-424c-af41-22cdc3627c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:21.754415 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-9b42e122-7307-424c-af41-22cdc3627c2e None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:46:21.755664 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-9b42e122-7307-424c-af41-22cdc3627c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:46:21.818587 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1192/2395] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:46:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:46:21.829289 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc168b7-ff17-4579-8e7c-d225a7b1e1d7 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:46:21.830701 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-cfc168b7-ff17-4579-8e7c-d225a7b1e1d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:46:21.889449 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc168b7-ff17-4579-8e7c-d225a7b1e1d7 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:46:21.896844 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81746747-9a72-4e49-8b1c-f8cbbfaa4971 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:46:21.898288 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81746747-9a72-4e49-8b1c-f8cbbfaa4971 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:21.898709 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81746747-9a72-4e49-8b1c-f8cbbfaa4971 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:21.899021 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81746747-9a72-4e49-8b1c-f8cbbfaa4971 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:21.909536 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81746747-9a72-4e49-8b1c-f8cbbfaa4971 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:46:21.910994 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81746747-9a72-4e49-8b1c-f8cbbfaa4971 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:46:21.920435 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1204/2396] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:46:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:46:22.200308 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b42e122-7307-424c-af41-22cdc3627c2e None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:46:22.201460 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-9b42e122-7307-424c-af41-22cdc3627c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:46:22.214440 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b42e122-7307-424c-af41-22cdc3627c2e None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:46:22.220514 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac11afc-1777-4f21-a086-b505445d07a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:46:22.221265 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac11afc-1777-4f21-a086-b505445d07a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:22.221504 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac11afc-1777-4f21-a086-b505445d07a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:22.221793 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac11afc-1777-4f21-a086-b505445d07a1 admin admin] PATH_INFO: `/v3/projects/8eeae39feb8d4b91b8844451a84dc066` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:22.223387 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac11afc-1777-4f21-a086-b505445d07a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8eeae39feb8d4b91b8844451a84dc066)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:46:22.225511 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac11afc-1777-4f21-a086-b505445d07a1 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:46:22.341394 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a1a379-7d40-4c57-a578-258d8900a595 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:22.341688 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a1a379-7d40-4c57-a578-258d8900a595 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:22.341972 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a1a379-7d40-4c57-a578-258d8900a595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:22.360684 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-62a1a379-7d40-4c57-a578-258d8900a595 None None] MFA Rules not processed for user `cfe598c377a74986b6452e5ea8a1180e`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:46:22.361926 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-62a1a379-7d40-4c57-a578-258d8900a595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:46:22.388924 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-0ac11afc-1777-4f21-a086-b505445d07a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8eeae39feb8d4b91b8844451a84dc066', 'request_id': 'req-0ac11afc-1777-4f21-a086-b505445d07a1'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:46:22.423160 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1205/2397] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:46:22 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:46:22.580949 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-0ac11afc-1777-4f21-a086-b505445d07a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8eeae39feb8d4b91b8844451a84dc066', 'request_id': 'req-0ac11afc-1777-4f21-a086-b505445d07a1'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:46:22.586883 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-0ac11afc-1777-4f21-a086-b505445d07a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8eeae39feb8d4b91b8844451a84dc066', 'request_id': 'req-0ac11afc-1777-4f21-a086-b505445d07a1'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:46:22.601991 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-0ac11afc-1777-4f21-a086-b505445d07a1 admin admin] The token cache is being invalidate because project 8eeae39feb8d4b91b8844451a84dc066 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:46:22.602286 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-0ac11afc-1777-4f21-a086-b505445d07a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:46:22.602949 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-0ac11afc-1777-4f21-a086-b505445d07a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:46:22.604525 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1193/2398] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:46:22 2022] DELETE /identity/v3/projects/8eeae39feb8d4b91b8844451a84dc066 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:46:22.609709 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ddcc51-e9f4-42a4-8634-ce1a09576807 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:22.610326 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ddcc51-e9f4-42a4-8634-ce1a09576807 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:22.610326 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ddcc51-e9f4-42a4-8634-ce1a09576807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:22.632844 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-17ddcc51-e9f4-42a4-8634-ce1a09576807 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:46:22.634053 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-17ddcc51-e9f4-42a4-8634-ce1a09576807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:46:22.699346 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1206/2399] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:46:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:46:22.711798 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ffd12-31f0-4154-b95f-53e7700af822 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:22.711798 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ffd12-31f0-4154-b95f-53e7700af822 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:22.711798 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ffd12-31f0-4154-b95f-53e7700af822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:22.738199 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-3a2ffd12-31f0-4154-b95f-53e7700af822 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:46:22.739405 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-3a2ffd12-31f0-4154-b95f-53e7700af822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:46:22.747663 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1194/2400] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:46:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:46:22.752203 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ddcc51-e9f4-42a4-8634-ce1a09576807 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:46:22.764964 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ddcc51-e9f4-42a4-8634-ce1a09576807 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:46:22.771320 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd311b-6a58-445f-93de-cc046164a02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:46:22.772042 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd311b-6a58-445f-93de-cc046164a02f admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:22.772327 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd311b-6a58-445f-93de-cc046164a02f admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:22.772622 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd311b-6a58-445f-93de-cc046164a02f admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:22.773357 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dd311b-6a58-445f-93de-cc046164a02f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:46:22.773668 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dd311b-6a58-445f-93de-cc046164a02f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:46:22.775272 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dd311b-6a58-445f-93de-cc046164a02f admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:46:22.788703 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1207/2401] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Apr 11 16:46:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:46:22.792998 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2ffd12-31f0-4154-b95f-53e7700af822 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:46:22.802670 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2ffd12-31f0-4154-b95f-53e7700af822 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:46:22.807709 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016d2665-72ef-4109-a236-bec9fe668039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:46:22.808375 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d2665-72ef-4109-a236-bec9fe668039 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:22.808686 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d2665-72ef-4109-a236-bec9fe668039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:22.808960 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d2665-72ef-4109-a236-bec9fe668039 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:22.809687 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016d2665-72ef-4109-a236-bec9fe668039 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:46:22.811611 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016d2665-72ef-4109-a236-bec9fe668039 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:46:22.931341 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1195/2402] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:46:22 2022] POST /identity/v3/projects => generated 391 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:46:22.935780 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd311b-6a58-445f-93de-cc046164a02f admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:46:22.948811 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd311b-6a58-445f-93de-cc046164a02f admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:46:23.019986 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824d19b6-f724-4fc3-83b9-1a9928431074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:46:23.020664 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d19b6-f724-4fc3-83b9-1a9928431074 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:23.020952 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d19b6-f724-4fc3-83b9-1a9928431074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:23.021231 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d19b6-f724-4fc3-83b9-1a9928431074 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:23.021924 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824d19b6-f724-4fc3-83b9-1a9928431074 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:46:23.023848 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824d19b6-f724-4fc3-83b9-1a9928431074 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:46:23.146928 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1208/2403] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:46:22 2022] POST /identity/v3/users => generated 296 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:46:23.157119 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016d2665-72ef-4109-a236-bec9fe668039 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:46:23.174110 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016d2665-72ef-4109-a236-bec9fe668039 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:46:23.179481 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd3ecd6-b7f8-4136-84e1-95790f4bb00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:46:23.180259 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3ecd6-b7f8-4136-84e1-95790f4bb00b admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:23.180540 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3ecd6-b7f8-4136-84e1-95790f4bb00b admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:23.180870 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3ecd6-b7f8-4136-84e1-95790f4bb00b admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:23.181553 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd3ecd6-b7f8-4136-84e1-95790f4bb00b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:46:23.183194 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd3ecd6-b7f8-4136-84e1-95790f4bb00b admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:46:23.197364 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1196/2404] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:46:23 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:46:23.198503 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824d19b6-f724-4fc3-83b9-1a9928431074 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:46:23.209542 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824d19b6-f724-4fc3-83b9-1a9928431074 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:46:23.214528 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e4fe17-3770-49f0-95ee-89f3a493bf37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:46:23.215149 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e4fe17-3770-49f0-95ee-89f3a493bf37 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:23.215428 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e4fe17-3770-49f0-95ee-89f3a493bf37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:23.215733 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e4fe17-3770-49f0-95ee-89f3a493bf37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:23.216461 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e4fe17-3770-49f0-95ee-89f3a493bf37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:46:23.218137 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e4fe17-3770-49f0-95ee-89f3a493bf37 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:46:23.239551 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1209/2405] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:46:23 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 16:46:23.241766 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd3ecd6-b7f8-4136-84e1-95790f4bb00b admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:46:23.252827 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd3ecd6-b7f8-4136-84e1-95790f4bb00b admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:46:23.259602 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075a6657-2e42-49f7-99f9-cd0c47f03b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:46:23.261020 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a6657-2e42-49f7-99f9-cd0c47f03b8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:23.261544 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a6657-2e42-49f7-99f9-cd0c47f03b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:23.262064 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a6657-2e42-49f7-99f9-cd0c47f03b8a admin admin] PATH_INFO: `/v3/projects/f7efaf8e58b5488dbcb89b872a61bd71/users/5daf3581cb154d1584483b2b329ac933/roles/0d41da7bec094450b5bff4e4831be52c` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:23.280082 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075a6657-2e42-49f7-99f9-cd0c47f03b8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7efaf8e58b5488dbcb89b872a61bd71, user_id=5daf3581cb154d1584483b2b329ac933, role_id=0d41da7bec094450b5bff4e4831be52c)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:46:23.284821 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075a6657-2e42-49f7-99f9-cd0c47f03b8a admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:46:23.494612 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1197/2406] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:46:23 2022] PUT /identity/v3/projects/f7efaf8e58b5488dbcb89b872a61bd71/users/5daf3581cb154d1584483b2b329ac933/roles/0d41da7bec094450b5bff4e4831be52c => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:46:23.560475 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6197507a-b4f4-4ec8-be15-95e9d60b6760 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:23.560787 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6197507a-b4f4-4ec8-be15-95e9d60b6760 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:23.561022 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6197507a-b4f4-4ec8-be15-95e9d60b6760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:23.590408 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-6197507a-b4f4-4ec8-be15-95e9d60b6760 None None] MFA Rules not processed for user `5daf3581cb154d1584483b2b329ac933`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:46:23.592546 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-6197507a-b4f4-4ec8-be15-95e9d60b6760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:46:23.665818 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1210/2407] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:46:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:46:23.677693 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075a6657-2e42-49f7-99f9-cd0c47f03b8a admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:46:23.679327 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-075a6657-2e42-49f7-99f9-cd0c47f03b8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:46:23.742443 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075a6657-2e42-49f7-99f9-cd0c47f03b8a admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:46:23.746710 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb9cce-c73d-4ed6-a575-9a36a6e24a37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '950b5b5f690d41509ead753065a0b793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:46:23.747423 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb9cce-c73d-4ed6-a575-9a36a6e24a37 service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:23.747759 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb9cce-c73d-4ed6-a575-9a36a6e24a37 service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:23.748041 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb9cce-c73d-4ed6-a575-9a36a6e24a37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:23.758428 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fb9cce-c73d-4ed6-a575-9a36a6e24a37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:46:23.759942 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fb9cce-c73d-4ed6-a575-9a36a6e24a37 service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:46:23.770726 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1198/2408] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:46:23 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:47:00.708858 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6197507a-b4f4-4ec8-be15-95e9d60b6760 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:47:00.790210 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6197507a-b4f4-4ec8-be15-95e9d60b6760 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:47:00.796291 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf7d079-1eb4-4dbf-b4b2-2934b3d80253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:47:00.797252 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7d079-1eb4-4dbf-b4b2-2934b3d80253 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:47:00.797563 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7d079-1eb4-4dbf-b4b2-2934b3d80253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:47:00.797837 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7d079-1eb4-4dbf-b4b2-2934b3d80253 admin admin] PATH_INFO: `/v3/users/5daf3581cb154d1584483b2b329ac933` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:47:00.799144 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf7d079-1eb4-4dbf-b4b2-2934b3d80253 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5daf3581cb154d1584483b2b329ac933)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:47:00.801514 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf7d079-1eb4-4dbf-b4b2-2934b3d80253 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:47:01.055005 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-cdf7d079-1eb4-4dbf-b4b2-2934b3d80253 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5daf3581cb154d1584483b2b329ac933'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:47:01.055705 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-cdf7d079-1eb4-4dbf-b4b2-2934b3d80253 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5daf3581cb154d1584483b2b329ac933'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:47:01.156476 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-cdf7d079-1eb4-4dbf-b4b2-2934b3d80253 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5daf3581cb154d1584483b2b329ac933'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:47:01.164076 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-cdf7d079-1eb4-4dbf-b4b2-2934b3d80253 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5daf3581cb154d1584483b2b329ac933'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:47:01.176518 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-cdf7d079-1eb4-4dbf-b4b2-2934b3d80253 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5daf3581cb154d1584483b2b329ac933'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:47:01.185393 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1211/2409] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:47:00 2022] DELETE /identity/v3/users/5daf3581cb154d1584483b2b329ac933 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:47:01.190516 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ced4ec-1d30-4248-ab30-a97aa0c7b8f5 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:47:01.192945 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ced4ec-1d30-4248-ab30-a97aa0c7b8f5 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:47:01.192945 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ced4ec-1d30-4248-ab30-a97aa0c7b8f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:47:01.208338 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-60ced4ec-1d30-4248-ab30-a97aa0c7b8f5 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:47:01.209557 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-60ced4ec-1d30-4248-ab30-a97aa0c7b8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:47:01.271419 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1199/2410] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:47:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:47:01.282429 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf7d079-1eb4-4dbf-b4b2-2934b3d80253 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:47:01.284030 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-cdf7d079-1eb4-4dbf-b4b2-2934b3d80253 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:47:01.354545 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf7d079-1eb4-4dbf-b4b2-2934b3d80253 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:47:01.356676 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4dc500-308e-4329-9697-dfd9ba2c708e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:47:01.359336 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4dc500-308e-4329-9697-dfd9ba2c708e service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:47:01.359336 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4dc500-308e-4329-9697-dfd9ba2c708e service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:47:01.359336 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4dc500-308e-4329-9697-dfd9ba2c708e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:47:01.369150 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4dc500-308e-4329-9697-dfd9ba2c708e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:47:01.370791 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4dc500-308e-4329-9697-dfd9ba2c708e service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:47:01.382838 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1212/2411] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:47:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 16:47:01.905689 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ced4ec-1d30-4248-ab30-a97aa0c7b8f5 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:47:01.907098 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-60ced4ec-1d30-4248-ab30-a97aa0c7b8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:47:01.920859 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ced4ec-1d30-4248-ab30-a97aa0c7b8f5 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:47:01.925560 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992988c2-d5b6-4c51-bbb6-380746d40731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:47:01.926698 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992988c2-d5b6-4c51-bbb6-380746d40731 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:47:01.927115 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992988c2-d5b6-4c51-bbb6-380746d40731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:47:01.927395 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992988c2-d5b6-4c51-bbb6-380746d40731 admin admin] PATH_INFO: `/v3/projects/f7efaf8e58b5488dbcb89b872a61bd71` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:47:01.928653 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992988c2-d5b6-4c51-bbb6-380746d40731 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7efaf8e58b5488dbcb89b872a61bd71)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:47:01.930694 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992988c2-d5b6-4c51-bbb6-380746d40731 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:47:02.035651 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-992988c2-d5b6-4c51-bbb6-380746d40731 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7efaf8e58b5488dbcb89b872a61bd71', 'request_id': 'req-992988c2-d5b6-4c51-bbb6-380746d40731'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:47:02.081616 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-992988c2-d5b6-4c51-bbb6-380746d40731 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7efaf8e58b5488dbcb89b872a61bd71', 'request_id': 'req-992988c2-d5b6-4c51-bbb6-380746d40731'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:47:02.088412 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-992988c2-d5b6-4c51-bbb6-380746d40731 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7efaf8e58b5488dbcb89b872a61bd71', 'request_id': 'req-992988c2-d5b6-4c51-bbb6-380746d40731'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:47:02.100317 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-992988c2-d5b6-4c51-bbb6-380746d40731 admin admin] The token cache is being invalidate because project f7efaf8e58b5488dbcb89b872a61bd71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:47:02.100601 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-992988c2-d5b6-4c51-bbb6-380746d40731 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:47:02.101260 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-992988c2-d5b6-4c51-bbb6-380746d40731 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:47:02.102792 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1200/2412] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:47:01 2022] DELETE /identity/v3/projects/f7efaf8e58b5488dbcb89b872a61bd71 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:47:02.501191 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4dc500-308e-4329-9697-dfd9ba2c708e service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:47:02.502651 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-6d4dc500-308e-4329-9697-dfd9ba2c708e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:47:02.516148 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4dc500-308e-4329-9697-dfd9ba2c708e service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:47:02.580304 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e396361a-4896-4bed-b711-c1773e1598aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:47:02.581308 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e396361a-4896-4bed-b711-c1773e1598aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:47:02.581593 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e396361a-4896-4bed-b711-c1773e1598aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:47:02.581871 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e396361a-4896-4bed-b711-c1773e1598aa admin admin] PATH_INFO: `/v3/users/21ac41c41e914fb29fa4284b040bc3d5` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:47:02.583175 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e396361a-4896-4bed-b711-c1773e1598aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=21ac41c41e914fb29fa4284b040bc3d5)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:47:02.585171 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e396361a-4896-4bed-b711-c1773e1598aa admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:47:02.766765 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e396361a-4896-4bed-b711-c1773e1598aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21ac41c41e914fb29fa4284b040bc3d5'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:47:02.767368 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e396361a-4896-4bed-b711-c1773e1598aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21ac41c41e914fb29fa4284b040bc3d5'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:47:02.860039 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e396361a-4896-4bed-b711-c1773e1598aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21ac41c41e914fb29fa4284b040bc3d5'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:47:02.867940 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e396361a-4896-4bed-b711-c1773e1598aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21ac41c41e914fb29fa4284b040bc3d5'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:47:02.880402 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e396361a-4896-4bed-b711-c1773e1598aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21ac41c41e914fb29fa4284b040bc3d5'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:47:02.887029 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1213/2413] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:47:02 2022] DELETE /identity/v3/users/21ac41c41e914fb29fa4284b040bc3d5 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:47:02.892406 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c18172-7242-4068-b2f6-001067a55c9d None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:47:02.893287 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c18172-7242-4068-b2f6-001067a55c9d None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:47:02.893287 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c18172-7242-4068-b2f6-001067a55c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:47:02.913149 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-12c18172-7242-4068-b2f6-001067a55c9d None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:47:02.914416 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-12c18172-7242-4068-b2f6-001067a55c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:47:02.976932 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1201/2414] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:47:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:47:02.987568 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e396361a-4896-4bed-b711-c1773e1598aa admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:47:02.988980 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e396361a-4896-4bed-b711-c1773e1598aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:47:03.046950 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e396361a-4896-4bed-b711-c1773e1598aa admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:47:03.050483 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f6e4d0-4019-444e-be71-3c7d4216f543 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:47:03.051381 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6e4d0-4019-444e-be71-3c7d4216f543 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:47:03.051694 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6e4d0-4019-444e-be71-3c7d4216f543 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:47:03.051973 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6e4d0-4019-444e-be71-3c7d4216f543 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:47:03.061054 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f6e4d0-4019-444e-be71-3c7d4216f543 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:47:03.062473 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f6e4d0-4019-444e-be71-3c7d4216f543 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:47:03.080066 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1214/2415] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:47:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:47:03.746360 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c18172-7242-4068-b2f6-001067a55c9d None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:47:03.749794 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-12c18172-7242-4068-b2f6-001067a55c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:47:03.774511 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c18172-7242-4068-b2f6-001067a55c9d None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:47:03.780422 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0543e09b-f89e-4e31-bdae-b1ca22df1f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:47:03.781297 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543e09b-f89e-4e31-bdae-b1ca22df1f7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:47:03.781581 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543e09b-f89e-4e31-bdae-b1ca22df1f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:47:03.781855 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543e09b-f89e-4e31-bdae-b1ca22df1f7e admin admin] PATH_INFO: `/v3/projects/cc5c21b2aa334d44bc93d8909899f087` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:47:03.783112 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0543e09b-f89e-4e31-bdae-b1ca22df1f7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc5c21b2aa334d44bc93d8909899f087)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:47:03.785123 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0543e09b-f89e-4e31-bdae-b1ca22df1f7e admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:47:03.949017 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-0543e09b-f89e-4e31-bdae-b1ca22df1f7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc5c21b2aa334d44bc93d8909899f087', 'request_id': 'req-0543e09b-f89e-4e31-bdae-b1ca22df1f7e'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:47:04.053401 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-0543e09b-f89e-4e31-bdae-b1ca22df1f7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc5c21b2aa334d44bc93d8909899f087', 'request_id': 'req-0543e09b-f89e-4e31-bdae-b1ca22df1f7e'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:47:04.060571 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-0543e09b-f89e-4e31-bdae-b1ca22df1f7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc5c21b2aa334d44bc93d8909899f087', 'request_id': 'req-0543e09b-f89e-4e31-bdae-b1ca22df1f7e'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:47:04.077563 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-0543e09b-f89e-4e31-bdae-b1ca22df1f7e admin admin] The token cache is being invalidate because project cc5c21b2aa334d44bc93d8909899f087 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:47:04.077866 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-0543e09b-f89e-4e31-bdae-b1ca22df1f7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:47:04.078530 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-0543e09b-f89e-4e31-bdae-b1ca22df1f7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:47:04.080258 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1202/2416] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:47:03 2022] DELETE /identity/v3/projects/cc5c21b2aa334d44bc93d8909899f087 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:47:04.085801 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f8abb-188e-4d65-af63-7746493889e8 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:47:04.086262 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f8abb-188e-4d65-af63-7746493889e8 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:47:04.086423 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f8abb-188e-4d65-af63-7746493889e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:47:04.106927 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-6c1f8abb-188e-4d65-af63-7746493889e8 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:47:04.109213 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-6c1f8abb-188e-4d65-af63-7746493889e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:47:04.186016 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1215/2417] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:47:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:47:04.200799 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50126dc5-28e8-4094-937a-0d79a0f7d4d3 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:47:04.201994 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50126dc5-28e8-4094-937a-0d79a0f7d4d3 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:47:04.202381 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50126dc5-28e8-4094-937a-0d79a0f7d4d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:47:04.224211 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-50126dc5-28e8-4094-937a-0d79a0f7d4d3 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:47:04.225528 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-50126dc5-28e8-4094-937a-0d79a0f7d4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:47:04.239565 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1203/2418] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:47:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:47:04.242984 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1f8abb-188e-4d65-af63-7746493889e8 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:47:04.259847 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1f8abb-188e-4d65-af63-7746493889e8 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:47:04.268107 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc31ab-839c-4411-aeaa-58549ba639b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:47:04.269293 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc31ab-839c-4411-aeaa-58549ba639b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:47:04.269771 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc31ab-839c-4411-aeaa-58549ba639b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:47:04.270438 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc31ab-839c-4411-aeaa-58549ba639b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:47:04.271711 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcc31ab-839c-4411-aeaa-58549ba639b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:47:04.272282 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcc31ab-839c-4411-aeaa-58549ba639b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:47:04.275462 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcc31ab-839c-4411-aeaa-58549ba639b7 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:47:04.300114 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1216/2419] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Apr 11 16:47:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:47:04.305767 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50126dc5-28e8-4094-937a-0d79a0f7d4d3 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:47:04.323744 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50126dc5-28e8-4094-937a-0d79a0f7d4d3 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:47:04.332382 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5635fe-af9e-43a8-8eb6-042e1754e460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:47:04.333557 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5635fe-af9e-43a8-8eb6-042e1754e460 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:47:04.334018 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5635fe-af9e-43a8-8eb6-042e1754e460 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:47:04.334487 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5635fe-af9e-43a8-8eb6-042e1754e460 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:47:04.335820 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5635fe-af9e-43a8-8eb6-042e1754e460 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:47:04.339673 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5635fe-af9e-43a8-8eb6-042e1754e460 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:47:04.462635 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1204/2420] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:47:04 2022] POST /identity/v3/projects => generated 383 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:47:04.468197 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc31ab-839c-4411-aeaa-58549ba639b7 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:47:04.485305 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc31ab-839c-4411-aeaa-58549ba639b7 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:47:04.599465 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b11acc-6842-41e4-832a-ce0e524bb91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:47:04.600961 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b11acc-6842-41e4-832a-ce0e524bb91a admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:47:04.601518 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b11acc-6842-41e4-832a-ce0e524bb91a admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:47:04.602013 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b11acc-6842-41e4-832a-ce0e524bb91a admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:47:04.603336 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b11acc-6842-41e4-832a-ce0e524bb91a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:47:04.607330 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b11acc-6842-41e4-832a-ce0e524bb91a admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:47:04.708905 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1217/2421] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:47:04 2022] POST /identity/v3/users => generated 292 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:47:04.712350 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5635fe-af9e-43a8-8eb6-042e1754e460 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:47:04.729923 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5635fe-af9e-43a8-8eb6-042e1754e460 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:47:04.738320 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb047b7-0d42-4370-8e10-562be1eaf983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:47:04.739705 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb047b7-0d42-4370-8e10-562be1eaf983 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:47:04.743334 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb047b7-0d42-4370-8e10-562be1eaf983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:47:04.743334 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb047b7-0d42-4370-8e10-562be1eaf983 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:47:04.743334 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb047b7-0d42-4370-8e10-562be1eaf983 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:47:04.744923 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb047b7-0d42-4370-8e10-562be1eaf983 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:47:04.768357 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1205/2422] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:47:04 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 16:47:04.784603 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b11acc-6842-41e4-832a-ce0e524bb91a admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:47:04.798851 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b11acc-6842-41e4-832a-ce0e524bb91a admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:47:04.809597 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe31e3fa-a794-453e-9040-b3be5471942c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:47:04.810983 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31e3fa-a794-453e-9040-b3be5471942c admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:47:04.811447 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31e3fa-a794-453e-9040-b3be5471942c admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:47:04.812023 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31e3fa-a794-453e-9040-b3be5471942c admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:47:04.813133 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe31e3fa-a794-453e-9040-b3be5471942c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:47:04.815509 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe31e3fa-a794-453e-9040-b3be5471942c admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:47:04.834209 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1218/2423] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:47:04 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:47:04.839759 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb047b7-0d42-4370-8e10-562be1eaf983 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:47:04.855654 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb047b7-0d42-4370-8e10-562be1eaf983 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:47:04.862557 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f3a0f-85c9-40fc-8516-93de171008d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:47:04.864047 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f3a0f-85c9-40fc-8516-93de171008d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:47:04.864527 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f3a0f-85c9-40fc-8516-93de171008d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:47:04.864970 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f3a0f-85c9-40fc-8516-93de171008d5 admin admin] PATH_INFO: `/v3/projects/e0387bb3fbf2485c8a6008defba1ba37/users/a6d703d5066b4909b00a0886a8437900/roles/0d41da7bec094450b5bff4e4831be52c` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:47:04.891537 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139f3a0f-85c9-40fc-8516-93de171008d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0387bb3fbf2485c8a6008defba1ba37, user_id=a6d703d5066b4909b00a0886a8437900, role_id=0d41da7bec094450b5bff4e4831be52c)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:47:04.897926 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139f3a0f-85c9-40fc-8516-93de171008d5 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:47:05.007774 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1206/2424] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:47:04 2022] PUT /identity/v3/projects/e0387bb3fbf2485c8a6008defba1ba37/users/a6d703d5066b4909b00a0886a8437900/roles/0d41da7bec094450b5bff4e4831be52c => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:47:05.022102 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f40872-30c2-4be5-8b02-268e96922b93 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:47:05.022830 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f40872-30c2-4be5-8b02-268e96922b93 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:47:05.023436 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f40872-30c2-4be5-8b02-268e96922b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:47:05.054469 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-e5f40872-30c2-4be5-8b02-268e96922b93 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:47:05.055923 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e5f40872-30c2-4be5-8b02-268e96922b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:47:05.175873 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1219/2425] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:47:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:47:05.186038 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f3a0f-85c9-40fc-8516-93de171008d5 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:47:05.186773 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-139f3a0f-85c9-40fc-8516-93de171008d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:47:05.285870 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f3a0f-85c9-40fc-8516-93de171008d5 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:47:05.292554 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e34fae8-6dcc-47e0-ab25-6cdd82ef772c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:47:05.293708 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e34fae8-6dcc-47e0-ab25-6cdd82ef772c service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:47:05.294202 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e34fae8-6dcc-47e0-ab25-6cdd82ef772c service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:47:05.294689 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e34fae8-6dcc-47e0-ab25-6cdd82ef772c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:47:05.316784 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e34fae8-6dcc-47e0-ab25-6cdd82ef772c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:47:05.319493 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e34fae8-6dcc-47e0-ab25-6cdd82ef772c service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:47:05.338881 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1207/2426] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:47:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:47:05.958901 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b39ed-148b-435c-b378-fb8aa55a3144 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:47:05.959330 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b39ed-148b-435c-b378-fb8aa55a3144 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:47:05.960061 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b39ed-148b-435c-b378-fb8aa55a3144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:47:05.984854 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-d08b39ed-148b-435c-b378-fb8aa55a3144 None None] MFA Rules not processed for user `cfe598c377a74986b6452e5ea8a1180e`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:47:05.986272 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-d08b39ed-148b-435c-b378-fb8aa55a3144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:47:06.063920 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1220/2427] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:47:05 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:47:06.906455 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75131b-3990-4f37-be9f-e00af3973562 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:47:06.908794 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75131b-3990-4f37-be9f-e00af3973562 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:47:06.914108 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75131b-3990-4f37-be9f-e00af3973562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:47:07.024361 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-3a75131b-3990-4f37-be9f-e00af3973562 None None] MFA Rules not processed for user `a6d703d5066b4909b00a0886a8437900`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:47:07.028324 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-3a75131b-3990-4f37-be9f-e00af3973562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:47:07.185122 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1208/2428] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:47:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:47:07.198023 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08b39ed-148b-435c-b378-fb8aa55a3144 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:47:07.200333 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-d08b39ed-148b-435c-b378-fb8aa55a3144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:47:07.284353 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08b39ed-148b-435c-b378-fb8aa55a3144 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:47:07.291778 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d80960-d136-44c5-a511-388221633d48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '950b5b5f690d41509ead753065a0b793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:47:07.292990 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d80960-d136-44c5-a511-388221633d48 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:47:07.293474 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d80960-d136-44c5-a511-388221633d48 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:47:07.293938 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d80960-d136-44c5-a511-388221633d48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:47:07.313270 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d80960-d136-44c5-a511-388221633d48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:47:07.316389 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d80960-d136-44c5-a511-388221633d48 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:47:07.331244 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1221/2429] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:47:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 16:47:10.294188 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc8c40-31a0-4755-8941-07f541be7916 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:47:10.294859 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc8c40-31a0-4755-8941-07f541be7916 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:47:10.294859 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc8c40-31a0-4755-8941-07f541be7916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:47:10.314815 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-f5bc8c40-31a0-4755-8941-07f541be7916 None None] MFA Rules not processed for user `a6d703d5066b4909b00a0886a8437900`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:47:10.316118 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-f5bc8c40-31a0-4755-8941-07f541be7916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:47:10.323847 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1209/2430] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:47:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:47:32.257867 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d80960-d136-44c5-a511-388221633d48 service cinder] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:47:32.259403 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-61d80960-d136-44c5-a511-388221633d48 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:47:32.275182 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d80960-d136-44c5-a511-388221633d48 service cinder] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:47:32.282709 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d86965-cd27-45d5-b3f3-8d65189d571d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:47:32.283604 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d86965-cd27-45d5-b3f3-8d65189d571d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:47:32.284582 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d86965-cd27-45d5-b3f3-8d65189d571d admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:47:32.284874 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d86965-cd27-45d5-b3f3-8d65189d571d admin admin] PATH_INFO: `/v3/users/5c9b34ddcbe64603a81a9fa05c4c3a2a` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:47:32.286972 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d86965-cd27-45d5-b3f3-8d65189d571d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c9b34ddcbe64603a81a9fa05c4c3a2a)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:47:32.289695 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d86965-cd27-45d5-b3f3-8d65189d571d admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:47:32.592373 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-42d86965-cd27-45d5-b3f3-8d65189d571d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c9b34ddcbe64603a81a9fa05c4c3a2a'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:47:32.593528 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-42d86965-cd27-45d5-b3f3-8d65189d571d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c9b34ddcbe64603a81a9fa05c4c3a2a'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:47:32.686491 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-42d86965-cd27-45d5-b3f3-8d65189d571d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c9b34ddcbe64603a81a9fa05c4c3a2a'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:47:32.695486 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-42d86965-cd27-45d5-b3f3-8d65189d571d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c9b34ddcbe64603a81a9fa05c4c3a2a'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:47:32.707843 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-42d86965-cd27-45d5-b3f3-8d65189d571d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c9b34ddcbe64603a81a9fa05c4c3a2a'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:47:32.713833 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1222/2431] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:47:32 2022] DELETE /identity/v3/users/5c9b34ddcbe64603a81a9fa05c4c3a2a => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:47:32.719133 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19adc112-699b-48c6-bff7-896f70e6474c None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:47:32.719682 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19adc112-699b-48c6-bff7-896f70e6474c None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:47:32.723945 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19adc112-699b-48c6-bff7-896f70e6474c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:47:32.738283 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-19adc112-699b-48c6-bff7-896f70e6474c None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:47:32.739730 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-19adc112-699b-48c6-bff7-896f70e6474c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:47:32.808069 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1210/2432] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:47:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:47:32.819093 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d86965-cd27-45d5-b3f3-8d65189d571d admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:47:32.820643 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-42d86965-cd27-45d5-b3f3-8d65189d571d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:47:32.877380 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d86965-cd27-45d5-b3f3-8d65189d571d admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:47:32.881112 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3f0503-df0d-4c9e-b949-9e84772cb149 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:47:32.881848 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f0503-df0d-4c9e-b949-9e84772cb149 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:47:32.882217 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f0503-df0d-4c9e-b949-9e84772cb149 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:47:32.882593 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f0503-df0d-4c9e-b949-9e84772cb149 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:47:32.892056 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3f0503-df0d-4c9e-b949-9e84772cb149 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:47:32.893471 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3f0503-df0d-4c9e-b949-9e84772cb149 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:47:32.904149 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1223/2433] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:47:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:47:33.395114 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19adc112-699b-48c6-bff7-896f70e6474c None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:47:33.397936 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-19adc112-699b-48c6-bff7-896f70e6474c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:47:33.438341 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19adc112-699b-48c6-bff7-896f70e6474c None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:47:33.445983 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad005e63-a528-4226-b1e0-80b4f2b67850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:47:33.447797 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad005e63-a528-4226-b1e0-80b4f2b67850 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:47:33.448529 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad005e63-a528-4226-b1e0-80b4f2b67850 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:47:33.449183 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad005e63-a528-4226-b1e0-80b4f2b67850 admin admin] PATH_INFO: `/v3/projects/6567af01cd114e04a6cb82b77f775865` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:47:33.452177 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad005e63-a528-4226-b1e0-80b4f2b67850 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6567af01cd114e04a6cb82b77f775865)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:47:33.455387 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad005e63-a528-4226-b1e0-80b4f2b67850 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:47:33.620449 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-ad005e63-a528-4226-b1e0-80b4f2b67850 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6567af01cd114e04a6cb82b77f775865', 'request_id': 'req-ad005e63-a528-4226-b1e0-80b4f2b67850'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:47:33.691859 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-ad005e63-a528-4226-b1e0-80b4f2b67850 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6567af01cd114e04a6cb82b77f775865', 'request_id': 'req-ad005e63-a528-4226-b1e0-80b4f2b67850'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:47:33.697816 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-ad005e63-a528-4226-b1e0-80b4f2b67850 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6567af01cd114e04a6cb82b77f775865', 'request_id': 'req-ad005e63-a528-4226-b1e0-80b4f2b67850'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:47:33.709874 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-ad005e63-a528-4226-b1e0-80b4f2b67850 admin admin] The token cache is being invalidate because project 6567af01cd114e04a6cb82b77f775865 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:47:33.710162 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-ad005e63-a528-4226-b1e0-80b4f2b67850 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:47:33.710834 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-ad005e63-a528-4226-b1e0-80b4f2b67850 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:47:33.712409 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1211/2434] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:47:33 2022] DELETE /identity/v3/projects/6567af01cd114e04a6cb82b77f775865 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:47:43.317847 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80edf0f1-a6c8-465f-bba4-e8370449affe None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:47:43.318434 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80edf0f1-a6c8-465f-bba4-e8370449affe None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:47:43.318434 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80edf0f1-a6c8-465f-bba4-e8370449affe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:47:43.338313 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-80edf0f1-a6c8-465f-bba4-e8370449affe None None] MFA Rules not processed for user `3252c48fdd5747a29fe4ba89e7162216`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:47:43.339576 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-80edf0f1-a6c8-465f-bba4-e8370449affe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:47:43.400679 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1224/2435] 10.222.0.43 () {58 vars in 1009 bytes} [Mon Apr 11 16:47:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:47:43.617199 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad005e63-a528-4226-b1e0-80b4f2b67850 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:47:43.619100 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-ad005e63-a528-4226-b1e0-80b4f2b67850 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:47:43.690396 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad005e63-a528-4226-b1e0-80b4f2b67850 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:47:43.695250 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78bfeb-1960-437b-be4f-d1c10e813b34 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb193a1a7abd430fbbcccab970e4f37c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:47:43.695960 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78bfeb-1960-437b-be4f-d1c10e813b34 service swift] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:47:43.696240 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78bfeb-1960-437b-be4f-d1c10e813b34 service swift] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:47:43.696514 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78bfeb-1960-437b-be4f-d1c10e813b34 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:47:43.705217 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee78bfeb-1960-437b-be4f-d1c10e813b34 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:47:43.706792 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee78bfeb-1960-437b-be4f-d1c10e813b34 service swift] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:47:43.714707 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1212/2436] 10.222.0.43 () {60 vars in 1384 bytes} [Mon Apr 11 16:47:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 11 16:48:02.438401 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e90fa1-68c9-4943-bc4c-57367478fc21 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:48:02.438920 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e90fa1-68c9-4943-bc4c-57367478fc21 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:48:02.439019 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e90fa1-68c9-4943-bc4c-57367478fc21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:48:02.457030 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-67e90fa1-68c9-4943-bc4c-57367478fc21 None None] MFA Rules not processed for user `3252c48fdd5747a29fe4ba89e7162216`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:48:02.458214 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-67e90fa1-68c9-4943-bc4c-57367478fc21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:48:02.465627 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1225/2437] 10.222.0.43 () {58 vars in 967 bytes} [Mon Apr 11 16:48:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:48:02.477876 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78bfeb-1960-437b-be4f-d1c10e813b34 service swift] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:48:02.489074 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78bfeb-1960-437b-be4f-d1c10e813b34 service swift] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:48:02.494135 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c35b1-36c3-495d-b741-268b7db683ba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb193a1a7abd430fbbcccab970e4f37c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:48:02.494781 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c35b1-36c3-495d-b741-268b7db683ba service swift] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:48:02.495066 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c35b1-36c3-495d-b741-268b7db683ba service swift] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:48:02.495343 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c35b1-36c3-495d-b741-268b7db683ba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:48:02.505662 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607c35b1-36c3-495d-b741-268b7db683ba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:48:02.507308 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607c35b1-36c3-495d-b741-268b7db683ba service swift] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:48:02.523118 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1213/2438] 10.222.0.43 () {60 vars in 1384 bytes} [Mon Apr 11 16:48:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 11 16:48:03.847997 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad9f33-ff7e-49fe-b6ca-a79410acbf1f None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:48:03.848601 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad9f33-ff7e-49fe-b6ca-a79410acbf1f None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:48:03.848706 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad9f33-ff7e-49fe-b6ca-a79410acbf1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:48:03.871925 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-8fad9f33-ff7e-49fe-b6ca-a79410acbf1f None None] MFA Rules not processed for user `3252c48fdd5747a29fe4ba89e7162216`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:48:03.873286 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-8fad9f33-ff7e-49fe-b6ca-a79410acbf1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:48:03.881517 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1226/2439] 10.222.0.43 () {58 vars in 1009 bytes} [Mon Apr 11 16:48:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:48:03.894676 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c35b1-36c3-495d-b741-268b7db683ba service swift] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:48:03.910164 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c35b1-36c3-495d-b741-268b7db683ba service swift] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:48:03.915432 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cde10b1-df64-4b1b-b3e5-1896684c99ed service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb193a1a7abd430fbbcccab970e4f37c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:48:03.916107 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde10b1-df64-4b1b-b3e5-1896684c99ed service swift] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:48:03.916389 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde10b1-df64-4b1b-b3e5-1896684c99ed service swift] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:48:03.916662 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde10b1-df64-4b1b-b3e5-1896684c99ed service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:48:03.925660 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cde10b1-df64-4b1b-b3e5-1896684c99ed service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:48:03.927231 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cde10b1-df64-4b1b-b3e5-1896684c99ed service swift] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:48:03.935484 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1214/2440] 10.222.0.43 () {60 vars in 1384 bytes} [Mon Apr 11 16:48:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 11 16:48:05.984844 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad9f33-ff7e-49fe-b6ca-a79410acbf1f None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:48:05.984844 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-8fad9f33-ff7e-49fe-b6ca-a79410acbf1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:48:06.078823 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad9f33-ff7e-49fe-b6ca-a79410acbf1f None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:48:06.083812 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9c7b38-c80a-42f5-af82-55aec62e4871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:48:06.084824 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c7b38-c80a-42f5-af82-55aec62e4871 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:48:06.085303 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c7b38-c80a-42f5-af82-55aec62e4871 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:48:06.085868 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c7b38-c80a-42f5-af82-55aec62e4871 admin admin] PATH_INFO: `/v3/users/cfe598c377a74986b6452e5ea8a1180e` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:48:06.087604 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9c7b38-c80a-42f5-af82-55aec62e4871 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfe598c377a74986b6452e5ea8a1180e)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:48:06.090249 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9c7b38-c80a-42f5-af82-55aec62e4871 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:48:06.324007 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-fd9c7b38-c80a-42f5-af82-55aec62e4871 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfe598c377a74986b6452e5ea8a1180e'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:48:06.324708 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-fd9c7b38-c80a-42f5-af82-55aec62e4871 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfe598c377a74986b6452e5ea8a1180e'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:48:06.399442 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-fd9c7b38-c80a-42f5-af82-55aec62e4871 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfe598c377a74986b6452e5ea8a1180e'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:48:06.407542 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-fd9c7b38-c80a-42f5-af82-55aec62e4871 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfe598c377a74986b6452e5ea8a1180e'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:48:06.422714 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-fd9c7b38-c80a-42f5-af82-55aec62e4871 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfe598c377a74986b6452e5ea8a1180e'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:48:06.430058 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1227/2441] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:48:05 2022] DELETE /identity/v3/users/cfe598c377a74986b6452e5ea8a1180e => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:48:06.776463 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cde10b1-df64-4b1b-b3e5-1896684c99ed service swift] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:48:06.804730 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cde10b1-df64-4b1b-b3e5-1896684c99ed service swift] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:48:06.887549 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a616bbdf-25bf-48a0-bde9-e88bde3a3ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:48:06.888813 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a616bbdf-25bf-48a0-bde9-e88bde3a3ba6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:48:06.889144 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a616bbdf-25bf-48a0-bde9-e88bde3a3ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:48:06.889420 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a616bbdf-25bf-48a0-bde9-e88bde3a3ba6 admin admin] PATH_INFO: `/v3/projects/89f8b5098b66454f88c79b581c9836e4` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:48:06.891929 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a616bbdf-25bf-48a0-bde9-e88bde3a3ba6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89f8b5098b66454f88c79b581c9836e4)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:48:06.894088 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a616bbdf-25bf-48a0-bde9-e88bde3a3ba6 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:48:07.013682 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a616bbdf-25bf-48a0-bde9-e88bde3a3ba6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89f8b5098b66454f88c79b581c9836e4', 'request_id': 'req-a616bbdf-25bf-48a0-bde9-e88bde3a3ba6'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:48:07.091922 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a616bbdf-25bf-48a0-bde9-e88bde3a3ba6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89f8b5098b66454f88c79b581c9836e4', 'request_id': 'req-a616bbdf-25bf-48a0-bde9-e88bde3a3ba6'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:48:07.099183 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a616bbdf-25bf-48a0-bde9-e88bde3a3ba6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89f8b5098b66454f88c79b581c9836e4', 'request_id': 'req-a616bbdf-25bf-48a0-bde9-e88bde3a3ba6'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:48:07.116403 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a616bbdf-25bf-48a0-bde9-e88bde3a3ba6 admin admin] The token cache is being invalidate because project 89f8b5098b66454f88c79b581c9836e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:48:07.116971 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a616bbdf-25bf-48a0-bde9-e88bde3a3ba6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:48:07.117663 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a616bbdf-25bf-48a0-bde9-e88bde3a3ba6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:48:07.120716 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1215/2442] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:48:06 2022] DELETE /identity/v3/projects/89f8b5098b66454f88c79b581c9836e4 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:48:07.128324 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb5fa86-9c3c-462b-94aa-e6037839736a None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:48:07.128833 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb5fa86-9c3c-462b-94aa-e6037839736a None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:48:07.129835 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb5fa86-9c3c-462b-94aa-e6037839736a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:48:07.163157 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-9fb5fa86-9c3c-462b-94aa-e6037839736a None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:48:07.164698 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-9fb5fa86-9c3c-462b-94aa-e6037839736a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:48:07.246873 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1228/2443] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:48:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:48:07.254677 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae92a1-00ca-44f0-a77c-bb77322feb9a None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:48:07.254974 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae92a1-00ca-44f0-a77c-bb77322feb9a None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:48:07.255290 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae92a1-00ca-44f0-a77c-bb77322feb9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:48:07.276059 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-1bae92a1-00ca-44f0-a77c-bb77322feb9a None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:48:07.277978 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-1bae92a1-00ca-44f0-a77c-bb77322feb9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:48:07.286421 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1216/2444] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:48:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:48:07.290684 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb5fa86-9c3c-462b-94aa-e6037839736a None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:48:07.302340 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb5fa86-9c3c-462b-94aa-e6037839736a None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:48:07.308138 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76bffcb-a81e-4c08-8abe-160822d0a154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:48:07.309610 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76bffcb-a81e-4c08-8abe-160822d0a154 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:48:07.309900 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76bffcb-a81e-4c08-8abe-160822d0a154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:48:07.310184 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76bffcb-a81e-4c08-8abe-160822d0a154 admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:48:07.310926 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76bffcb-a81e-4c08-8abe-160822d0a154 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:48:07.311406 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76bffcb-a81e-4c08-8abe-160822d0a154 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:48:07.313059 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76bffcb-a81e-4c08-8abe-160822d0a154 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:48:07.326018 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1229/2445] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Apr 11 16:48:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:48:07.331115 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bae92a1-00ca-44f0-a77c-bb77322feb9a None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:48:07.343420 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bae92a1-00ca-44f0-a77c-bb77322feb9a None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:48:07.349708 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ad1956-6915-4c5b-865f-361e0b21d2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:48:07.350388 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad1956-6915-4c5b-865f-361e0b21d2fc admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:48:07.350674 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad1956-6915-4c5b-865f-361e0b21d2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:48:07.350954 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad1956-6915-4c5b-865f-361e0b21d2fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:48:07.351691 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ad1956-6915-4c5b-865f-361e0b21d2fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:48:07.353812 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ad1956-6915-4c5b-865f-361e0b21d2fc admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:48:07.475770 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1217/2446] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:48:07 2022] POST /identity/v3/projects => generated 373 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:48:07.488412 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76bffcb-a81e-4c08-8abe-160822d0a154 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:48:07.507658 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76bffcb-a81e-4c08-8abe-160822d0a154 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:48:07.617160 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3c6da7-a9e5-4bbb-bdd6-a04a9e6ef977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:48:07.617870 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c6da7-a9e5-4bbb-bdd6-a04a9e6ef977 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:48:07.618161 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c6da7-a9e5-4bbb-bdd6-a04a9e6ef977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:48:07.618440 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c6da7-a9e5-4bbb-bdd6-a04a9e6ef977 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:48:07.619164 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3c6da7-a9e5-4bbb-bdd6-a04a9e6ef977 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:48:07.621557 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3c6da7-a9e5-4bbb-bdd6-a04a9e6ef977 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:48:08.074840 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1230/2447] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:48:07 2022] POST /identity/v3/users => generated 287 bytes in 595 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:48:08.080455 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ad1956-6915-4c5b-865f-361e0b21d2fc admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:48:08.095944 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ad1956-6915-4c5b-865f-361e0b21d2fc admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:48:08.095944 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a893a2fe-21b2-4d26-bba1-7b1537ae44c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:48:08.096303 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893a2fe-21b2-4d26-bba1-7b1537ae44c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:48:08.096592 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893a2fe-21b2-4d26-bba1-7b1537ae44c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:48:08.096866 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893a2fe-21b2-4d26-bba1-7b1537ae44c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:48:08.097597 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a893a2fe-21b2-4d26-bba1-7b1537ae44c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:48:08.099182 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a893a2fe-21b2-4d26-bba1-7b1537ae44c2 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:48:08.249776 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1218/2448] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:48:08 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:48:08.253669 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3c6da7-a9e5-4bbb-bdd6-a04a9e6ef977 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:48:08.265155 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3c6da7-a9e5-4bbb-bdd6-a04a9e6ef977 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:48:08.269886 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa56431-4dd9-46ef-80ac-bdac68d4e177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:48:08.271801 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa56431-4dd9-46ef-80ac-bdac68d4e177 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:48:08.271801 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa56431-4dd9-46ef-80ac-bdac68d4e177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:48:08.271801 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa56431-4dd9-46ef-80ac-bdac68d4e177 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:48:08.272091 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa56431-4dd9-46ef-80ac-bdac68d4e177 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:48:08.273501 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa56431-4dd9-46ef-80ac-bdac68d4e177 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:48:08.284531 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1231/2449] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:48:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:48:08.288737 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a893a2fe-21b2-4d26-bba1-7b1537ae44c2 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:48:08.299322 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a893a2fe-21b2-4d26-bba1-7b1537ae44c2 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:48:08.304113 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2a979e-3f40-4d3a-9a4e-f61806da4b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:48:08.304994 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a979e-3f40-4d3a-9a4e-f61806da4b1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:48:08.305274 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a979e-3f40-4d3a-9a4e-f61806da4b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:48:08.305546 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a979e-3f40-4d3a-9a4e-f61806da4b1e admin admin] PATH_INFO: `/v3/projects/e519d5dba1a84daba1dfce70b3133bdb/users/4ff4a686fcd9483dbeaf1881f683a298/roles/0d41da7bec094450b5bff4e4831be52c` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:48:08.320364 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2a979e-3f40-4d3a-9a4e-f61806da4b1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e519d5dba1a84daba1dfce70b3133bdb, user_id=4ff4a686fcd9483dbeaf1881f683a298, role_id=0d41da7bec094450b5bff4e4831be52c)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:48:08.322992 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2a979e-3f40-4d3a-9a4e-f61806da4b1e admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:48:08.506857 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1219/2450] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:48:08 2022] PUT /identity/v3/projects/e519d5dba1a84daba1dfce70b3133bdb/users/4ff4a686fcd9483dbeaf1881f683a298/roles/0d41da7bec094450b5bff4e4831be52c => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:48:08.507086 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4912bb96-cf1a-448a-bf69-f45a1bfdcb78 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:48:08.507086 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4912bb96-cf1a-448a-bf69-f45a1bfdcb78 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:48:08.507086 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4912bb96-cf1a-448a-bf69-f45a1bfdcb78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:48:08.527021 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-4912bb96-cf1a-448a-bf69-f45a1bfdcb78 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:48:08.529778 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-4912bb96-cf1a-448a-bf69-f45a1bfdcb78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:48:08.605587 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1232/2451] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:48:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:48:08.616348 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2a979e-3f40-4d3a-9a4e-f61806da4b1e admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:48:08.618130 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-5d2a979e-3f40-4d3a-9a4e-f61806da4b1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:48:08.694835 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2a979e-3f40-4d3a-9a4e-f61806da4b1e admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:48:08.699526 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d48dd5a-d638-4b6c-88bc-88fb573c3c12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:48:08.700402 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d48dd5a-d638-4b6c-88bc-88fb573c3c12 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:48:08.700686 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d48dd5a-d638-4b6c-88bc-88fb573c3c12 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:48:08.700961 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d48dd5a-d638-4b6c-88bc-88fb573c3c12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:48:08.712662 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d48dd5a-d638-4b6c-88bc-88fb573c3c12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:48:08.714145 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d48dd5a-d638-4b6c-88bc-88fb573c3c12 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:48:08.727446 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1220/2452] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:48:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:48:16.267488 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f97ebae-afcc-4d05-83ed-f2061d7928e9 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:48:16.268088 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f97ebae-afcc-4d05-83ed-f2061d7928e9 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:48:16.268088 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f97ebae-afcc-4d05-83ed-f2061d7928e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:48:16.315308 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-1f97ebae-afcc-4d05-83ed-f2061d7928e9 None None] MFA Rules not processed for user `4ff4a686fcd9483dbeaf1881f683a298`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:48:16.315308 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-1f97ebae-afcc-4d05-83ed-f2061d7928e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:48:16.380640 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1233/2453] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:48:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:48:16.385314 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d48dd5a-d638-4b6c-88bc-88fb573c3c12 service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:48:16.396918 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d48dd5a-d638-4b6c-88bc-88fb573c3c12 service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:48:16.402707 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e564734d-b097-4e53-a082-e0a62c0b43dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:48:16.403560 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564734d-b097-4e53-a082-e0a62c0b43dd admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:48:16.403852 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564734d-b097-4e53-a082-e0a62c0b43dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:48:16.404130 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564734d-b097-4e53-a082-e0a62c0b43dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:48:16.405014 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e564734d-b097-4e53-a082-e0a62c0b43dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:48:16.406934 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e564734d-b097-4e53-a082-e0a62c0b43dd admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:48:16.561983 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1221/2454] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:48:16 2022] POST /identity/v3/projects => generated 371 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:48:16.566779 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f97ebae-afcc-4d05-83ed-f2061d7928e9 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:48:16.577679 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f97ebae-afcc-4d05-83ed-f2061d7928e9 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:48:16.642277 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f814ec-c0f1-445e-b163-fbd3fdcd0945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:48:16.643200 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f814ec-c0f1-445e-b163-fbd3fdcd0945 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:48:16.643495 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f814ec-c0f1-445e-b163-fbd3fdcd0945 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:48:16.643849 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f814ec-c0f1-445e-b163-fbd3fdcd0945 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:48:16.644806 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f814ec-c0f1-445e-b163-fbd3fdcd0945 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:48:16.647799 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f814ec-c0f1-445e-b163-fbd3fdcd0945 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:48:16.771777 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1234/2455] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:48:16 2022] POST /identity/v3/users => generated 292 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:48:16.776248 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e564734d-b097-4e53-a082-e0a62c0b43dd admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:48:16.790614 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e564734d-b097-4e53-a082-e0a62c0b43dd admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:48:16.796690 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a4a14d-aea5-4c41-9d0f-a2a069d347ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:48:16.797437 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a4a14d-aea5-4c41-9d0f-a2a069d347ae admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:48:16.797721 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a4a14d-aea5-4c41-9d0f-a2a069d347ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:48:16.798000 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a4a14d-aea5-4c41-9d0f-a2a069d347ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:48:16.799005 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a4a14d-aea5-4c41-9d0f-a2a069d347ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:48:16.800653 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a4a14d-aea5-4c41-9d0f-a2a069d347ae admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:48:16.813146 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1222/2456] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:48:16 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:48:16.817428 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f814ec-c0f1-445e-b163-fbd3fdcd0945 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:48:16.828755 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f814ec-c0f1-445e-b163-fbd3fdcd0945 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:48:16.833657 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0698efd2-7719-4c1d-93a1-8f7b70a2e492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:48:16.834601 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0698efd2-7719-4c1d-93a1-8f7b70a2e492 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:48:16.834888 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0698efd2-7719-4c1d-93a1-8f7b70a2e492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:48:16.835169 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0698efd2-7719-4c1d-93a1-8f7b70a2e492 admin admin] PATH_INFO: `/v3/projects/e6e861e727af4a5e9c5adca5c1a99835/users/ab2342a2e68b4c0ea39cac8fefc6aaad/roles/702e5e78b5d744529384b96a390ae92f` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:48:16.852354 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0698efd2-7719-4c1d-93a1-8f7b70a2e492 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6e861e727af4a5e9c5adca5c1a99835, user_id=ab2342a2e68b4c0ea39cac8fefc6aaad, role_id=702e5e78b5d744529384b96a390ae92f)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:48:16.855869 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0698efd2-7719-4c1d-93a1-8f7b70a2e492 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:48:16.972693 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1235/2457] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:48:16 2022] PUT /identity/v3/projects/e6e861e727af4a5e9c5adca5c1a99835/users/ab2342a2e68b4c0ea39cac8fefc6aaad/roles/702e5e78b5d744529384b96a390ae92f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:48:16.976907 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a4a14d-aea5-4c41-9d0f-a2a069d347ae admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:48:16.987766 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0698efd2-7719-4c1d-93a1-8f7b70a2e492 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:48:16.990022 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a4a14d-aea5-4c41-9d0f-a2a069d347ae admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:48:17.068788 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0698efd2-7719-4c1d-93a1-8f7b70a2e492 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:48:17.073163 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce355b5-ba3b-4fec-8366-e2f3467ded56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:48:17.076546 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce355b5-ba3b-4fec-8366-e2f3467ded56 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:48:17.076546 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce355b5-ba3b-4fec-8366-e2f3467ded56 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:48:17.076546 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce355b5-ba3b-4fec-8366-e2f3467ded56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:48:17.079950 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-2ce355b5-ba3b-4fec-8366-e2f3467ded56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:48:17.083635 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768888ac-8be0-4477-9196-4e68d06f43bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:48:17.084560 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768888ac-8be0-4477-9196-4e68d06f43bd admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:48:17.085013 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768888ac-8be0-4477-9196-4e68d06f43bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:48:17.085497 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768888ac-8be0-4477-9196-4e68d06f43bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:48:17.086398 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768888ac-8be0-4477-9196-4e68d06f43bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:48:17.088308 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768888ac-8be0-4477-9196-4e68d06f43bd admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:48:17.103337 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1223/2458] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:48:16 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:48:17.114769 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768888ac-8be0-4477-9196-4e68d06f43bd admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:48:17.130141 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768888ac-8be0-4477-9196-4e68d06f43bd admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:48:17.138631 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a93468-d272-4645-aff6-7f9920d41d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:48:17.139828 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a93468-d272-4645-aff6-7f9920d41d39 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:48:17.140301 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a93468-d272-4645-aff6-7f9920d41d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:48:17.140744 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a93468-d272-4645-aff6-7f9920d41d39 admin admin] PATH_INFO: `/v3/projects/e6e861e727af4a5e9c5adca5c1a99835/users/ab2342a2e68b4c0ea39cac8fefc6aaad/roles/702e5e78b5d744529384b96a390ae92f` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:48:17.143076 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a93468-d272-4645-aff6-7f9920d41d39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6e861e727af4a5e9c5adca5c1a99835, user_id=ab2342a2e68b4c0ea39cac8fefc6aaad, role_id=702e5e78b5d744529384b96a390ae92f)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:48:17.146039 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a93468-d272-4645-aff6-7f9920d41d39 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:48:17.162661 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1224/2459] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:48:17 2022] PUT /identity/v3/projects/e6e861e727af4a5e9c5adca5c1a99835/users/ab2342a2e68b4c0ea39cac8fefc6aaad/roles/702e5e78b5d744529384b96a390ae92f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:48:17.226981 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce355b5-ba3b-4fec-8366-e2f3467ded56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:48:17.228588 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce355b5-ba3b-4fec-8366-e2f3467ded56 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:48:17.254242 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1236/2460] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:48:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 16:48:18.842627 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a93468-d272-4645-aff6-7f9920d41d39 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:48:18.844667 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-01a93468-d272-4645-aff6-7f9920d41d39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:48:18.918869 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a93468-d272-4645-aff6-7f9920d41d39 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:48:18.922527 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70a88ae-7b51-40d2-a47d-c720c2116c36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:48:18.923246 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a88ae-7b51-40d2-a47d-c720c2116c36 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:48:18.928239 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a88ae-7b51-40d2-a47d-c720c2116c36 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:48:18.928239 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a88ae-7b51-40d2-a47d-c720c2116c36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:48:18.928239 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-b70a88ae-7b51-40d2-a47d-c720c2116c36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:48:19.041403 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70a88ae-7b51-40d2-a47d-c720c2116c36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:48:19.042844 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70a88ae-7b51-40d2-a47d-c720c2116c36 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:48:19.057256 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1225/2461] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:48:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:48:24.180250 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505807d7-cdfa-4b14-b95e-db77dc263929 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:48:24.180755 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505807d7-cdfa-4b14-b95e-db77dc263929 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:48:24.180868 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505807d7-cdfa-4b14-b95e-db77dc263929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:48:24.207679 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-505807d7-cdfa-4b14-b95e-db77dc263929 None None] MFA Rules not processed for user `ab2342a2e68b4c0ea39cac8fefc6aaad`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:48:24.208904 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-505807d7-cdfa-4b14-b95e-db77dc263929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:48:24.280555 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1237/2462] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:48:24 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:48:24.291279 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70a88ae-7b51-40d2-a47d-c720c2116c36 service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:48:24.293339 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-b70a88ae-7b51-40d2-a47d-c720c2116c36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:48:24.307350 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70a88ae-7b51-40d2-a47d-c720c2116c36 service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:48:24.315276 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0628c456-b4c1-4711-a0be-5ac4dfdf5461 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1be2652c984a4283aeee0b937f0555e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:48:24.316256 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628c456-b4c1-4711-a0be-5ac4dfdf5461 service nova] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:48:24.316644 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628c456-b4c1-4711-a0be-5ac4dfdf5461 service nova] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:48:24.317022 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628c456-b4c1-4711-a0be-5ac4dfdf5461 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:48:24.379806 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0628c456-b4c1-4711-a0be-5ac4dfdf5461 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:48:24.381391 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0628c456-b4c1-4711-a0be-5ac4dfdf5461 service nova] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:48:24.390586 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1226/2463] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:48:24 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:48:27.110602 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70949ac0-826b-418c-894b-3dc3e0c0486e None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:48:27.111269 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70949ac0-826b-418c-894b-3dc3e0c0486e None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:48:27.111269 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70949ac0-826b-418c-894b-3dc3e0c0486e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:48:27.130193 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-70949ac0-826b-418c-894b-3dc3e0c0486e None None] MFA Rules not processed for user `4ff4a686fcd9483dbeaf1881f683a298`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:48:27.131412 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-70949ac0-826b-418c-894b-3dc3e0c0486e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:48:27.139448 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1238/2464] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:48:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:48:27.833526 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0628c456-b4c1-4711-a0be-5ac4dfdf5461 service nova] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:48:27.845576 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0628c456-b4c1-4711-a0be-5ac4dfdf5461 service nova] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:48:27.852050 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0ecc5d-4d6d-4444-9e4d-11e25d339814 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1be2652c984a4283aeee0b937f0555e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:48:27.852981 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ecc5d-4d6d-4444-9e4d-11e25d339814 service nova] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:48:27.853337 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ecc5d-4d6d-4444-9e4d-11e25d339814 service nova] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:48:27.853688 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ecc5d-4d6d-4444-9e4d-11e25d339814 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:48:27.855800 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-9a0ecc5d-4d6d-4444-9e4d-11e25d339814 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:48:27.940154 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0ecc5d-4d6d-4444-9e4d-11e25d339814 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:48:27.947707 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0ecc5d-4d6d-4444-9e4d-11e25d339814 service nova] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:48:27.955814 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1227/2465] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:48:27 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:48:30.601034 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70949ac0-826b-418c-894b-3dc3e0c0486e None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:48:30.612535 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70949ac0-826b-418c-894b-3dc3e0c0486e None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:48:30.616317 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6f591a-8484-4763-9ca7-afdde696ca32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:48:30.616977 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f591a-8484-4763-9ca7-afdde696ca32 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:48:30.617258 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f591a-8484-4763-9ca7-afdde696ca32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:48:30.617540 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f591a-8484-4763-9ca7-afdde696ca32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:48:30.619339 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0f6f591a-8484-4763-9ca7-afdde696ca32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:48:30.630392 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6f591a-8484-4763-9ca7-afdde696ca32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:48:30.631839 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6f591a-8484-4763-9ca7-afdde696ca32 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:48:30.640708 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1239/2466] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:48:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:48:30.939718 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd799f-fe4e-4b29-b0c5-21156b6dc232 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:48:30.940369 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd799f-fe4e-4b29-b0c5-21156b6dc232 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:48:30.940369 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd799f-fe4e-4b29-b0c5-21156b6dc232 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:48:30.941866 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1228/2467] 10.222.0.43 () {54 vars in 921 bytes} [Mon Apr 11 16:48:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:48:30.948760 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d0542-677f-4454-b82c-9ba884085a9b None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:48:30.949057 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d0542-677f-4454-b82c-9ba884085a9b None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:48:30.949351 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d0542-677f-4454-b82c-9ba884085a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:48:30.988417 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-352d0542-677f-4454-b82c-9ba884085a9b None None] MFA Rules not processed for user `1be2652c984a4283aeee0b937f0555e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:48:30.989767 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-352d0542-677f-4454-b82c-9ba884085a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:48:30.999454 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1240/2468] 10.222.0.43 () {58 vars in 1018 bytes} [Mon Apr 11 16:48:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:48:31.011101 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fd799f-fe4e-4b29-b0c5-21156b6dc232 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:48:31.012830 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-d4fd799f-fe4e-4b29-b0c5-21156b6dc232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:48:31.072112 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fd799f-fe4e-4b29-b0c5-21156b6dc232 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:48:31.075859 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33192454-bb5b-4c00-b305-2b6cafacbcb7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f7cf98d5394b28a475fd67e30fc9c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:48:31.076516 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33192454-bb5b-4c00-b305-2b6cafacbcb7 service glance] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:48:31.076800 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33192454-bb5b-4c00-b305-2b6cafacbcb7 service glance] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:48:31.077076 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33192454-bb5b-4c00-b305-2b6cafacbcb7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:48:31.087677 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33192454-bb5b-4c00-b305-2b6cafacbcb7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:48:31.089696 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33192454-bb5b-4c00-b305-2b6cafacbcb7 service glance] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:48:31.100321 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1229/2469] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:48:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:48:31.327377 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe1401-d237-4cd4-a757-7d6389166947 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:48:31.327677 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe1401-d237-4cd4-a757-7d6389166947 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:48:31.327887 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe1401-d237-4cd4-a757-7d6389166947 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:48:31.329363 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1241/2470] 10.222.0.43 () {54 vars in 921 bytes} [Mon Apr 11 16:48:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:48:31.334159 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f77b235-a5aa-4607-b046-7bca64bb7b27 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:48:31.334475 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f77b235-a5aa-4607-b046-7bca64bb7b27 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:48:31.334761 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f77b235-a5aa-4607-b046-7bca64bb7b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:48:31.352821 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-8f77b235-a5aa-4607-b046-7bca64bb7b27 None None] MFA Rules not processed for user `f8c213711e794a1ba47ecf46ecb57769`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:48:31.354044 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-8f77b235-a5aa-4607-b046-7bca64bb7b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:48:31.360624 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1230/2471] 10.222.0.43 () {58 vars in 1018 bytes} [Mon Apr 11 16:48:31 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:48:31.372492 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe1401-d237-4cd4-a757-7d6389166947 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:48:31.383316 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe1401-d237-4cd4-a757-7d6389166947 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:48:31.387688 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0969906c-873f-46d3-8c2d-c98c5486387a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:48:31.388339 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969906c-873f-46d3-8c2d-c98c5486387a service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:48:31.388623 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969906c-873f-46d3-8c2d-c98c5486387a service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:48:31.388907 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969906c-873f-46d3-8c2d-c98c5486387a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:48:31.396072 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0969906c-873f-46d3-8c2d-c98c5486387a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:48:31.397488 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0969906c-873f-46d3-8c2d-c98c5486387a service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:48:31.406779 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1242/2472] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:48:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:48:31.494341 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a0da61-feef-45b3-8ac8-d686e45b5be9 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:48:31.494672 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a0da61-feef-45b3-8ac8-d686e45b5be9 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:48:31.495112 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a0da61-feef-45b3-8ac8-d686e45b5be9 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:48:31.496598 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1231/2473] 10.222.0.43 () {54 vars in 921 bytes} [Mon Apr 11 16:48:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:48:31.502757 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b849a-87a2-4545-bd0d-aa82174edc03 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:48:31.503079 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b849a-87a2-4545-bd0d-aa82174edc03 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:48:31.503338 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b849a-87a2-4545-bd0d-aa82174edc03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:48:31.522523 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-b60b849a-87a2-4545-bd0d-aa82174edc03 None None] MFA Rules not processed for user `1be2652c984a4283aeee0b937f0555e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:48:31.523802 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b60b849a-87a2-4545-bd0d-aa82174edc03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:48:31.534280 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1243/2474] 10.222.0.43 () {58 vars in 1018 bytes} [Mon Apr 11 16:48:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:48:31.544639 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a0da61-feef-45b3-8ac8-d686e45b5be9 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:48:31.555650 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a0da61-feef-45b3-8ac8-d686e45b5be9 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:48:31.560462 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42f4a3a-1bc8-48ed-b40f-294e344b8a4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:48:31.561214 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f4a3a-1bc8-48ed-b40f-294e344b8a4b service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:48:31.561577 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f4a3a-1bc8-48ed-b40f-294e344b8a4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:48:31.561930 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f4a3a-1bc8-48ed-b40f-294e344b8a4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:48:31.573918 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42f4a3a-1bc8-48ed-b40f-294e344b8a4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:48:31.575337 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42f4a3a-1bc8-48ed-b40f-294e344b8a4b service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:48:31.586215 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1232/2475] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:48:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 16:48:31.647570 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60b849a-87a2-4545-bd0d-aa82174edc03 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:48:31.648971 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b60b849a-87a2-4545-bd0d-aa82174edc03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:48:31.718468 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60b849a-87a2-4545-bd0d-aa82174edc03 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:48:31.723649 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c18ace4-f11f-4ad1-a817-3f78905ae812 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6589debd41bf496085c7339ab5409666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:48:31.724296 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c18ace4-f11f-4ad1-a817-3f78905ae812 service placement] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:48:31.724578 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c18ace4-f11f-4ad1-a817-3f78905ae812 service placement] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:48:31.724855 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c18ace4-f11f-4ad1-a817-3f78905ae812 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:48:31.726684 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-5c18ace4-f11f-4ad1-a817-3f78905ae812 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:48:31.739442 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c18ace4-f11f-4ad1-a817-3f78905ae812 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:48:31.741010 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c18ace4-f11f-4ad1-a817-3f78905ae812 service placement] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:48:31.751714 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1244/2476] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:48:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:48:39.709319 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42f4a3a-1bc8-48ed-b40f-294e344b8a4b service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:48:39.718612 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42f4a3a-1bc8-48ed-b40f-294e344b8a4b service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:48:39.722576 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5005411c-6ca2-4f8e-8b3f-143a203a5359 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:48:39.723382 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005411c-6ca2-4f8e-8b3f-143a203a5359 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:48:39.723537 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005411c-6ca2-4f8e-8b3f-143a203a5359 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:48:39.723949 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005411c-6ca2-4f8e-8b3f-143a203a5359 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:48:39.725781 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-5005411c-6ca2-4f8e-8b3f-143a203a5359 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:48:39.735894 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5005411c-6ca2-4f8e-8b3f-143a203a5359 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:48:39.737384 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5005411c-6ca2-4f8e-8b3f-143a203a5359 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:48:39.746516 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1233/2477] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:48:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:48:41.009328 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33da60-f2a1-4e61-a20d-f4790ef8f781 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:48:41.009837 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33da60-f2a1-4e61-a20d-f4790ef8f781 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:48:41.009990 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33da60-f2a1-4e61-a20d-f4790ef8f781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:48:41.028030 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-7a33da60-f2a1-4e61-a20d-f4790ef8f781 None None] MFA Rules not processed for user `3252c48fdd5747a29fe4ba89e7162216`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:48:41.031956 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-7a33da60-f2a1-4e61-a20d-f4790ef8f781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:48:41.089314 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1245/2478] 10.222.0.43 () {58 vars in 1009 bytes} [Mon Apr 11 16:48:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:48:41.101800 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5005411c-6ca2-4f8e-8b3f-143a203a5359 service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:48:41.103307 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-5005411c-6ca2-4f8e-8b3f-143a203a5359 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:48:41.177946 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5005411c-6ca2-4f8e-8b3f-143a203a5359 service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:48:41.183892 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b379275c-3de8-411f-9660-a97d678a2c3a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb193a1a7abd430fbbcccab970e4f37c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:48:41.184542 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b379275c-3de8-411f-9660-a97d678a2c3a service swift] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:48:41.184826 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b379275c-3de8-411f-9660-a97d678a2c3a service swift] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:48:41.185103 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b379275c-3de8-411f-9660-a97d678a2c3a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:48:41.193728 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b379275c-3de8-411f-9660-a97d678a2c3a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:48:41.195358 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b379275c-3de8-411f-9660-a97d678a2c3a service swift] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:48:41.204781 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1234/2479] 10.222.0.43 () {60 vars in 1384 bytes} [Mon Apr 11 16:48:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 11 16:48:59.004471 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33da60-f2a1-4e61-a20d-f4790ef8f781 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:48:59.015241 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33da60-f2a1-4e61-a20d-f4790ef8f781 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:48:59.019001 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccea9ed7-4bb9-42d9-a682-91e446959fdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:48:59.019845 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea9ed7-4bb9-42d9-a682-91e446959fdf service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:48:59.020225 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea9ed7-4bb9-42d9-a682-91e446959fdf service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:48:59.020614 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea9ed7-4bb9-42d9-a682-91e446959fdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:48:59.022647 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ccea9ed7-4bb9-42d9-a682-91e446959fdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:48:59.033665 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccea9ed7-4bb9-42d9-a682-91e446959fdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:48:59.035148 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccea9ed7-4bb9-42d9-a682-91e446959fdf service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:48:59.045003 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1246/2480] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:48:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 16:49:04.943893 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b379275c-3de8-411f-9660-a97d678a2c3a service swift] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:49:04.945918 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-b379275c-3de8-411f-9660-a97d678a2c3a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:49:04.966110 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b379275c-3de8-411f-9660-a97d678a2c3a service swift] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:49:04.972340 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32b4e3f-bda1-401b-81cb-f4bec89af192 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1be2652c984a4283aeee0b937f0555e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:49:04.973194 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b4e3f-bda1-401b-81cb-f4bec89af192 service nova] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:49:04.973523 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b4e3f-bda1-401b-81cb-f4bec89af192 service nova] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:49:04.973865 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b4e3f-bda1-401b-81cb-f4bec89af192 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:49:04.975995 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-f32b4e3f-bda1-401b-81cb-f4bec89af192 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:49:04.990270 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32b4e3f-bda1-401b-81cb-f4bec89af192 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:49:04.992608 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32b4e3f-bda1-401b-81cb-f4bec89af192 service nova] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:49:05.048135 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1235/2481] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:49:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 16:49:13.965801 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccea9ed7-4bb9-42d9-a682-91e446959fdf service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:49:13.982899 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccea9ed7-4bb9-42d9-a682-91e446959fdf service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:49:13.989882 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142077f1-4bbe-4f50-8e4c-6ac00b110bfb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1be2652c984a4283aeee0b937f0555e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:49:13.990656 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142077f1-4bbe-4f50-8e4c-6ac00b110bfb service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:49:13.991002 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142077f1-4bbe-4f50-8e4c-6ac00b110bfb service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:49:13.991335 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142077f1-4bbe-4f50-8e4c-6ac00b110bfb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:49:13.994926 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-142077f1-4bbe-4f50-8e4c-6ac00b110bfb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:49:14.085434 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142077f1-4bbe-4f50-8e4c-6ac00b110bfb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:49:14.088604 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142077f1-4bbe-4f50-8e4c-6ac00b110bfb service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:49:14.106737 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1247/2482] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:49:13 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:49:15.643541 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32b4e3f-bda1-401b-81cb-f4bec89af192 service nova] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:49:15.655645 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32b4e3f-bda1-401b-81cb-f4bec89af192 service nova] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:49:15.662641 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbcfd55-943f-4377-a728-f0eb76523935 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1be2652c984a4283aeee0b937f0555e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:49:15.663349 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbcfd55-943f-4377-a728-f0eb76523935 service nova] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:49:15.663680 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbcfd55-943f-4377-a728-f0eb76523935 service nova] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:49:15.663970 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbcfd55-943f-4377-a728-f0eb76523935 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:49:15.667828 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-3bbcfd55-943f-4377-a728-f0eb76523935 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:49:15.682036 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbcfd55-943f-4377-a728-f0eb76523935 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:49:15.683677 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbcfd55-943f-4377-a728-f0eb76523935 service nova] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:49:15.694882 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1236/2483] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:49:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:49:21.331232 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3953ae-54d0-43f8-99e5-1be3401d1efe None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:49:21.332318 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3953ae-54d0-43f8-99e5-1be3401d1efe None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:49:21.332818 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3953ae-54d0-43f8-99e5-1be3401d1efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:49:21.357969 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-af3953ae-54d0-43f8-99e5-1be3401d1efe None None] MFA Rules not processed for user `a6d703d5066b4909b00a0886a8437900`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:49:21.359318 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-af3953ae-54d0-43f8-99e5-1be3401d1efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:49:21.442274 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1248/2484] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:49:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:49:22.076951 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b4efc3-a23d-494b-974b-3e30a2f1bdd1 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:49:22.077815 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b4efc3-a23d-494b-974b-3e30a2f1bdd1 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:49:22.078143 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b4efc3-a23d-494b-974b-3e30a2f1bdd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:49:22.099145 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-80b4efc3-a23d-494b-974b-3e30a2f1bdd1 None None] MFA Rules not processed for user `3252c48fdd5747a29fe4ba89e7162216`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:49:22.100379 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-80b4efc3-a23d-494b-974b-3e30a2f1bdd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:49:22.109117 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1237/2485] 10.222.0.43 () {58 vars in 967 bytes} [Mon Apr 11 16:49:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:49:22.134876 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3953ae-54d0-43f8-99e5-1be3401d1efe None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:49:22.148394 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3953ae-54d0-43f8-99e5-1be3401d1efe None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:49:22.154074 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6b21b7-db4b-461a-8b57-9ccbfc137a26 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb193a1a7abd430fbbcccab970e4f37c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:49:22.154738 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b21b7-db4b-461a-8b57-9ccbfc137a26 service swift] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:49:22.155024 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b21b7-db4b-461a-8b57-9ccbfc137a26 service swift] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:49:22.155298 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b21b7-db4b-461a-8b57-9ccbfc137a26 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:49:22.165203 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6b21b7-db4b-461a-8b57-9ccbfc137a26 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:49:22.167196 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6b21b7-db4b-461a-8b57-9ccbfc137a26 service swift] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:49:22.177989 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1249/2486] 10.222.0.43 () {60 vars in 1384 bytes} [Mon Apr 11 16:49:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 11 16:49:26.714424 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b4efc3-a23d-494b-974b-3e30a2f1bdd1 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:49:26.729971 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b4efc3-a23d-494b-974b-3e30a2f1bdd1 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:49:26.736726 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67f9aee-b1f8-4688-922f-a523cc33903f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:49:26.738286 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f9aee-b1f8-4688-922f-a523cc33903f service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:49:26.738874 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f9aee-b1f8-4688-922f-a523cc33903f service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:49:26.739656 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f9aee-b1f8-4688-922f-a523cc33903f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:49:26.755016 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67f9aee-b1f8-4688-922f-a523cc33903f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:49:26.757046 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67f9aee-b1f8-4688-922f-a523cc33903f service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:49:26.768033 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1238/2487] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:49:26 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 16:49:29.860799 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6b21b7-db4b-461a-8b57-9ccbfc137a26 service swift] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:49:29.886740 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6b21b7-db4b-461a-8b57-9ccbfc137a26 service swift] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:49:29.898185 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d5959-0f16-41b2-8285-3c75ba19c0b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1be2652c984a4283aeee0b937f0555e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:49:29.900594 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d5959-0f16-41b2-8285-3c75ba19c0b6 service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:49:29.901327 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d5959-0f16-41b2-8285-3c75ba19c0b6 service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:49:29.902050 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d5959-0f16-41b2-8285-3c75ba19c0b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:49:29.905994 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-df2d5959-0f16-41b2-8285-3c75ba19c0b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:49:29.930244 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2d5959-0f16-41b2-8285-3c75ba19c0b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:49:29.933762 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2d5959-0f16-41b2-8285-3c75ba19c0b6 service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:49:29.954823 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1250/2488] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:49:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:49:50.070450 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c161a1-7e9e-40c5-876a-b6b1c5bbf85d None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:49:50.071376 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c161a1-7e9e-40c5-876a-b6b1c5bbf85d None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:49:50.071376 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c161a1-7e9e-40c5-876a-b6b1c5bbf85d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:49:50.092852 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-31c161a1-7e9e-40c5-876a-b6b1c5bbf85d None None] MFA Rules not processed for user `975273630f7e4852848335d674693ea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:49:50.094314 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-31c161a1-7e9e-40c5-876a-b6b1c5bbf85d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:49:50.104424 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1239/2489] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:49:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:50:46.283179 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d5959-0f16-41b2-8285-3c75ba19c0b6 service nova] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:46.284721 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-df2d5959-0f16-41b2-8285-3c75ba19c0b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:46.352850 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d5959-0f16-41b2-8285-3c75ba19c0b6 service nova] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:46.357418 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3857a2bc-0fbc-4ce2-bd4d-8d2033bc747c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:46.358290 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3857a2bc-0fbc-4ce2-bd4d-8d2033bc747c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:46.358603 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3857a2bc-0fbc-4ce2-bd4d-8d2033bc747c admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:46.358888 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3857a2bc-0fbc-4ce2-bd4d-8d2033bc747c admin admin] PATH_INFO: `/v3/users/a6d703d5066b4909b00a0886a8437900` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:46.360117 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3857a2bc-0fbc-4ce2-bd4d-8d2033bc747c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6d703d5066b4909b00a0886a8437900)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:46.362035 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3857a2bc-0fbc-4ce2-bd4d-8d2033bc747c admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:46.564304 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-3857a2bc-0fbc-4ce2-bd4d-8d2033bc747c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6d703d5066b4909b00a0886a8437900'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:50:46.565067 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-3857a2bc-0fbc-4ce2-bd4d-8d2033bc747c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6d703d5066b4909b00a0886a8437900'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:50:46.664539 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-3857a2bc-0fbc-4ce2-bd4d-8d2033bc747c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6d703d5066b4909b00a0886a8437900'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:50:46.672169 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-3857a2bc-0fbc-4ce2-bd4d-8d2033bc747c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6d703d5066b4909b00a0886a8437900'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:50:46.685566 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-3857a2bc-0fbc-4ce2-bd4d-8d2033bc747c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6d703d5066b4909b00a0886a8437900'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:50:46.691785 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1251/2490] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:50:46 2022] DELETE /identity/v3/users/a6d703d5066b4909b00a0886a8437900 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:50:47.003024 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c161a1-7e9e-40c5-876a-b6b1c5bbf85d None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:47.016608 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c161a1-7e9e-40c5-876a-b6b1c5bbf85d None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:47.084642 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3450a93-2d6a-40c4-ae95-c6f361e00722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:47.085519 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3450a93-2d6a-40c4-ae95-c6f361e00722 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:47.085799 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3450a93-2d6a-40c4-ae95-c6f361e00722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:47.086072 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3450a93-2d6a-40c4-ae95-c6f361e00722 admin admin] PATH_INFO: `/v3/projects/e0387bb3fbf2485c8a6008defba1ba37` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:47.087318 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3450a93-2d6a-40c4-ae95-c6f361e00722 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0387bb3fbf2485c8a6008defba1ba37)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:47.089270 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3450a93-2d6a-40c4-ae95-c6f361e00722 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:47.202391 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b3450a93-2d6a-40c4-ae95-c6f361e00722 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0387bb3fbf2485c8a6008defba1ba37', 'request_id': 'req-b3450a93-2d6a-40c4-ae95-c6f361e00722'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:50:47.281805 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b3450a93-2d6a-40c4-ae95-c6f361e00722 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0387bb3fbf2485c8a6008defba1ba37', 'request_id': 'req-b3450a93-2d6a-40c4-ae95-c6f361e00722'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:50:47.287792 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b3450a93-2d6a-40c4-ae95-c6f361e00722 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0387bb3fbf2485c8a6008defba1ba37', 'request_id': 'req-b3450a93-2d6a-40c4-ae95-c6f361e00722'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:50:47.299827 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b3450a93-2d6a-40c4-ae95-c6f361e00722 admin admin] The token cache is being invalidate because project e0387bb3fbf2485c8a6008defba1ba37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:50:47.300116 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b3450a93-2d6a-40c4-ae95-c6f361e00722 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:50:47.300784 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b3450a93-2d6a-40c4-ae95-c6f361e00722 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:50:47.302980 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1240/2491] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:50:47 2022] DELETE /identity/v3/projects/e0387bb3fbf2485c8a6008defba1ba37 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:50:47.308118 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65ad93-b1bf-4bab-8e73-7a340615f5fc None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:47.308745 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65ad93-b1bf-4bab-8e73-7a340615f5fc None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:47.309022 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65ad93-b1bf-4bab-8e73-7a340615f5fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:47.332800 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-0c65ad93-b1bf-4bab-8e73-7a340615f5fc None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:50:47.335173 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0c65ad93-b1bf-4bab-8e73-7a340615f5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:47.402540 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1252/2492] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:50:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:50:47.410495 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c372251-aec1-4797-ba1e-622710ea6c77 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:47.411485 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c372251-aec1-4797-ba1e-622710ea6c77 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:47.411918 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c372251-aec1-4797-ba1e-622710ea6c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:47.432604 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-2c372251-aec1-4797-ba1e-622710ea6c77 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:50:47.433879 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-2c372251-aec1-4797-ba1e-622710ea6c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:47.442231 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1241/2493] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:50:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:50:47.446751 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c65ad93-b1bf-4bab-8e73-7a340615f5fc None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:47.456886 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c65ad93-b1bf-4bab-8e73-7a340615f5fc None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:47.462751 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc024de-1719-4220-9f02-5f507a14a4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:47.463493 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc024de-1719-4220-9f02-5f507a14a4aa admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:47.463823 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc024de-1719-4220-9f02-5f507a14a4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:47.464104 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc024de-1719-4220-9f02-5f507a14a4aa admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:47.464883 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc024de-1719-4220-9f02-5f507a14a4aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:50:47.465219 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc024de-1719-4220-9f02-5f507a14a4aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:47.466894 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc024de-1719-4220-9f02-5f507a14a4aa admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:47.481878 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1253/2494] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Apr 11 16:50:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:50:47.486692 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c372251-aec1-4797-ba1e-622710ea6c77 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:47.497211 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c372251-aec1-4797-ba1e-622710ea6c77 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:47.502181 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a48140-8d46-4e40-b9b9-ef6766ec2dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:47.502866 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a48140-8d46-4e40-b9b9-ef6766ec2dc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:47.503147 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a48140-8d46-4e40-b9b9-ef6766ec2dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:47.503417 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a48140-8d46-4e40-b9b9-ef6766ec2dc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:47.504220 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a48140-8d46-4e40-b9b9-ef6766ec2dc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:47.506227 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a48140-8d46-4e40-b9b9-ef6766ec2dc6 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:47.621208 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1242/2495] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:50:47 2022] POST /identity/v3/projects => generated 399 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:50:47.625603 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc024de-1719-4220-9f02-5f507a14a4aa admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:47.638617 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc024de-1719-4220-9f02-5f507a14a4aa admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:47.705608 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0345b385-9566-4d25-826a-29fc79d4341f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:47.706307 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0345b385-9566-4d25-826a-29fc79d4341f admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:47.706573 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0345b385-9566-4d25-826a-29fc79d4341f admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:47.706848 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0345b385-9566-4d25-826a-29fc79d4341f admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:47.707567 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0345b385-9566-4d25-826a-29fc79d4341f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:47.710287 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0345b385-9566-4d25-826a-29fc79d4341f admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:47.796537 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1254/2496] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:50:47 2022] POST /identity/v3/users => generated 300 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:50:47.800849 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a48140-8d46-4e40-b9b9-ef6766ec2dc6 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:47.811306 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a48140-8d46-4e40-b9b9-ef6766ec2dc6 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:47.816029 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba008e66-a351-455f-b957-913ec18b77ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:47.816687 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba008e66-a351-455f-b957-913ec18b77ee admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:47.817093 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba008e66-a351-455f-b957-913ec18b77ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:47.817831 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba008e66-a351-455f-b957-913ec18b77ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:47.818199 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba008e66-a351-455f-b957-913ec18b77ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:47.819805 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba008e66-a351-455f-b957-913ec18b77ee admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:47.830046 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1243/2497] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:50:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:50:47.834796 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0345b385-9566-4d25-826a-29fc79d4341f admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:47.844851 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0345b385-9566-4d25-826a-29fc79d4341f admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:47.850727 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c1cd5f-5dab-4d8b-a347-7db8527736d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:47.851391 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c1cd5f-5dab-4d8b-a347-7db8527736d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:47.851703 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c1cd5f-5dab-4d8b-a347-7db8527736d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:47.851976 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c1cd5f-5dab-4d8b-a347-7db8527736d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:47.852706 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c1cd5f-5dab-4d8b-a347-7db8527736d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:47.854276 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c1cd5f-5dab-4d8b-a347-7db8527736d4 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:47.864467 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1255/2498] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:50:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:50:47.868732 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba008e66-a351-455f-b957-913ec18b77ee admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:47.878797 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba008e66-a351-455f-b957-913ec18b77ee admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:47.883875 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e562a-a3d5-4bce-a73a-bbd10f91af34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:47.885732 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e562a-a3d5-4bce-a73a-bbd10f91af34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:47.886017 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e562a-a3d5-4bce-a73a-bbd10f91af34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:47.886291 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e562a-a3d5-4bce-a73a-bbd10f91af34 admin admin] PATH_INFO: `/v3/projects/a75adfa72cd54d388e1e7d7e4a52930d/users/6bbcf5b66b6740cfae31e0d3a3d7b959/roles/0d41da7bec094450b5bff4e4831be52c` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:47.902256 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211e562a-a3d5-4bce-a73a-bbd10f91af34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a75adfa72cd54d388e1e7d7e4a52930d, user_id=6bbcf5b66b6740cfae31e0d3a3d7b959, role_id=0d41da7bec094450b5bff4e4831be52c)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:47.904893 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211e562a-a3d5-4bce-a73a-bbd10f91af34 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:47.963318 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1244/2499] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:50:47 2022] PUT /identity/v3/projects/a75adfa72cd54d388e1e7d7e4a52930d/users/6bbcf5b66b6740cfae31e0d3a3d7b959/roles/0d41da7bec094450b5bff4e4831be52c => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:50:48.028955 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03f613-8630-4ff9-9296-abb963ef5a2d None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:48.029449 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03f613-8630-4ff9-9296-abb963ef5a2d None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:48.029746 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03f613-8630-4ff9-9296-abb963ef5a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:48.057632 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-8f03f613-8630-4ff9-9296-abb963ef5a2d None None] MFA Rules not processed for user `6bbcf5b66b6740cfae31e0d3a3d7b959`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:50:48.058857 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-8f03f613-8630-4ff9-9296-abb963ef5a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:48.121177 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1256/2500] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:50:48 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:50:48.133449 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e562a-a3d5-4bce-a73a-bbd10f91af34 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:48.135097 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-211e562a-a3d5-4bce-a73a-bbd10f91af34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:48.192120 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e562a-a3d5-4bce-a73a-bbd10f91af34 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:48.195977 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4488f807-60d3-40df-be6e-2ddf0325f5e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '950b5b5f690d41509ead753065a0b793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:48.196628 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488f807-60d3-40df-be6e-2ddf0325f5e9 service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:48.196911 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488f807-60d3-40df-be6e-2ddf0325f5e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:48.197186 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488f807-60d3-40df-be6e-2ddf0325f5e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:48.205768 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4488f807-60d3-40df-be6e-2ddf0325f5e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:48.207189 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4488f807-60d3-40df-be6e-2ddf0325f5e9 service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:48.216382 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1245/2501] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:50:48 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:50:58.118121 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f03f613-8630-4ff9-9296-abb963ef5a2d None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:58.181433 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f03f613-8630-4ff9-9296-abb963ef5a2d None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:58.185921 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c74a9de-521a-4174-a69c-3e0d787c7e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:58.186793 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74a9de-521a-4174-a69c-3e0d787c7e90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:58.187074 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74a9de-521a-4174-a69c-3e0d787c7e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:58.187345 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74a9de-521a-4174-a69c-3e0d787c7e90 admin admin] PATH_INFO: `/v3/users/6bbcf5b66b6740cfae31e0d3a3d7b959` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:58.188719 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c74a9de-521a-4174-a69c-3e0d787c7e90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bbcf5b66b6740cfae31e0d3a3d7b959)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:58.211829 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c74a9de-521a-4174-a69c-3e0d787c7e90 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:58.409661 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-2c74a9de-521a-4174-a69c-3e0d787c7e90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bbcf5b66b6740cfae31e0d3a3d7b959'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:50:58.410318 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-2c74a9de-521a-4174-a69c-3e0d787c7e90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bbcf5b66b6740cfae31e0d3a3d7b959'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:50:58.470224 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-2c74a9de-521a-4174-a69c-3e0d787c7e90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bbcf5b66b6740cfae31e0d3a3d7b959'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:50:58.480006 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-2c74a9de-521a-4174-a69c-3e0d787c7e90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bbcf5b66b6740cfae31e0d3a3d7b959'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:50:58.492156 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-2c74a9de-521a-4174-a69c-3e0d787c7e90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bbcf5b66b6740cfae31e0d3a3d7b959'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:50:58.498127 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1257/2502] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:50:58 2022] DELETE /identity/v3/users/6bbcf5b66b6740cfae31e0d3a3d7b959 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:50:58.502903 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e9fc9-d1ed-4eb7-b4ea-4747d89d2d9a None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:58.503396 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e9fc9-d1ed-4eb7-b4ea-4747d89d2d9a None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:58.503505 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e9fc9-d1ed-4eb7-b4ea-4747d89d2d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:58.520604 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-1d9e9fc9-d1ed-4eb7-b4ea-4747d89d2d9a None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:50:58.523195 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-1d9e9fc9-d1ed-4eb7-b4ea-4747d89d2d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:58.581174 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1246/2503] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:50:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:50:58.591719 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c74a9de-521a-4174-a69c-3e0d787c7e90 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:58.593175 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-2c74a9de-521a-4174-a69c-3e0d787c7e90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:58.657025 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c74a9de-521a-4174-a69c-3e0d787c7e90 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:58.661022 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1257df71-4ffd-4d5b-b8e8-373ad9288ab6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:58.661673 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257df71-4ffd-4d5b-b8e8-373ad9288ab6 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:58.661955 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257df71-4ffd-4d5b-b8e8-373ad9288ab6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:58.662231 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257df71-4ffd-4d5b-b8e8-373ad9288ab6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:58.671713 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1257df71-4ffd-4d5b-b8e8-373ad9288ab6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:58.673133 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1257df71-4ffd-4d5b-b8e8-373ad9288ab6 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:58.682964 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1258/2504] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:50:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:50:59.106603 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9e9fc9-d1ed-4eb7-b4ea-4747d89d2d9a None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:59.108180 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-1d9e9fc9-d1ed-4eb7-b4ea-4747d89d2d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:59.124050 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9e9fc9-d1ed-4eb7-b4ea-4747d89d2d9a None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:59.130393 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b12716e-0711-4686-a11a-6923e0fb4790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:59.131969 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b12716e-0711-4686-a11a-6923e0fb4790 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:59.132354 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b12716e-0711-4686-a11a-6923e0fb4790 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:59.132502 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b12716e-0711-4686-a11a-6923e0fb4790 admin admin] PATH_INFO: `/v3/projects/a75adfa72cd54d388e1e7d7e4a52930d` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:59.133750 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b12716e-0711-4686-a11a-6923e0fb4790 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a75adfa72cd54d388e1e7d7e4a52930d)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:59.135701 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b12716e-0711-4686-a11a-6923e0fb4790 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:59.287193 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-4b12716e-0711-4686-a11a-6923e0fb4790 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a75adfa72cd54d388e1e7d7e4a52930d', 'request_id': 'req-4b12716e-0711-4686-a11a-6923e0fb4790'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:50:59.378733 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-4b12716e-0711-4686-a11a-6923e0fb4790 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a75adfa72cd54d388e1e7d7e4a52930d', 'request_id': 'req-4b12716e-0711-4686-a11a-6923e0fb4790'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:50:59.385897 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-4b12716e-0711-4686-a11a-6923e0fb4790 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a75adfa72cd54d388e1e7d7e4a52930d', 'request_id': 'req-4b12716e-0711-4686-a11a-6923e0fb4790'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:50:59.399510 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-4b12716e-0711-4686-a11a-6923e0fb4790 admin admin] The token cache is being invalidate because project a75adfa72cd54d388e1e7d7e4a52930d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:50:59.399906 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-4b12716e-0711-4686-a11a-6923e0fb4790 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:50:59.400615 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-4b12716e-0711-4686-a11a-6923e0fb4790 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:50:59.402525 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1247/2505] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:50:59 2022] DELETE /identity/v3/projects/a75adfa72cd54d388e1e7d7e4a52930d => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:13.683635 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da2a0b-dddb-4997-96ea-1b69be2f7fc8 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:13.684156 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da2a0b-dddb-4997-96ea-1b69be2f7fc8 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:13.684268 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da2a0b-dddb-4997-96ea-1b69be2f7fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:13.702141 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-b9da2a0b-dddb-4997-96ea-1b69be2f7fc8 None None] MFA Rules not processed for user `de39f6406f414bc68ee956c7639dab5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:13.703363 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b9da2a0b-dddb-4997-96ea-1b69be2f7fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:13.759256 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1259/2506] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:51:13 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:51:15.691873 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b12716e-0711-4686-a11a-6923e0fb4790 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:15.693471 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-4b12716e-0711-4686-a11a-6923e0fb4790 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:15.761887 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b12716e-0711-4686-a11a-6923e0fb4790 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:15.766923 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5e79e1-7773-458c-8d41-670e7e16ee32 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6589debd41bf496085c7339ab5409666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:15.767626 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e79e1-7773-458c-8d41-670e7e16ee32 service placement] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:15.767911 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e79e1-7773-458c-8d41-670e7e16ee32 service placement] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:15.768187 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e79e1-7773-458c-8d41-670e7e16ee32 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:15.769992 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-2b5e79e1-7773-458c-8d41-670e7e16ee32 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:15.781752 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5e79e1-7773-458c-8d41-670e7e16ee32 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:15.783356 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5e79e1-7773-458c-8d41-670e7e16ee32 service placement] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:15.794889 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1248/2507] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:51:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:51:40.789215 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9da2a0b-dddb-4997-96ea-1b69be2f7fc8 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:40.790856 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b9da2a0b-dddb-4997-96ea-1b69be2f7fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:40.852728 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9da2a0b-dddb-4997-96ea-1b69be2f7fc8 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:40.856688 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ab1e74-6505-4e78-b3d7-244d77727ad7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:40.857024 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ab1e74-6505-4e78-b3d7-244d77727ad7 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:40.857302 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ab1e74-6505-4e78-b3d7-244d77727ad7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:40.857698 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ab1e74-6505-4e78-b3d7-244d77727ad7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:40.859582 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-19ab1e74-6505-4e78-b3d7-244d77727ad7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:40.922669 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ab1e74-6505-4e78-b3d7-244d77727ad7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:40.924119 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ab1e74-6505-4e78-b3d7-244d77727ad7 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:40.934988 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1260/2508] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:51:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:51:45.335287 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5e79e1-7773-458c-8d41-670e7e16ee32 service placement] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:45.336788 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-2b5e79e1-7773-458c-8d41-670e7e16ee32 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:45.350648 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5e79e1-7773-458c-8d41-670e7e16ee32 service placement] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:45.355385 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9e7126-4a5f-4518-99fa-f5a2f0ef4aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:45.356354 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e7126-4a5f-4518-99fa-f5a2f0ef4aa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:45.356636 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e7126-4a5f-4518-99fa-f5a2f0ef4aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:45.356910 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e7126-4a5f-4518-99fa-f5a2f0ef4aa5 admin admin] PATH_INFO: `/v3/users/975273630f7e4852848335d674693ea7` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:45.358116 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9e7126-4a5f-4518-99fa-f5a2f0ef4aa5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=975273630f7e4852848335d674693ea7)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:45.360825 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9e7126-4a5f-4518-99fa-f5a2f0ef4aa5 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:45.536955 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-aa9e7126-4a5f-4518-99fa-f5a2f0ef4aa5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '975273630f7e4852848335d674693ea7'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:45.641465 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-aa9e7126-4a5f-4518-99fa-f5a2f0ef4aa5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '975273630f7e4852848335d674693ea7'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:45.651411 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-aa9e7126-4a5f-4518-99fa-f5a2f0ef4aa5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '975273630f7e4852848335d674693ea7'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:45.656953 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-aa9e7126-4a5f-4518-99fa-f5a2f0ef4aa5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '975273630f7e4852848335d674693ea7'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:45.693342 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-aa9e7126-4a5f-4518-99fa-f5a2f0ef4aa5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '975273630f7e4852848335d674693ea7'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:45.700253 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1249/2509] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:51:45 2022] DELETE /identity/v3/users/975273630f7e4852848335d674693ea7 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:45.960739 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ab1e74-6505-4e78-b3d7-244d77727ad7 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:45.983550 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ab1e74-6505-4e78-b3d7-244d77727ad7 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:46.058556 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebd2e68-fb0f-4deb-b316-8e63d389a0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:46.059480 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebd2e68-fb0f-4deb-b316-8e63d389a0de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:46.059798 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebd2e68-fb0f-4deb-b316-8e63d389a0de admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:46.062485 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebd2e68-fb0f-4deb-b316-8e63d389a0de admin admin] PATH_INFO: `/v3/projects/4a9922f7c7e54b419b8bad2c6246f1ae` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:46.066583 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebd2e68-fb0f-4deb-b316-8e63d389a0de admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a9922f7c7e54b419b8bad2c6246f1ae)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:46.068524 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebd2e68-fb0f-4deb-b316-8e63d389a0de admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:46.173646 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-2ebd2e68-fb0f-4deb-b316-8e63d389a0de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a9922f7c7e54b419b8bad2c6246f1ae', 'request_id': 'req-2ebd2e68-fb0f-4deb-b316-8e63d389a0de'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:46.189405 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-2ebd2e68-fb0f-4deb-b316-8e63d389a0de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a9922f7c7e54b419b8bad2c6246f1ae', 'request_id': 'req-2ebd2e68-fb0f-4deb-b316-8e63d389a0de'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:46.292396 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-2ebd2e68-fb0f-4deb-b316-8e63d389a0de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a9922f7c7e54b419b8bad2c6246f1ae', 'request_id': 'req-2ebd2e68-fb0f-4deb-b316-8e63d389a0de'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:46.304684 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-2ebd2e68-fb0f-4deb-b316-8e63d389a0de admin admin] The token cache is being invalidate because project 4a9922f7c7e54b419b8bad2c6246f1ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:51:46.304976 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-2ebd2e68-fb0f-4deb-b316-8e63d389a0de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:46.305623 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-2ebd2e68-fb0f-4deb-b316-8e63d389a0de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:46.307154 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1261/2510] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:51:45 2022] DELETE /identity/v3/projects/4a9922f7c7e54b419b8bad2c6246f1ae => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:51:46.312242 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7590c1-5753-4586-8031-970746a37557 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:46.312588 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7590c1-5753-4586-8031-970746a37557 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:46.312872 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7590c1-5753-4586-8031-970746a37557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:46.337999 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-7d7590c1-5753-4586-8031-970746a37557 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:46.340627 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-7d7590c1-5753-4586-8031-970746a37557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:46.406458 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1250/2511] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:51:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:51:46.415068 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28acfe3d-9829-4ac1-8727-8cab3588135f None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:46.415461 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28acfe3d-9829-4ac1-8727-8cab3588135f None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:46.415781 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28acfe3d-9829-4ac1-8727-8cab3588135f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:46.434820 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-28acfe3d-9829-4ac1-8727-8cab3588135f None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:46.436066 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-28acfe3d-9829-4ac1-8727-8cab3588135f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:46.444592 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1262/2512] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:51:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:51:46.448866 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7590c1-5753-4586-8031-970746a37557 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:46.459373 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7590c1-5753-4586-8031-970746a37557 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:46.464004 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fb0577-9ad3-44d8-bacc-85798e8332e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:46.464660 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fb0577-9ad3-44d8-bacc-85798e8332e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:46.464944 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fb0577-9ad3-44d8-bacc-85798e8332e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:46.465218 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fb0577-9ad3-44d8-bacc-85798e8332e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:46.465951 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fb0577-9ad3-44d8-bacc-85798e8332e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:51:46.466254 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fb0577-9ad3-44d8-bacc-85798e8332e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:46.467895 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fb0577-9ad3-44d8-bacc-85798e8332e7 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:46.480092 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1251/2513] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Apr 11 16:51:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:51:46.484474 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28acfe3d-9829-4ac1-8727-8cab3588135f None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:46.502496 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28acfe3d-9829-4ac1-8727-8cab3588135f None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:46.508657 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f622431b-8eb0-499e-8f7b-fddb2fb2d697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:46.509355 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f622431b-8eb0-499e-8f7b-fddb2fb2d697 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:46.509671 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f622431b-8eb0-499e-8f7b-fddb2fb2d697 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:46.509957 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f622431b-8eb0-499e-8f7b-fddb2fb2d697 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:46.510716 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f622431b-8eb0-499e-8f7b-fddb2fb2d697 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:46.513169 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f622431b-8eb0-499e-8f7b-fddb2fb2d697 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:46.597225 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1263/2514] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:51:46 2022] POST /identity/v3/projects => generated 373 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:51:46.602516 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fb0577-9ad3-44d8-bacc-85798e8332e7 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:46.612861 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fb0577-9ad3-44d8-bacc-85798e8332e7 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:46.675647 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52e68d4-a321-447d-a3ad-f1e8d5ce760e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:46.676639 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e68d4-a321-447d-a3ad-f1e8d5ce760e admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:46.677095 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e68d4-a321-447d-a3ad-f1e8d5ce760e admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:46.677508 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e68d4-a321-447d-a3ad-f1e8d5ce760e admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:46.678578 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52e68d4-a321-447d-a3ad-f1e8d5ce760e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:46.681981 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52e68d4-a321-447d-a3ad-f1e8d5ce760e admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:46.779231 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1252/2515] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:51:46 2022] POST /identity/v3/users => generated 287 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:51:46.783960 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f622431b-8eb0-499e-8f7b-fddb2fb2d697 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:46.795630 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f622431b-8eb0-499e-8f7b-fddb2fb2d697 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:46.800353 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7b021a-7f53-4f29-bb45-a2c450c8458b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:46.801531 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b021a-7f53-4f29-bb45-a2c450c8458b admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:46.801821 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b021a-7f53-4f29-bb45-a2c450c8458b admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:46.802105 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b021a-7f53-4f29-bb45-a2c450c8458b admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:46.802837 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7b021a-7f53-4f29-bb45-a2c450c8458b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:46.804654 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7b021a-7f53-4f29-bb45-a2c450c8458b admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:46.815166 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1264/2516] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:51:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:51:46.819371 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52e68d4-a321-447d-a3ad-f1e8d5ce760e admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:46.829656 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52e68d4-a321-447d-a3ad-f1e8d5ce760e admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:46.835180 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aa989f-acb6-4baf-89ca-b76d05f3cee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:46.835913 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa989f-acb6-4baf-89ca-b76d05f3cee5 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:46.836199 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa989f-acb6-4baf-89ca-b76d05f3cee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:46.836486 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa989f-acb6-4baf-89ca-b76d05f3cee5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:46.837210 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aa989f-acb6-4baf-89ca-b76d05f3cee5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:46.838803 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aa989f-acb6-4baf-89ca-b76d05f3cee5 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:46.850183 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1253/2517] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:51:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 16:51:46.854360 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7b021a-7f53-4f29-bb45-a2c450c8458b admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:46.865160 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7b021a-7f53-4f29-bb45-a2c450c8458b admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:46.870552 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82c2d0f-fdd8-4e23-854d-a67dfe8b9e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:46.871496 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c2d0f-fdd8-4e23-854d-a67dfe8b9e64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:46.871813 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c2d0f-fdd8-4e23-854d-a67dfe8b9e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:46.872089 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c2d0f-fdd8-4e23-854d-a67dfe8b9e64 admin admin] PATH_INFO: `/v3/projects/b0254d6202eb40839dc8a48091ae2bcc/users/1040eab73e2e4c38a129b0e16771bc98/roles/0d41da7bec094450b5bff4e4831be52c` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:46.887944 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82c2d0f-fdd8-4e23-854d-a67dfe8b9e64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0254d6202eb40839dc8a48091ae2bcc, user_id=1040eab73e2e4c38a129b0e16771bc98, role_id=0d41da7bec094450b5bff4e4831be52c)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:46.890583 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82c2d0f-fdd8-4e23-854d-a67dfe8b9e64 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:46.991150 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1265/2518] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:51:46 2022] PUT /identity/v3/projects/b0254d6202eb40839dc8a48091ae2bcc/users/1040eab73e2e4c38a129b0e16771bc98/roles/0d41da7bec094450b5bff4e4831be52c => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:47.006908 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da67bed4-f118-43f4-83dd-02c801163cfc None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:47.007201 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da67bed4-f118-43f4-83dd-02c801163cfc None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:47.007492 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da67bed4-f118-43f4-83dd-02c801163cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:47.049004 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-da67bed4-f118-43f4-83dd-02c801163cfc None None] MFA Rules not processed for user `1040eab73e2e4c38a129b0e16771bc98`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:47.050378 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-da67bed4-f118-43f4-83dd-02c801163cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:47.115388 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1254/2519] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:51:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:51:47.126403 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82c2d0f-fdd8-4e23-854d-a67dfe8b9e64 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:47.128510 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-f82c2d0f-fdd8-4e23-854d-a67dfe8b9e64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:47.213867 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82c2d0f-fdd8-4e23-854d-a67dfe8b9e64 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:47.219592 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65889c97-1b37-45f2-a5fc-25528e19f561 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1be2652c984a4283aeee0b937f0555e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:47.220269 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65889c97-1b37-45f2-a5fc-25528e19f561 service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:47.220556 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65889c97-1b37-45f2-a5fc-25528e19f561 service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:47.220840 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65889c97-1b37-45f2-a5fc-25528e19f561 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:47.230610 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65889c97-1b37-45f2-a5fc-25528e19f561 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:47.232255 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65889c97-1b37-45f2-a5fc-25528e19f561 service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:47.242909 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1266/2520] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:51:47 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:51:50.672477 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da67bed4-f118-43f4-83dd-02c801163cfc None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:50.759219 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da67bed4-f118-43f4-83dd-02c801163cfc None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:50.763990 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ee6ed-f002-4fe2-8c07-5c5b890d7ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:50.765579 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ee6ed-f002-4fe2-8c07-5c5b890d7ff9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:50.765579 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ee6ed-f002-4fe2-8c07-5c5b890d7ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:50.765579 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ee6ed-f002-4fe2-8c07-5c5b890d7ff9 admin admin] PATH_INFO: `/v3/users/1040eab73e2e4c38a129b0e16771bc98` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:50.766682 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87ee6ed-f002-4fe2-8c07-5c5b890d7ff9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1040eab73e2e4c38a129b0e16771bc98)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:50.768687 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87ee6ed-f002-4fe2-8c07-5c5b890d7ff9 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:50.970720 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b87ee6ed-f002-4fe2-8c07-5c5b890d7ff9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1040eab73e2e4c38a129b0e16771bc98'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:51.041538 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b87ee6ed-f002-4fe2-8c07-5c5b890d7ff9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1040eab73e2e4c38a129b0e16771bc98'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:51.049336 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b87ee6ed-f002-4fe2-8c07-5c5b890d7ff9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1040eab73e2e4c38a129b0e16771bc98'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:51.050006 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b87ee6ed-f002-4fe2-8c07-5c5b890d7ff9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1040eab73e2e4c38a129b0e16771bc98'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:51.062353 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b87ee6ed-f002-4fe2-8c07-5c5b890d7ff9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1040eab73e2e4c38a129b0e16771bc98'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:51.069336 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1255/2521] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:51:50 2022] DELETE /identity/v3/users/1040eab73e2e4c38a129b0e16771bc98 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:51:51.074204 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d2ce0c-971e-4f01-a119-117e61431ba6 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:51.074705 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d2ce0c-971e-4f01-a119-117e61431ba6 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:51.074808 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d2ce0c-971e-4f01-a119-117e61431ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:51.093350 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-43d2ce0c-971e-4f01-a119-117e61431ba6 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:51.096791 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-43d2ce0c-971e-4f01-a119-117e61431ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:51.154262 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1267/2522] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:51:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:51:51.167011 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ee6ed-f002-4fe2-8c07-5c5b890d7ff9 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:51.168439 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-b87ee6ed-f002-4fe2-8c07-5c5b890d7ff9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:51.230368 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ee6ed-f002-4fe2-8c07-5c5b890d7ff9 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:51.234089 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7351bfa-03dd-42f3-a4e6-93bd17090122 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:51.234743 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7351bfa-03dd-42f3-a4e6-93bd17090122 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:51.235025 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7351bfa-03dd-42f3-a4e6-93bd17090122 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:51.235310 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7351bfa-03dd-42f3-a4e6-93bd17090122 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:51.247883 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7351bfa-03dd-42f3-a4e6-93bd17090122 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:51.249349 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7351bfa-03dd-42f3-a4e6-93bd17090122 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:51.260298 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1256/2523] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:51:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:51:51.734439 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d2ce0c-971e-4f01-a119-117e61431ba6 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:51.736876 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-43d2ce0c-971e-4f01-a119-117e61431ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:51.748027 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d2ce0c-971e-4f01-a119-117e61431ba6 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:51.752827 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a652aeeb-5abc-43d7-80ae-a2d04ba7d4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:51.754479 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652aeeb-5abc-43d7-80ae-a2d04ba7d4db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:51.754904 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652aeeb-5abc-43d7-80ae-a2d04ba7d4db admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:51.755218 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652aeeb-5abc-43d7-80ae-a2d04ba7d4db admin admin] PATH_INFO: `/v3/projects/b0254d6202eb40839dc8a48091ae2bcc` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:51.756513 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a652aeeb-5abc-43d7-80ae-a2d04ba7d4db admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0254d6202eb40839dc8a48091ae2bcc)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:51.758515 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a652aeeb-5abc-43d7-80ae-a2d04ba7d4db admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:51.930102 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a652aeeb-5abc-43d7-80ae-a2d04ba7d4db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0254d6202eb40839dc8a48091ae2bcc', 'request_id': 'req-a652aeeb-5abc-43d7-80ae-a2d04ba7d4db'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:51.935647 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a652aeeb-5abc-43d7-80ae-a2d04ba7d4db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0254d6202eb40839dc8a48091ae2bcc', 'request_id': 'req-a652aeeb-5abc-43d7-80ae-a2d04ba7d4db'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:52.037281 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a652aeeb-5abc-43d7-80ae-a2d04ba7d4db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0254d6202eb40839dc8a48091ae2bcc', 'request_id': 'req-a652aeeb-5abc-43d7-80ae-a2d04ba7d4db'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:52.050007 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a652aeeb-5abc-43d7-80ae-a2d04ba7d4db admin admin] The token cache is being invalidate because project b0254d6202eb40839dc8a48091ae2bcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:51:52.052230 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a652aeeb-5abc-43d7-80ae-a2d04ba7d4db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:52.052230 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a652aeeb-5abc-43d7-80ae-a2d04ba7d4db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:52.053568 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1268/2524] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:51:51 2022] DELETE /identity/v3/projects/b0254d6202eb40839dc8a48091ae2bcc => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:52.058563 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813243e-2344-453e-a4ef-6f3e68659a66 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:52.059065 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813243e-2344-453e-a4ef-6f3e68659a66 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:52.059169 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813243e-2344-453e-a4ef-6f3e68659a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:52.076855 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-3813243e-2344-453e-a4ef-6f3e68659a66 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:52.078080 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-3813243e-2344-453e-a4ef-6f3e68659a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:52.136520 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1257/2525] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:51:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:51:52.144352 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11cf1bd-6f35-4097-9347-1d6a0931ff9f None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:52.144850 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11cf1bd-6f35-4097-9347-1d6a0931ff9f None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:52.145280 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11cf1bd-6f35-4097-9347-1d6a0931ff9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:52.165574 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-b11cf1bd-6f35-4097-9347-1d6a0931ff9f None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:52.166806 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b11cf1bd-6f35-4097-9347-1d6a0931ff9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:52.175052 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1269/2526] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:51:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:51:52.180782 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813243e-2344-453e-a4ef-6f3e68659a66 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:52.190549 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813243e-2344-453e-a4ef-6f3e68659a66 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:52.195769 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38e55a1-d714-40a6-a2b0-c1e3b41be793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:52.196437 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e55a1-d714-40a6-a2b0-c1e3b41be793 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:52.196731 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e55a1-d714-40a6-a2b0-c1e3b41be793 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:52.197012 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e55a1-d714-40a6-a2b0-c1e3b41be793 admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:52.197742 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38e55a1-d714-40a6-a2b0-c1e3b41be793 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:51:52.198055 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38e55a1-d714-40a6-a2b0-c1e3b41be793 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:52.199676 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38e55a1-d714-40a6-a2b0-c1e3b41be793 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:52.212109 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1258/2527] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Apr 11 16:51:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:51:52.216530 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11cf1bd-6f35-4097-9347-1d6a0931ff9f None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:52.226467 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11cf1bd-6f35-4097-9347-1d6a0931ff9f None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:52.231074 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0369b4-5316-41c3-a40f-eb13079f02f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:52.231780 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0369b4-5316-41c3-a40f-eb13079f02f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:52.232065 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0369b4-5316-41c3-a40f-eb13079f02f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:52.232342 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0369b4-5316-41c3-a40f-eb13079f02f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:52.233046 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0369b4-5316-41c3-a40f-eb13079f02f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:52.235025 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0369b4-5316-41c3-a40f-eb13079f02f5 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:52.358228 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1270/2528] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:51:52 2022] POST /identity/v3/projects => generated 365 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:51:52.362421 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38e55a1-d714-40a6-a2b0-c1e3b41be793 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:52.373412 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38e55a1-d714-40a6-a2b0-c1e3b41be793 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:52.433135 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e6d2fd-3da5-4664-a339-059a41c97b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:52.433815 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e6d2fd-3da5-4664-a339-059a41c97b51 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:52.434131 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e6d2fd-3da5-4664-a339-059a41c97b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:52.434456 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e6d2fd-3da5-4664-a339-059a41c97b51 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:52.435201 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e6d2fd-3da5-4664-a339-059a41c97b51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:52.437189 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e6d2fd-3da5-4664-a339-059a41c97b51 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:52.567490 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1259/2529] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:51:52 2022] POST /identity/v3/users => generated 283 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:51:52.571787 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0369b4-5316-41c3-a40f-eb13079f02f5 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:52.582937 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0369b4-5316-41c3-a40f-eb13079f02f5 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:52.588491 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a2495a-13c4-46c6-a896-fff209e8f644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:52.588870 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2495a-13c4-46c6-a896-fff209e8f644 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:52.589155 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2495a-13c4-46c6-a896-fff209e8f644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:52.589437 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2495a-13c4-46c6-a896-fff209e8f644 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:52.590184 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a2495a-13c4-46c6-a896-fff209e8f644 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:52.591888 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a2495a-13c4-46c6-a896-fff209e8f644 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:52.604648 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1271/2530] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:51:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:51:52.609015 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e6d2fd-3da5-4664-a339-059a41c97b51 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:52.619555 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e6d2fd-3da5-4664-a339-059a41c97b51 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:52.624819 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04c4aff-035f-4712-b758-174deea36781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:52.625521 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c4aff-035f-4712-b758-174deea36781 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:52.625807 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c4aff-035f-4712-b758-174deea36781 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:52.626085 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c4aff-035f-4712-b758-174deea36781 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:52.626838 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04c4aff-035f-4712-b758-174deea36781 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:52.628596 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04c4aff-035f-4712-b758-174deea36781 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:52.641757 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1260/2531] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:51:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:51:52.646995 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a2495a-13c4-46c6-a896-fff209e8f644 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:52.657629 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a2495a-13c4-46c6-a896-fff209e8f644 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:52.663328 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937bad15-b713-46cc-a491-20bbc62b922c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:52.664279 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937bad15-b713-46cc-a491-20bbc62b922c admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:52.664566 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937bad15-b713-46cc-a491-20bbc62b922c admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:52.664843 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937bad15-b713-46cc-a491-20bbc62b922c admin admin] PATH_INFO: `/v3/projects/f99f33ac82794c44a27e626197422d6a/users/0adfe66311d6490d911d42dcf591cdae/roles/0d41da7bec094450b5bff4e4831be52c` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:52.680846 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937bad15-b713-46cc-a491-20bbc62b922c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f99f33ac82794c44a27e626197422d6a, user_id=0adfe66311d6490d911d42dcf591cdae, role_id=0d41da7bec094450b5bff4e4831be52c)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:52.683621 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937bad15-b713-46cc-a491-20bbc62b922c admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:52.762541 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1272/2532] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:51:52 2022] PUT /identity/v3/projects/f99f33ac82794c44a27e626197422d6a/users/0adfe66311d6490d911d42dcf591cdae/roles/0d41da7bec094450b5bff4e4831be52c => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:52.773521 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e94b1-11d2-4e5a-9641-25d00fe666f7 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:52.774209 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e94b1-11d2-4e5a-9641-25d00fe666f7 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:52.774209 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e94b1-11d2-4e5a-9641-25d00fe666f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:52.805838 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-9e6e94b1-11d2-4e5a-9641-25d00fe666f7 None None] MFA Rules not processed for user `0adfe66311d6490d911d42dcf591cdae`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:52.807145 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-9e6e94b1-11d2-4e5a-9641-25d00fe666f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:52.876672 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1261/2533] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:51:52 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:51:52.881647 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937bad15-b713-46cc-a491-20bbc62b922c admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:52.946962 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937bad15-b713-46cc-a491-20bbc62b922c admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:52.954641 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd62d8dc-eec4-43c4-9020-00663048cd1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:52.954641 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62d8dc-eec4-43c4-9020-00663048cd1c admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:52.954641 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62d8dc-eec4-43c4-9020-00663048cd1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:52.954641 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62d8dc-eec4-43c4-9020-00663048cd1c admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:52.955669 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd62d8dc-eec4-43c4-9020-00663048cd1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:52.956097 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd62d8dc-eec4-43c4-9020-00663048cd1c admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:53.055056 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1273/2534] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:51:52 2022] POST /identity/v3/projects => generated 363 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:51:53.060002 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6e94b1-11d2-4e5a-9641-25d00fe666f7 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:53.072385 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6e94b1-11d2-4e5a-9641-25d00fe666f7 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:53.146132 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d777677-93ac-4d87-92db-60197bb23dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:53.147465 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d777677-93ac-4d87-92db-60197bb23dcd admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:53.147784 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d777677-93ac-4d87-92db-60197bb23dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:53.148067 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d777677-93ac-4d87-92db-60197bb23dcd admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:53.148785 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d777677-93ac-4d87-92db-60197bb23dcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:53.150717 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d777677-93ac-4d87-92db-60197bb23dcd admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:53.270794 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1262/2535] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:51:53 2022] POST /identity/v3/users => generated 288 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:51:53.274820 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd62d8dc-eec4-43c4-9020-00663048cd1c admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:53.285849 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd62d8dc-eec4-43c4-9020-00663048cd1c admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:53.290647 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31f7d44-79ad-4e17-ba13-e466c83e4ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:53.291295 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f7d44-79ad-4e17-ba13-e466c83e4ce9 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:53.291607 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f7d44-79ad-4e17-ba13-e466c83e4ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:53.291886 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f7d44-79ad-4e17-ba13-e466c83e4ce9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:53.292608 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31f7d44-79ad-4e17-ba13-e466c83e4ce9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:53.294534 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31f7d44-79ad-4e17-ba13-e466c83e4ce9 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:53.305089 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1274/2536] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:51:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:51:53.309290 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d777677-93ac-4d87-92db-60197bb23dcd admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:53.319541 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d777677-93ac-4d87-92db-60197bb23dcd admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:53.324376 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691b02ce-e8a0-4439-9329-e8d527fec0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:53.325253 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b02ce-e8a0-4439-9329-e8d527fec0a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:53.325537 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b02ce-e8a0-4439-9329-e8d527fec0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:53.325810 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b02ce-e8a0-4439-9329-e8d527fec0a2 admin admin] PATH_INFO: `/v3/projects/be8d7b3a47cb4c8cb121481598530038/users/a89ff0a346f44c3693f6d6fe0a903e47/roles/702e5e78b5d744529384b96a390ae92f` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:53.341205 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691b02ce-e8a0-4439-9329-e8d527fec0a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be8d7b3a47cb4c8cb121481598530038, user_id=a89ff0a346f44c3693f6d6fe0a903e47, role_id=702e5e78b5d744529384b96a390ae92f)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:53.343956 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691b02ce-e8a0-4439-9329-e8d527fec0a2 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:53.452747 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1263/2537] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:51:53 2022] PUT /identity/v3/projects/be8d7b3a47cb4c8cb121481598530038/users/a89ff0a346f44c3693f6d6fe0a903e47/roles/702e5e78b5d744529384b96a390ae92f => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:51:53.458523 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31f7d44-79ad-4e17-ba13-e466c83e4ce9 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:53.468515 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31f7d44-79ad-4e17-ba13-e466c83e4ce9 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:53.525921 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86df81a-541e-4a77-b029-d52c878da8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:53.526589 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86df81a-541e-4a77-b029-d52c878da8cb admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:53.526872 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86df81a-541e-4a77-b029-d52c878da8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:53.527148 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86df81a-541e-4a77-b029-d52c878da8cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:53.527954 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86df81a-541e-4a77-b029-d52c878da8cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:53.529461 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86df81a-541e-4a77-b029-d52c878da8cb admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:53.539258 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1275/2538] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:51:53 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:51:53.543646 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691b02ce-e8a0-4439-9329-e8d527fec0a2 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:53.554719 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691b02ce-e8a0-4439-9329-e8d527fec0a2 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:53.559343 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab3fae6-ede1-4d56-bdb9-8280d78b1049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:53.560300 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab3fae6-ede1-4d56-bdb9-8280d78b1049 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:53.560591 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab3fae6-ede1-4d56-bdb9-8280d78b1049 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:53.560890 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab3fae6-ede1-4d56-bdb9-8280d78b1049 admin admin] PATH_INFO: `/v3/projects/be8d7b3a47cb4c8cb121481598530038/users/a89ff0a346f44c3693f6d6fe0a903e47/roles/702e5e78b5d744529384b96a390ae92f` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:53.562860 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab3fae6-ede1-4d56-bdb9-8280d78b1049 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be8d7b3a47cb4c8cb121481598530038, user_id=a89ff0a346f44c3693f6d6fe0a903e47, role_id=702e5e78b5d744529384b96a390ae92f)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:53.565518 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab3fae6-ede1-4d56-bdb9-8280d78b1049 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:53.576172 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1264/2539] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:51:53 2022] PUT /identity/v3/projects/be8d7b3a47cb4c8cb121481598530038/users/a89ff0a346f44c3693f6d6fe0a903e47/roles/702e5e78b5d744529384b96a390ae92f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:53.588518 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d8046-2507-4e7e-9e2f-bfd3afb04446 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:53.588810 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d8046-2507-4e7e-9e2f-bfd3afb04446 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:53.589092 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d8046-2507-4e7e-9e2f-bfd3afb04446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:53.614496 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-f18d8046-2507-4e7e-9e2f-bfd3afb04446 None None] MFA Rules not processed for user `a89ff0a346f44c3693f6d6fe0a903e47`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:53.615728 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-f18d8046-2507-4e7e-9e2f-bfd3afb04446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:53.681347 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1276/2540] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:51:53 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:51:53.693378 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab3fae6-ede1-4d56-bdb9-8280d78b1049 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:53.695060 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-4ab3fae6-ede1-4d56-bdb9-8280d78b1049 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:53.751383 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab3fae6-ede1-4d56-bdb9-8280d78b1049 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:53.755619 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6554c668-34ba-478e-82d0-e1abe91d325b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '950b5b5f690d41509ead753065a0b793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:53.760807 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554c668-34ba-478e-82d0-e1abe91d325b service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:53.760807 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554c668-34ba-478e-82d0-e1abe91d325b service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:53.760807 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554c668-34ba-478e-82d0-e1abe91d325b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:53.765697 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6554c668-34ba-478e-82d0-e1abe91d325b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:53.767200 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6554c668-34ba-478e-82d0-e1abe91d325b service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:53.777122 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1265/2541] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:51:53 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:51:54.012665 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d8046-2507-4e7e-9e2f-bfd3afb04446 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:54.022019 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d8046-2507-4e7e-9e2f-bfd3afb04446 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:54.025558 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a40b2-3400-4562-a7d4-ed7af4be4311 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '950b5b5f690d41509ead753065a0b793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:54.026189 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a40b2-3400-4562-a7d4-ed7af4be4311 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:54.026470 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a40b2-3400-4562-a7d4-ed7af4be4311 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:54.026746 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a40b2-3400-4562-a7d4-ed7af4be4311 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:54.090536 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0a40b2-3400-4562-a7d4-ed7af4be4311 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:54.092051 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0a40b2-3400-4562-a7d4-ed7af4be4311 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:54.100754 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1277/2542] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:51:54 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 16:52:07.425709 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6554c668-34ba-478e-82d0-e1abe91d325b service cinder] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:07.490854 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6554c668-34ba-478e-82d0-e1abe91d325b service cinder] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:07.496837 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062a26d2-e214-4221-930e-5a56ff6527e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:07.497717 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a26d2-e214-4221-930e-5a56ff6527e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:07.498003 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a26d2-e214-4221-930e-5a56ff6527e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:07.498285 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a26d2-e214-4221-930e-5a56ff6527e7 admin admin] PATH_INFO: `/v3/users/0adfe66311d6490d911d42dcf591cdae` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:07.502070 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062a26d2-e214-4221-930e-5a56ff6527e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0adfe66311d6490d911d42dcf591cdae)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:07.504036 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062a26d2-e214-4221-930e-5a56ff6527e7 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:07.768933 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-062a26d2-e214-4221-930e-5a56ff6527e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0adfe66311d6490d911d42dcf591cdae'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:07.870322 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-062a26d2-e214-4221-930e-5a56ff6527e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0adfe66311d6490d911d42dcf591cdae'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:07.878442 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-062a26d2-e214-4221-930e-5a56ff6527e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0adfe66311d6490d911d42dcf591cdae'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:07.879093 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-062a26d2-e214-4221-930e-5a56ff6527e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0adfe66311d6490d911d42dcf591cdae'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:07.891070 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-062a26d2-e214-4221-930e-5a56ff6527e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0adfe66311d6490d911d42dcf591cdae'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:07.896941 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1266/2543] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:52:07 2022] DELETE /identity/v3/users/0adfe66311d6490d911d42dcf591cdae => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:52:07.902548 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e057ca-13ad-453e-b0f1-33e1035e9d1b None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:07.903021 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e057ca-13ad-453e-b0f1-33e1035e9d1b None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:07.903115 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e057ca-13ad-453e-b0f1-33e1035e9d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:07.921636 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-98e057ca-13ad-453e-b0f1-33e1035e9d1b None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:52:07.922824 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-98e057ca-13ad-453e-b0f1-33e1035e9d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:07.981109 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1278/2544] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:52:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:52:07.991041 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062a26d2-e214-4221-930e-5a56ff6527e7 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:07.992534 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-062a26d2-e214-4221-930e-5a56ff6527e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:08.048198 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062a26d2-e214-4221-930e-5a56ff6527e7 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:08.051813 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd36013c-cdad-48a6-a682-d69492e6d7c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:08.052459 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd36013c-cdad-48a6-a682-d69492e6d7c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:08.052743 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd36013c-cdad-48a6-a682-d69492e6d7c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:08.053020 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd36013c-cdad-48a6-a682-d69492e6d7c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:08.062149 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd36013c-cdad-48a6-a682-d69492e6d7c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:08.063596 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd36013c-cdad-48a6-a682-d69492e6d7c7 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:08.073129 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1267/2545] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:52:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:52:08.489641 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e057ca-13ad-453e-b0f1-33e1035e9d1b None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:08.491320 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-98e057ca-13ad-453e-b0f1-33e1035e9d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:08.507093 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e057ca-13ad-453e-b0f1-33e1035e9d1b None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:08.512717 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3ce6a6-6258-4e9e-83fe-c4b505210666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:08.513627 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ce6a6-6258-4e9e-83fe-c4b505210666 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:08.513913 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ce6a6-6258-4e9e-83fe-c4b505210666 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:08.514192 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ce6a6-6258-4e9e-83fe-c4b505210666 admin admin] PATH_INFO: `/v3/projects/f99f33ac82794c44a27e626197422d6a` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:08.515506 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3ce6a6-6258-4e9e-83fe-c4b505210666 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f99f33ac82794c44a27e626197422d6a)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:08.517545 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3ce6a6-6258-4e9e-83fe-c4b505210666 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:08.641822 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1a3ce6a6-6258-4e9e-83fe-c4b505210666 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f99f33ac82794c44a27e626197422d6a', 'request_id': 'req-1a3ce6a6-6258-4e9e-83fe-c4b505210666'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:08.647078 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1a3ce6a6-6258-4e9e-83fe-c4b505210666 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f99f33ac82794c44a27e626197422d6a', 'request_id': 'req-1a3ce6a6-6258-4e9e-83fe-c4b505210666'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:08.749346 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1a3ce6a6-6258-4e9e-83fe-c4b505210666 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f99f33ac82794c44a27e626197422d6a', 'request_id': 'req-1a3ce6a6-6258-4e9e-83fe-c4b505210666'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:08.760640 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1a3ce6a6-6258-4e9e-83fe-c4b505210666 admin admin] The token cache is being invalidate because project f99f33ac82794c44a27e626197422d6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:52:08.760927 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1a3ce6a6-6258-4e9e-83fe-c4b505210666 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:08.761563 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1a3ce6a6-6258-4e9e-83fe-c4b505210666 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:08.763107 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1279/2546] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:52:08 2022] DELETE /identity/v3/projects/f99f33ac82794c44a27e626197422d6a => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:52:08.767154 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd36013c-cdad-48a6-a682-d69492e6d7c7 service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:08.777577 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd36013c-cdad-48a6-a682-d69492e6d7c7 service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:08.832799 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221c704a-0449-4546-a100-3f1e037b9643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:08.833727 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c704a-0449-4546-a100-3f1e037b9643 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:08.834035 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c704a-0449-4546-a100-3f1e037b9643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:08.834316 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c704a-0449-4546-a100-3f1e037b9643 admin admin] PATH_INFO: `/v3/users/a89ff0a346f44c3693f6d6fe0a903e47` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:08.835603 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221c704a-0449-4546-a100-3f1e037b9643 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a89ff0a346f44c3693f6d6fe0a903e47)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:08.838226 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221c704a-0449-4546-a100-3f1e037b9643 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:09.112157 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-221c704a-0449-4546-a100-3f1e037b9643 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a89ff0a346f44c3693f6d6fe0a903e47'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:09.195334 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-221c704a-0449-4546-a100-3f1e037b9643 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a89ff0a346f44c3693f6d6fe0a903e47'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:09.202910 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-221c704a-0449-4546-a100-3f1e037b9643 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a89ff0a346f44c3693f6d6fe0a903e47'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:09.203607 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-221c704a-0449-4546-a100-3f1e037b9643 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a89ff0a346f44c3693f6d6fe0a903e47'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:09.215699 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-221c704a-0449-4546-a100-3f1e037b9643 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a89ff0a346f44c3693f6d6fe0a903e47'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:09.221854 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1268/2547] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:52:08 2022] DELETE /identity/v3/users/a89ff0a346f44c3693f6d6fe0a903e47 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:52:09.728437 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3ce6a6-6258-4e9e-83fe-c4b505210666 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:09.731028 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-1a3ce6a6-6258-4e9e-83fe-c4b505210666 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:09.744475 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3ce6a6-6258-4e9e-83fe-c4b505210666 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:09.801595 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aabf4b1-9a28-4046-9080-10350f696b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:09.802455 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aabf4b1-9a28-4046-9080-10350f696b67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:09.802735 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aabf4b1-9a28-4046-9080-10350f696b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:09.803009 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aabf4b1-9a28-4046-9080-10350f696b67 admin admin] PATH_INFO: `/v3/projects/be8d7b3a47cb4c8cb121481598530038` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:09.804221 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aabf4b1-9a28-4046-9080-10350f696b67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be8d7b3a47cb4c8cb121481598530038)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:09.809149 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aabf4b1-9a28-4046-9080-10350f696b67 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:09.915432 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0aabf4b1-9a28-4046-9080-10350f696b67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be8d7b3a47cb4c8cb121481598530038', 'request_id': 'req-0aabf4b1-9a28-4046-9080-10350f696b67'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:09.921218 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0aabf4b1-9a28-4046-9080-10350f696b67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be8d7b3a47cb4c8cb121481598530038', 'request_id': 'req-0aabf4b1-9a28-4046-9080-10350f696b67'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:10.012337 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0aabf4b1-9a28-4046-9080-10350f696b67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be8d7b3a47cb4c8cb121481598530038', 'request_id': 'req-0aabf4b1-9a28-4046-9080-10350f696b67'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:10.023415 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0aabf4b1-9a28-4046-9080-10350f696b67 admin admin] The token cache is being invalidate because project be8d7b3a47cb4c8cb121481598530038 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:52:10.023731 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0aabf4b1-9a28-4046-9080-10350f696b67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:10.024343 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0aabf4b1-9a28-4046-9080-10350f696b67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:10.026464 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1280/2548] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:52:09 2022] DELETE /identity/v3/projects/be8d7b3a47cb4c8cb121481598530038 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:52:10.031460 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb12c3ac-88e8-41ab-a9e7-8262d7a564e6 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:10.031990 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb12c3ac-88e8-41ab-a9e7-8262d7a564e6 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:10.032112 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb12c3ac-88e8-41ab-a9e7-8262d7a564e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:10.050027 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-cb12c3ac-88e8-41ab-a9e7-8262d7a564e6 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:52:10.051338 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-cb12c3ac-88e8-41ab-a9e7-8262d7a564e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:10.111218 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1269/2549] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:52:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:52:10.119057 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c159ef56-b11e-4794-b0df-92be2bddff7d None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:10.119342 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c159ef56-b11e-4794-b0df-92be2bddff7d None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:10.119657 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c159ef56-b11e-4794-b0df-92be2bddff7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:10.138110 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-c159ef56-b11e-4794-b0df-92be2bddff7d None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:52:10.139369 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-c159ef56-b11e-4794-b0df-92be2bddff7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:10.147354 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1281/2550] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:52:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:52:10.152263 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb12c3ac-88e8-41ab-a9e7-8262d7a564e6 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:10.162021 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb12c3ac-88e8-41ab-a9e7-8262d7a564e6 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:10.166806 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632551ff-604b-4eea-bc7e-4dbaf42d3bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:10.167452 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632551ff-604b-4eea-bc7e-4dbaf42d3bfa admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:10.167789 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632551ff-604b-4eea-bc7e-4dbaf42d3bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:10.168067 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632551ff-604b-4eea-bc7e-4dbaf42d3bfa admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:10.169051 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632551ff-604b-4eea-bc7e-4dbaf42d3bfa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:52:10.169360 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632551ff-604b-4eea-bc7e-4dbaf42d3bfa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:10.170934 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632551ff-604b-4eea-bc7e-4dbaf42d3bfa admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:10.182773 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1270/2551] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Apr 11 16:52:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:52:10.187170 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c159ef56-b11e-4794-b0df-92be2bddff7d None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:10.196334 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c159ef56-b11e-4794-b0df-92be2bddff7d None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:10.202711 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40687fa1-a575-45ed-a2bc-15a4529d90b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:10.203390 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40687fa1-a575-45ed-a2bc-15a4529d90b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:10.203706 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40687fa1-a575-45ed-a2bc-15a4529d90b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:10.203990 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40687fa1-a575-45ed-a2bc-15a4529d90b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:10.205329 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40687fa1-a575-45ed-a2bc-15a4529d90b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:10.209103 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40687fa1-a575-45ed-a2bc-15a4529d90b9 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:10.312070 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1282/2552] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:52:10 2022] POST /identity/v3/projects => generated 379 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:52:10.316160 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632551ff-604b-4eea-bc7e-4dbaf42d3bfa admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:10.326669 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632551ff-604b-4eea-bc7e-4dbaf42d3bfa admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:10.382034 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350fd3f0-47aa-4511-8706-7e142f51e42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:10.382704 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350fd3f0-47aa-4511-8706-7e142f51e42e admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:10.382990 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350fd3f0-47aa-4511-8706-7e142f51e42e admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:10.383266 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350fd3f0-47aa-4511-8706-7e142f51e42e admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:10.384028 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350fd3f0-47aa-4511-8706-7e142f51e42e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:10.386719 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350fd3f0-47aa-4511-8706-7e142f51e42e admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:10.470179 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1271/2553] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:52:10 2022] POST /identity/v3/users => generated 290 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:52:10.474405 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40687fa1-a575-45ed-a2bc-15a4529d90b9 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:10.484976 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40687fa1-a575-45ed-a2bc-15a4529d90b9 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:10.496139 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b49c62-f52e-4d17-917a-ab7982ee4916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:10.496139 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b49c62-f52e-4d17-917a-ab7982ee4916 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:10.496139 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b49c62-f52e-4d17-917a-ab7982ee4916 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:10.496139 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b49c62-f52e-4d17-917a-ab7982ee4916 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:10.496602 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b49c62-f52e-4d17-917a-ab7982ee4916 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:10.496602 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b49c62-f52e-4d17-917a-ab7982ee4916 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:10.507696 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1283/2554] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:52:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:52:10.513128 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350fd3f0-47aa-4511-8706-7e142f51e42e admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:10.523474 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350fd3f0-47aa-4511-8706-7e142f51e42e admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:10.529003 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3763a9aa-1498-45ec-a3fb-3863de29b2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:10.529680 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763a9aa-1498-45ec-a3fb-3863de29b2c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:10.530002 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763a9aa-1498-45ec-a3fb-3863de29b2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:10.530286 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763a9aa-1498-45ec-a3fb-3863de29b2c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:10.531012 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3763a9aa-1498-45ec-a3fb-3863de29b2c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:10.532626 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3763a9aa-1498-45ec-a3fb-3863de29b2c5 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:10.547624 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1272/2555] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:52:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:52:10.551964 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b49c62-f52e-4d17-917a-ab7982ee4916 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:10.562481 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b49c62-f52e-4d17-917a-ab7982ee4916 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:10.567084 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9037bc-c87c-47ca-8f0a-a8640a6fdf4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:10.567981 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9037bc-c87c-47ca-8f0a-a8640a6fdf4e admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:10.568261 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9037bc-c87c-47ca-8f0a-a8640a6fdf4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:10.568536 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9037bc-c87c-47ca-8f0a-a8640a6fdf4e admin admin] PATH_INFO: `/v3/projects/239a62f12f514c3c9c700abb8e5c2c4e/users/466b5a5ca639442ba8bf54664ef67118/roles/0d41da7bec094450b5bff4e4831be52c` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:10.584145 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9037bc-c87c-47ca-8f0a-a8640a6fdf4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=239a62f12f514c3c9c700abb8e5c2c4e, user_id=466b5a5ca639442ba8bf54664ef67118, role_id=0d41da7bec094450b5bff4e4831be52c)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:10.586755 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9037bc-c87c-47ca-8f0a-a8640a6fdf4e admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:10.663606 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1284/2556] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:52:10 2022] PUT /identity/v3/projects/239a62f12f514c3c9c700abb8e5c2c4e/users/466b5a5ca639442ba8bf54664ef67118/roles/0d41da7bec094450b5bff4e4831be52c => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:52:10.674431 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726eb07e-56eb-4134-bdc6-97729f84e09e None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:10.674721 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726eb07e-56eb-4134-bdc6-97729f84e09e None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:10.675002 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726eb07e-56eb-4134-bdc6-97729f84e09e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:10.703234 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-726eb07e-56eb-4134-bdc6-97729f84e09e None None] MFA Rules not processed for user `466b5a5ca639442ba8bf54664ef67118`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:52:10.704518 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-726eb07e-56eb-4134-bdc6-97729f84e09e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:10.769003 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1273/2557] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:52:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:52:10.773559 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9037bc-c87c-47ca-8f0a-a8640a6fdf4e admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:10.833001 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9037bc-c87c-47ca-8f0a-a8640a6fdf4e admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:10.837759 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68f0c1d-8dad-4982-b67d-d4b991e2f4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:10.838308 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f0c1d-8dad-4982-b67d-d4b991e2f4db admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:10.838593 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f0c1d-8dad-4982-b67d-d4b991e2f4db admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:10.838868 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f0c1d-8dad-4982-b67d-d4b991e2f4db admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:10.839571 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68f0c1d-8dad-4982-b67d-d4b991e2f4db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:10.841772 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68f0c1d-8dad-4982-b67d-d4b991e2f4db admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:10.940733 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1285/2558] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:52:10 2022] POST /identity/v3/projects => generated 379 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:52:10.944946 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726eb07e-56eb-4134-bdc6-97729f84e09e None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:10.955699 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726eb07e-56eb-4134-bdc6-97729f84e09e None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:11.011008 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54605cd-a0ff-4e9e-abc6-c3106a3a7b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:11.011718 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54605cd-a0ff-4e9e-abc6-c3106a3a7b80 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:11.012004 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54605cd-a0ff-4e9e-abc6-c3106a3a7b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:11.012281 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54605cd-a0ff-4e9e-abc6-c3106a3a7b80 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:11.012977 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54605cd-a0ff-4e9e-abc6-c3106a3a7b80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:11.014881 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54605cd-a0ff-4e9e-abc6-c3106a3a7b80 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:11.128029 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1274/2559] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:52:10 2022] POST /identity/v3/users => generated 290 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:52:11.132403 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68f0c1d-8dad-4982-b67d-d4b991e2f4db admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:11.142883 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68f0c1d-8dad-4982-b67d-d4b991e2f4db admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:11.147493 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9877146-56fe-44d5-8408-f604e7c8706a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:11.153162 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9877146-56fe-44d5-8408-f604e7c8706a admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:11.153162 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9877146-56fe-44d5-8408-f604e7c8706a admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:11.153162 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9877146-56fe-44d5-8408-f604e7c8706a admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:11.153162 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9877146-56fe-44d5-8408-f604e7c8706a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:11.153162 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9877146-56fe-44d5-8408-f604e7c8706a admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:11.162460 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1286/2560] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:52:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:52:11.167245 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54605cd-a0ff-4e9e-abc6-c3106a3a7b80 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:11.177450 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54605cd-a0ff-4e9e-abc6-c3106a3a7b80 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:11.182777 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc880aeb-e77f-4286-acdc-c47556b45bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:11.183430 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc880aeb-e77f-4286-acdc-c47556b45bc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:11.183747 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc880aeb-e77f-4286-acdc-c47556b45bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:11.184024 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc880aeb-e77f-4286-acdc-c47556b45bc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:11.184743 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc880aeb-e77f-4286-acdc-c47556b45bc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:11.186318 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc880aeb-e77f-4286-acdc-c47556b45bc4 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:11.196108 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1275/2561] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:52:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:52:11.200733 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9877146-56fe-44d5-8408-f604e7c8706a admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:11.214765 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9877146-56fe-44d5-8408-f604e7c8706a admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:11.221252 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa471989-1d01-403d-9f0b-1c12c0c63836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:11.222578 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa471989-1d01-403d-9f0b-1c12c0c63836 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:11.222998 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa471989-1d01-403d-9f0b-1c12c0c63836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:11.223407 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa471989-1d01-403d-9f0b-1c12c0c63836 admin admin] PATH_INFO: `/v3/projects/db117745e08947008059071aa254e78d/users/66c777025c1749b3ad956c90f9b4778e/roles/0d41da7bec094450b5bff4e4831be52c` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:11.244816 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa471989-1d01-403d-9f0b-1c12c0c63836 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db117745e08947008059071aa254e78d, user_id=66c777025c1749b3ad956c90f9b4778e, role_id=0d41da7bec094450b5bff4e4831be52c)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:11.248648 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa471989-1d01-403d-9f0b-1c12c0c63836 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:11.315767 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1287/2562] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:52:11 2022] PUT /identity/v3/projects/db117745e08947008059071aa254e78d/users/66c777025c1749b3ad956c90f9b4778e/roles/0d41da7bec094450b5bff4e4831be52c => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:52:11.327844 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eca5e6-17c2-454f-8123-857bc17a0b65 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:11.328137 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eca5e6-17c2-454f-8123-857bc17a0b65 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:11.328437 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eca5e6-17c2-454f-8123-857bc17a0b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:11.356070 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-78eca5e6-17c2-454f-8123-857bc17a0b65 None None] MFA Rules not processed for user `66c777025c1749b3ad956c90f9b4778e`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:52:11.357288 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-78eca5e6-17c2-454f-8123-857bc17a0b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:11.421186 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1276/2563] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:52:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:52:11.425925 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa471989-1d01-403d-9f0b-1c12c0c63836 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:11.486890 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa471989-1d01-403d-9f0b-1c12c0c63836 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:11.491630 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294dad4d-e039-48d4-8650-e40f632d3ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:11.492290 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294dad4d-e039-48d4-8650-e40f632d3ba2 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:11.502580 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294dad4d-e039-48d4-8650-e40f632d3ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:11.502580 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294dad4d-e039-48d4-8650-e40f632d3ba2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:11.502580 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294dad4d-e039-48d4-8650-e40f632d3ba2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:11.502580 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294dad4d-e039-48d4-8650-e40f632d3ba2 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:11.602526 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1288/2564] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:52:11 2022] POST /identity/v3/projects => generated 379 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:52:11.607593 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eca5e6-17c2-454f-8123-857bc17a0b65 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:11.618522 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eca5e6-17c2-454f-8123-857bc17a0b65 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:11.673640 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ffaf5d-acf6-4f0e-9af2-52fb1a1c05a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:11.674186 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ffaf5d-acf6-4f0e-9af2-52fb1a1c05a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:11.674467 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ffaf5d-acf6-4f0e-9af2-52fb1a1c05a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:11.674740 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ffaf5d-acf6-4f0e-9af2-52fb1a1c05a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:11.675428 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ffaf5d-acf6-4f0e-9af2-52fb1a1c05a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:11.677350 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ffaf5d-acf6-4f0e-9af2-52fb1a1c05a6 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:11.790345 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1277/2565] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:52:11 2022] POST /identity/v3/users => generated 296 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:52:11.794892 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294dad4d-e039-48d4-8650-e40f632d3ba2 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:11.807852 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294dad4d-e039-48d4-8650-e40f632d3ba2 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:11.812660 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e3fc4e-c47e-496a-8838-a88bb7b48c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:11.813319 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3fc4e-c47e-496a-8838-a88bb7b48c19 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:11.813604 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3fc4e-c47e-496a-8838-a88bb7b48c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:11.813882 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3fc4e-c47e-496a-8838-a88bb7b48c19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:11.814638 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e3fc4e-c47e-496a-8838-a88bb7b48c19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:11.816347 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e3fc4e-c47e-496a-8838-a88bb7b48c19 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:11.827498 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1289/2566] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:52:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:52:11.832033 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ffaf5d-acf6-4f0e-9af2-52fb1a1c05a6 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:11.842705 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ffaf5d-acf6-4f0e-9af2-52fb1a1c05a6 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:11.847299 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b30d4-b311-4a5d-9e0b-8d8d27a744ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:11.848230 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b30d4-b311-4a5d-9e0b-8d8d27a744ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:11.848499 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b30d4-b311-4a5d-9e0b-8d8d27a744ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:11.848773 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b30d4-b311-4a5d-9e0b-8d8d27a744ba admin admin] PATH_INFO: `/v3/projects/348b4c697e184a60aa0e378242c87848/users/96536a29258042dbb08010d216da70b8/roles/702e5e78b5d744529384b96a390ae92f` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:11.863500 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499b30d4-b311-4a5d-9e0b-8d8d27a744ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=348b4c697e184a60aa0e378242c87848, user_id=96536a29258042dbb08010d216da70b8, role_id=702e5e78b5d744529384b96a390ae92f)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:11.866256 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499b30d4-b311-4a5d-9e0b-8d8d27a744ba admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:11.972789 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1278/2567] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:52:11 2022] PUT /identity/v3/projects/348b4c697e184a60aa0e378242c87848/users/96536a29258042dbb08010d216da70b8/roles/702e5e78b5d744529384b96a390ae92f => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:52:11.976933 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e3fc4e-c47e-496a-8838-a88bb7b48c19 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:11.987071 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e3fc4e-c47e-496a-8838-a88bb7b48c19 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:12.042993 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5895291-b25a-427d-9066-cec20057d314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:12.043964 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5895291-b25a-427d-9066-cec20057d314 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:12.044255 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5895291-b25a-427d-9066-cec20057d314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:12.044538 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5895291-b25a-427d-9066-cec20057d314 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:12.045287 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5895291-b25a-427d-9066-cec20057d314 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:12.046909 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5895291-b25a-427d-9066-cec20057d314 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:12.056600 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1290/2568] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:52:11 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:52:12.061344 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b30d4-b311-4a5d-9e0b-8d8d27a744ba admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:12.071663 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b30d4-b311-4a5d-9e0b-8d8d27a744ba admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:12.076948 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa39248-a7a5-44ed-b01f-52021961c7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:12.077894 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa39248-a7a5-44ed-b01f-52021961c7e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:12.078180 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa39248-a7a5-44ed-b01f-52021961c7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:12.078453 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa39248-a7a5-44ed-b01f-52021961c7e3 admin admin] PATH_INFO: `/v3/projects/348b4c697e184a60aa0e378242c87848/users/96536a29258042dbb08010d216da70b8/roles/702e5e78b5d744529384b96a390ae92f` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:12.080478 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa39248-a7a5-44ed-b01f-52021961c7e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=348b4c697e184a60aa0e378242c87848, user_id=96536a29258042dbb08010d216da70b8, role_id=702e5e78b5d744529384b96a390ae92f)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:12.083078 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa39248-a7a5-44ed-b01f-52021961c7e3 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:12.093382 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1279/2569] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:52:12 2022] PUT /identity/v3/projects/348b4c697e184a60aa0e378242c87848/users/96536a29258042dbb08010d216da70b8/roles/702e5e78b5d744529384b96a390ae92f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:52:12.103635 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3cba68-a2d8-48eb-a16f-574fff911945 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:12.104091 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3cba68-a2d8-48eb-a16f-574fff911945 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:12.104375 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3cba68-a2d8-48eb-a16f-574fff911945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:12.130278 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-8f3cba68-a2d8-48eb-a16f-574fff911945 None None] MFA Rules not processed for user `96536a29258042dbb08010d216da70b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:52:12.131533 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-8f3cba68-a2d8-48eb-a16f-574fff911945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:12.199200 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1291/2570] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:52:12 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:52:12.211238 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa39248-a7a5-44ed-b01f-52021961c7e3 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:12.213522 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-faa39248-a7a5-44ed-b01f-52021961c7e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:12.271489 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa39248-a7a5-44ed-b01f-52021961c7e3 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:12.275134 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7017a62a-957b-48b3-b982-153b03bc41c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '950b5b5f690d41509ead753065a0b793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:12.276583 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7017a62a-957b-48b3-b982-153b03bc41c7 service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:12.276772 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7017a62a-957b-48b3-b982-153b03bc41c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:12.276970 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7017a62a-957b-48b3-b982-153b03bc41c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:12.285981 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7017a62a-957b-48b3-b982-153b03bc41c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:12.287406 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7017a62a-957b-48b3-b982-153b03bc41c7 service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:12.298223 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1280/2571] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:52:12 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:52:12.464162 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3cba68-a2d8-48eb-a16f-574fff911945 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:12.465564 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-8f3cba68-a2d8-48eb-a16f-574fff911945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:12.477411 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3cba68-a2d8-48eb-a16f-574fff911945 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:12.481693 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719d34f8-563b-477a-95db-661ab02a59a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '950b5b5f690d41509ead753065a0b793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:12.486156 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d34f8-563b-477a-95db-661ab02a59a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:12.486156 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d34f8-563b-477a-95db-661ab02a59a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:12.486156 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d34f8-563b-477a-95db-661ab02a59a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:12.538707 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719d34f8-563b-477a-95db-661ab02a59a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:12.540085 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719d34f8-563b-477a-95db-661ab02a59a5 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:12.549323 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1292/2572] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:52:12 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:52:17.981864 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7017a62a-957b-48b3-b982-153b03bc41c7 service cinder] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:18.046799 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7017a62a-957b-48b3-b982-153b03bc41c7 service cinder] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:18.051533 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d45940c-5a99-4f94-81c8-98c905ceecfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:18.052361 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d45940c-5a99-4f94-81c8-98c905ceecfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:18.052662 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d45940c-5a99-4f94-81c8-98c905ceecfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:18.052917 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d45940c-5a99-4f94-81c8-98c905ceecfd admin admin] PATH_INFO: `/v3/users/466b5a5ca639442ba8bf54664ef67118` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:18.054109 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d45940c-5a99-4f94-81c8-98c905ceecfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=466b5a5ca639442ba8bf54664ef67118)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:18.056050 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d45940c-5a99-4f94-81c8-98c905ceecfd admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:18.300848 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-3d45940c-5a99-4f94-81c8-98c905ceecfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '466b5a5ca639442ba8bf54664ef67118'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:18.394144 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-3d45940c-5a99-4f94-81c8-98c905ceecfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '466b5a5ca639442ba8bf54664ef67118'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:18.401700 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-3d45940c-5a99-4f94-81c8-98c905ceecfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '466b5a5ca639442ba8bf54664ef67118'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:18.402380 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-3d45940c-5a99-4f94-81c8-98c905ceecfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '466b5a5ca639442ba8bf54664ef67118'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:18.414570 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-3d45940c-5a99-4f94-81c8-98c905ceecfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '466b5a5ca639442ba8bf54664ef67118'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:18.421297 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1281/2573] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:52:17 2022] DELETE /identity/v3/users/466b5a5ca639442ba8bf54664ef67118 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:52:18.425812 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f8daf-a21b-4a62-8d41-41635256dbb1 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:18.426334 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f8daf-a21b-4a62-8d41-41635256dbb1 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:18.426463 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f8daf-a21b-4a62-8d41-41635256dbb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:18.444535 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-8c2f8daf-a21b-4a62-8d41-41635256dbb1 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:52:18.445902 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-8c2f8daf-a21b-4a62-8d41-41635256dbb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:18.504149 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1293/2574] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:52:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:52:18.514138 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d45940c-5a99-4f94-81c8-98c905ceecfd admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:18.515743 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-3d45940c-5a99-4f94-81c8-98c905ceecfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:18.572191 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d45940c-5a99-4f94-81c8-98c905ceecfd admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:18.575782 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddf0705-f71b-452a-90d1-140a87f096b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:18.577018 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf0705-f71b-452a-90d1-140a87f096b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:18.577281 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf0705-f71b-452a-90d1-140a87f096b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:18.577554 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf0705-f71b-452a-90d1-140a87f096b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:18.587112 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddf0705-f71b-452a-90d1-140a87f096b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:18.588649 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddf0705-f71b-452a-90d1-140a87f096b5 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:18.598770 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1282/2575] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:52:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:52:19.020678 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f8daf-a21b-4a62-8d41-41635256dbb1 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:19.022410 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-8c2f8daf-a21b-4a62-8d41-41635256dbb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:19.037185 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f8daf-a21b-4a62-8d41-41635256dbb1 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:19.042506 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5a17fe-c280-4150-b8b8-b3900364feaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:19.043838 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a17fe-c280-4150-b8b8-b3900364feaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:19.044129 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a17fe-c280-4150-b8b8-b3900364feaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:19.044403 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a17fe-c280-4150-b8b8-b3900364feaf admin admin] PATH_INFO: `/v3/projects/239a62f12f514c3c9c700abb8e5c2c4e` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:19.049952 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5a17fe-c280-4150-b8b8-b3900364feaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=239a62f12f514c3c9c700abb8e5c2c4e)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:19.049952 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5a17fe-c280-4150-b8b8-b3900364feaf admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:19.161197 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-6a5a17fe-c280-4150-b8b8-b3900364feaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '239a62f12f514c3c9c700abb8e5c2c4e', 'request_id': 'req-6a5a17fe-c280-4150-b8b8-b3900364feaf'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:19.166383 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-6a5a17fe-c280-4150-b8b8-b3900364feaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '239a62f12f514c3c9c700abb8e5c2c4e', 'request_id': 'req-6a5a17fe-c280-4150-b8b8-b3900364feaf'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:19.264322 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-6a5a17fe-c280-4150-b8b8-b3900364feaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '239a62f12f514c3c9c700abb8e5c2c4e', 'request_id': 'req-6a5a17fe-c280-4150-b8b8-b3900364feaf'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:19.275622 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-6a5a17fe-c280-4150-b8b8-b3900364feaf admin admin] The token cache is being invalidate because project 239a62f12f514c3c9c700abb8e5c2c4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:52:19.275927 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-6a5a17fe-c280-4150-b8b8-b3900364feaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:19.276570 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-6a5a17fe-c280-4150-b8b8-b3900364feaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:19.278210 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1294/2576] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:52:19 2022] DELETE /identity/v3/projects/239a62f12f514c3c9c700abb8e5c2c4e => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:52:19.282911 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddf0705-f71b-452a-90d1-140a87f096b5 service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:19.292833 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddf0705-f71b-452a-90d1-140a87f096b5 service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:19.350922 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b7d06c-abbf-4d0e-b52c-df14232be626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:19.351825 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b7d06c-abbf-4d0e-b52c-df14232be626 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:19.352110 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b7d06c-abbf-4d0e-b52c-df14232be626 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:19.352386 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b7d06c-abbf-4d0e-b52c-df14232be626 admin admin] PATH_INFO: `/v3/users/66c777025c1749b3ad956c90f9b4778e` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:19.353613 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b7d06c-abbf-4d0e-b52c-df14232be626 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66c777025c1749b3ad956c90f9b4778e)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:19.355544 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b7d06c-abbf-4d0e-b52c-df14232be626 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:19.609067 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-00b7d06c-abbf-4d0e-b52c-df14232be626 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66c777025c1749b3ad956c90f9b4778e'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:19.697951 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-00b7d06c-abbf-4d0e-b52c-df14232be626 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66c777025c1749b3ad956c90f9b4778e'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:19.706075 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-00b7d06c-abbf-4d0e-b52c-df14232be626 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66c777025c1749b3ad956c90f9b4778e'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:19.706750 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-00b7d06c-abbf-4d0e-b52c-df14232be626 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66c777025c1749b3ad956c90f9b4778e'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:19.718511 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-00b7d06c-abbf-4d0e-b52c-df14232be626 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66c777025c1749b3ad956c90f9b4778e'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:19.724562 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1283/2577] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:52:19 2022] DELETE /identity/v3/users/66c777025c1749b3ad956c90f9b4778e => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:52:20.226314 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5a17fe-c280-4150-b8b8-b3900364feaf admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:20.235010 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-6a5a17fe-c280-4150-b8b8-b3900364feaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:20.244323 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5a17fe-c280-4150-b8b8-b3900364feaf admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:20.307213 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5696d8-1f11-465b-bd29-e82af7ff78a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:20.308135 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5696d8-1f11-465b-bd29-e82af7ff78a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:20.308417 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5696d8-1f11-465b-bd29-e82af7ff78a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:20.308693 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5696d8-1f11-465b-bd29-e82af7ff78a7 admin admin] PATH_INFO: `/v3/projects/db117745e08947008059071aa254e78d` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:20.309880 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5696d8-1f11-465b-bd29-e82af7ff78a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db117745e08947008059071aa254e78d)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:20.312471 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5696d8-1f11-465b-bd29-e82af7ff78a7 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:20.441768 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-4c5696d8-1f11-465b-bd29-e82af7ff78a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db117745e08947008059071aa254e78d', 'request_id': 'req-4c5696d8-1f11-465b-bd29-e82af7ff78a7'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:20.447262 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-4c5696d8-1f11-465b-bd29-e82af7ff78a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db117745e08947008059071aa254e78d', 'request_id': 'req-4c5696d8-1f11-465b-bd29-e82af7ff78a7'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:20.565936 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-4c5696d8-1f11-465b-bd29-e82af7ff78a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db117745e08947008059071aa254e78d', 'request_id': 'req-4c5696d8-1f11-465b-bd29-e82af7ff78a7'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:20.577865 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-4c5696d8-1f11-465b-bd29-e82af7ff78a7 admin admin] The token cache is being invalidate because project db117745e08947008059071aa254e78d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:52:20.578216 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-4c5696d8-1f11-465b-bd29-e82af7ff78a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:20.578877 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-4c5696d8-1f11-465b-bd29-e82af7ff78a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:20.580608 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1295/2578] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:52:20 2022] DELETE /identity/v3/projects/db117745e08947008059071aa254e78d => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:52:20.584788 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b7d06c-abbf-4d0e-b52c-df14232be626 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:20.586182 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-00b7d06c-abbf-4d0e-b52c-df14232be626 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:20.599106 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b7d06c-abbf-4d0e-b52c-df14232be626 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:20.658032 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98518027-0653-4ccf-a711-3ee8f2572f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:20.658878 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98518027-0653-4ccf-a711-3ee8f2572f56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:20.659160 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98518027-0653-4ccf-a711-3ee8f2572f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:20.659470 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98518027-0653-4ccf-a711-3ee8f2572f56 admin admin] PATH_INFO: `/v3/users/96536a29258042dbb08010d216da70b8` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:20.660704 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98518027-0653-4ccf-a711-3ee8f2572f56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96536a29258042dbb08010d216da70b8)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:20.662605 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98518027-0653-4ccf-a711-3ee8f2572f56 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:20.917779 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-98518027-0653-4ccf-a711-3ee8f2572f56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96536a29258042dbb08010d216da70b8'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:21.006650 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-98518027-0653-4ccf-a711-3ee8f2572f56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96536a29258042dbb08010d216da70b8'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:21.014419 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-98518027-0653-4ccf-a711-3ee8f2572f56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96536a29258042dbb08010d216da70b8'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:21.015108 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-98518027-0653-4ccf-a711-3ee8f2572f56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96536a29258042dbb08010d216da70b8'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:21.026764 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-98518027-0653-4ccf-a711-3ee8f2572f56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96536a29258042dbb08010d216da70b8'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:21.033712 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1284/2579] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:52:20 2022] DELETE /identity/v3/users/96536a29258042dbb08010d216da70b8 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:52:21.483353 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5696d8-1f11-465b-bd29-e82af7ff78a7 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:21.487049 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-4c5696d8-1f11-465b-bd29-e82af7ff78a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:21.499188 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5696d8-1f11-465b-bd29-e82af7ff78a7 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:21.560071 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208a075a-b792-43ee-90be-ee2b5abe42f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:21.561558 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a075a-b792-43ee-90be-ee2b5abe42f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:21.561846 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a075a-b792-43ee-90be-ee2b5abe42f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:21.562126 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a075a-b792-43ee-90be-ee2b5abe42f6 admin admin] PATH_INFO: `/v3/projects/348b4c697e184a60aa0e378242c87848` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:21.563328 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208a075a-b792-43ee-90be-ee2b5abe42f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=348b4c697e184a60aa0e378242c87848)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:21.565272 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208a075a-b792-43ee-90be-ee2b5abe42f6 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:21.693026 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-208a075a-b792-43ee-90be-ee2b5abe42f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '348b4c697e184a60aa0e378242c87848', 'request_id': 'req-208a075a-b792-43ee-90be-ee2b5abe42f6'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:21.698189 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-208a075a-b792-43ee-90be-ee2b5abe42f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '348b4c697e184a60aa0e378242c87848', 'request_id': 'req-208a075a-b792-43ee-90be-ee2b5abe42f6'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:21.801095 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-208a075a-b792-43ee-90be-ee2b5abe42f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '348b4c697e184a60aa0e378242c87848', 'request_id': 'req-208a075a-b792-43ee-90be-ee2b5abe42f6'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:21.814749 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-208a075a-b792-43ee-90be-ee2b5abe42f6 admin admin] The token cache is being invalidate because project 348b4c697e184a60aa0e378242c87848 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:52:21.815050 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-208a075a-b792-43ee-90be-ee2b5abe42f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:21.815718 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-208a075a-b792-43ee-90be-ee2b5abe42f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:21.817295 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1296/2580] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:52:21 2022] DELETE /identity/v3/projects/348b4c697e184a60aa0e378242c87848 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:52:21.823430 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e296981-025c-4057-b279-a7fb91916074 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:21.823960 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e296981-025c-4057-b279-a7fb91916074 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:21.824064 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e296981-025c-4057-b279-a7fb91916074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:21.843200 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-0e296981-025c-4057-b279-a7fb91916074 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:52:21.844462 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-0e296981-025c-4057-b279-a7fb91916074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:21.903976 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1285/2581] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:52:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:52:21.912961 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2bd39-56b2-47d1-b3ef-60d94027676a None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:21.913391 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2bd39-56b2-47d1-b3ef-60d94027676a None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:21.913713 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2bd39-56b2-47d1-b3ef-60d94027676a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:21.933041 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-4fe2bd39-56b2-47d1-b3ef-60d94027676a None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:52:21.934258 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-4fe2bd39-56b2-47d1-b3ef-60d94027676a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:21.943234 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1297/2582] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:52:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:52:21.947635 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e296981-025c-4057-b279-a7fb91916074 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:21.958259 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e296981-025c-4057-b279-a7fb91916074 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:21.963444 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e609e-c360-4bbb-8f67-ff00469f83c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:21.964074 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e609e-c360-4bbb-8f67-ff00469f83c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:21.964337 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e609e-c360-4bbb-8f67-ff00469f83c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:21.964509 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e609e-c360-4bbb-8f67-ff00469f83c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:21.965347 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4e609e-c360-4bbb-8f67-ff00469f83c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:52:21.965548 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4e609e-c360-4bbb-8f67-ff00469f83c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:21.967779 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4e609e-c360-4bbb-8f67-ff00469f83c6 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:21.982183 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1286/2583] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Apr 11 16:52:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:52:21.987228 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe2bd39-56b2-47d1-b3ef-60d94027676a None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:21.996925 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe2bd39-56b2-47d1-b3ef-60d94027676a None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:22.001828 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc0968a-9ee1-4764-80af-777f2eb71832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:22.002553 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0968a-9ee1-4764-80af-777f2eb71832 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:22.002840 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0968a-9ee1-4764-80af-777f2eb71832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:22.003119 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0968a-9ee1-4764-80af-777f2eb71832 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:22.003854 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc0968a-9ee1-4764-80af-777f2eb71832 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:22.005804 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc0968a-9ee1-4764-80af-777f2eb71832 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:22.117564 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1298/2584] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:52:21 2022] POST /identity/v3/projects => generated 371 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:52:22.121794 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e609e-c360-4bbb-8f67-ff00469f83c6 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:22.131971 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e609e-c360-4bbb-8f67-ff00469f83c6 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:22.189887 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7a7321-dfb9-4607-b19f-113041aa34f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:22.190575 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a7321-dfb9-4607-b19f-113041aa34f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:22.190887 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a7321-dfb9-4607-b19f-113041aa34f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:22.191111 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a7321-dfb9-4607-b19f-113041aa34f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:22.191944 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7a7321-dfb9-4607-b19f-113041aa34f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:22.193887 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7a7321-dfb9-4607-b19f-113041aa34f3 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:22.323212 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1287/2585] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:52:22 2022] POST /identity/v3/users => generated 286 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:52:22.327444 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc0968a-9ee1-4764-80af-777f2eb71832 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:22.338044 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc0968a-9ee1-4764-80af-777f2eb71832 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:22.342787 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035bee94-db77-4102-8899-c78fef9642e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:22.343461 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035bee94-db77-4102-8899-c78fef9642e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:22.343789 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035bee94-db77-4102-8899-c78fef9642e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:22.344070 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035bee94-db77-4102-8899-c78fef9642e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:22.344801 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035bee94-db77-4102-8899-c78fef9642e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:22.346400 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035bee94-db77-4102-8899-c78fef9642e6 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:22.359036 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1299/2586] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:52:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:52:22.367032 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7a7321-dfb9-4607-b19f-113041aa34f3 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:22.378006 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7a7321-dfb9-4607-b19f-113041aa34f3 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:22.382774 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bab91b-c0f9-49fc-b6e1-0ead55e1f37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:22.383449 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bab91b-c0f9-49fc-b6e1-0ead55e1f37e admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:22.383771 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bab91b-c0f9-49fc-b6e1-0ead55e1f37e admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:22.384052 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bab91b-c0f9-49fc-b6e1-0ead55e1f37e admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:22.384786 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bab91b-c0f9-49fc-b6e1-0ead55e1f37e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:22.386393 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bab91b-c0f9-49fc-b6e1-0ead55e1f37e admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:22.397573 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1288/2587] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:52:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:52:22.401863 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035bee94-db77-4102-8899-c78fef9642e6 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:22.412984 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035bee94-db77-4102-8899-c78fef9642e6 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:22.418357 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1d1e0c-265d-40b9-a8a0-87bfb2fc167a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:22.419647 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d1e0c-265d-40b9-a8a0-87bfb2fc167a admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:22.420595 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d1e0c-265d-40b9-a8a0-87bfb2fc167a admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:22.420917 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d1e0c-265d-40b9-a8a0-87bfb2fc167a admin admin] PATH_INFO: `/v3/projects/1ef8ee4852e647178750688b27f452f3/users/249ffa59e27446aa9ed72a882f6eed47/roles/0d41da7bec094450b5bff4e4831be52c` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:22.442011 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1d1e0c-265d-40b9-a8a0-87bfb2fc167a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ef8ee4852e647178750688b27f452f3, user_id=249ffa59e27446aa9ed72a882f6eed47, role_id=0d41da7bec094450b5bff4e4831be52c)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:22.447450 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1d1e0c-265d-40b9-a8a0-87bfb2fc167a admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:22.539100 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1300/2588] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:52:22 2022] PUT /identity/v3/projects/1ef8ee4852e647178750688b27f452f3/users/249ffa59e27446aa9ed72a882f6eed47/roles/0d41da7bec094450b5bff4e4831be52c => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:52:22.544707 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f052e-a97f-4bd7-8102-c2e51ecbd995 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:22.545776 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f052e-a97f-4bd7-8102-c2e51ecbd995 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:22.546134 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f052e-a97f-4bd7-8102-c2e51ecbd995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:22.565047 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-2d4f052e-a97f-4bd7-8102-c2e51ecbd995 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:52:22.571417 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-2d4f052e-a97f-4bd7-8102-c2e51ecbd995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:22.626094 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1289/2589] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:52:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:52:22.635816 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1d1e0c-265d-40b9-a8a0-87bfb2fc167a admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:22.638390 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ea1d1e0c-265d-40b9-a8a0-87bfb2fc167a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:22.695222 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1d1e0c-265d-40b9-a8a0-87bfb2fc167a admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:22.698810 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296093ca-8926-4d98-92e4-f1614e0b6044 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:22.699446 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296093ca-8926-4d98-92e4-f1614e0b6044 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:22.699757 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296093ca-8926-4d98-92e4-f1614e0b6044 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:22.700031 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296093ca-8926-4d98-92e4-f1614e0b6044 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:22.709758 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296093ca-8926-4d98-92e4-f1614e0b6044 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:22.711290 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296093ca-8926-4d98-92e4-f1614e0b6044 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:22.721257 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1301/2590] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:52:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:52:24.122624 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59d565-1e6c-4f20-aee6-621c56a1bebb None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:24.123186 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59d565-1e6c-4f20-aee6-621c56a1bebb None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:24.123186 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59d565-1e6c-4f20-aee6-621c56a1bebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:24.151434 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-5b59d565-1e6c-4f20-aee6-621c56a1bebb None None] MFA Rules not processed for user `249ffa59e27446aa9ed72a882f6eed47`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:52:24.152760 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-5b59d565-1e6c-4f20-aee6-621c56a1bebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:24.216834 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1290/2591] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:52:24 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:52:24.222257 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296093ca-8926-4d98-92e4-f1614e0b6044 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:24.231984 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296093ca-8926-4d98-92e4-f1614e0b6044 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:24.238210 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fe6e3a-3441-4e77-9503-c018f36f182d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:24.238901 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe6e3a-3441-4e77-9503-c018f36f182d admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:24.239376 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe6e3a-3441-4e77-9503-c018f36f182d admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:24.239500 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe6e3a-3441-4e77-9503-c018f36f182d admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:24.240180 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fe6e3a-3441-4e77-9503-c018f36f182d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:24.242064 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fe6e3a-3441-4e77-9503-c018f36f182d admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:24.322405 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1302/2592] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:52:24 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:52:24.326899 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b59d565-1e6c-4f20-aee6-621c56a1bebb None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:24.341140 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b59d565-1e6c-4f20-aee6-621c56a1bebb None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:24.401273 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bfd8ae-a221-4a8f-92e9-be277c6c0c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:24.401951 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bfd8ae-a221-4a8f-92e9-be277c6c0c65 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:24.402237 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bfd8ae-a221-4a8f-92e9-be277c6c0c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:24.402516 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bfd8ae-a221-4a8f-92e9-be277c6c0c65 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:24.403228 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bfd8ae-a221-4a8f-92e9-be277c6c0c65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:24.406040 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bfd8ae-a221-4a8f-92e9-be277c6c0c65 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:24.539017 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1291/2593] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:52:24 2022] POST /identity/v3/users => generated 293 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:52:24.543034 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fe6e3a-3441-4e77-9503-c018f36f182d admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:24.555140 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fe6e3a-3441-4e77-9503-c018f36f182d admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:24.559787 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa835e9-2676-417f-9310-9a9cc8647297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:24.563971 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa835e9-2676-417f-9310-9a9cc8647297 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:24.563971 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa835e9-2676-417f-9310-9a9cc8647297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:24.563971 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa835e9-2676-417f-9310-9a9cc8647297 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:24.563971 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa835e9-2676-417f-9310-9a9cc8647297 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:24.563971 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa835e9-2676-417f-9310-9a9cc8647297 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:24.574537 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1303/2594] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:52:24.579417 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bfd8ae-a221-4a8f-92e9-be277c6c0c65 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:24.589741 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bfd8ae-a221-4a8f-92e9-be277c6c0c65 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:24.595422 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d18c449-cd23-45f7-954b-549bcd19534e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:24.596336 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18c449-cd23-45f7-954b-549bcd19534e admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:24.596617 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18c449-cd23-45f7-954b-549bcd19534e admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:24.596888 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18c449-cd23-45f7-954b-549bcd19534e admin admin] PATH_INFO: `/v3/projects/9d7ac7a518134b6c88c39077e371ffa9/users/7d99d9b7e6704cd780b2d54a831a64f4/roles/702e5e78b5d744529384b96a390ae92f` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:24.612696 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d18c449-cd23-45f7-954b-549bcd19534e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d7ac7a518134b6c88c39077e371ffa9, user_id=7d99d9b7e6704cd780b2d54a831a64f4, role_id=702e5e78b5d744529384b96a390ae92f)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:24.615384 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d18c449-cd23-45f7-954b-549bcd19534e admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:24.726194 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1292/2595] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:52:24 2022] PUT /identity/v3/projects/9d7ac7a518134b6c88c39077e371ffa9/users/7d99d9b7e6704cd780b2d54a831a64f4/roles/702e5e78b5d744529384b96a390ae92f => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:52:24.730296 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa835e9-2676-417f-9310-9a9cc8647297 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:24.740526 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa835e9-2676-417f-9310-9a9cc8647297 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:24.795769 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2076fb8-574a-4f3d-913c-af7865684766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:24.796442 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2076fb8-574a-4f3d-913c-af7865684766 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:24.796724 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2076fb8-574a-4f3d-913c-af7865684766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:24.796998 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2076fb8-574a-4f3d-913c-af7865684766 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:24.797723 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2076fb8-574a-4f3d-913c-af7865684766 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:24.799375 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2076fb8-574a-4f3d-913c-af7865684766 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:24.809316 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1304/2596] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 16:52:24.816117 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d18c449-cd23-45f7-954b-549bcd19534e admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:24.827046 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d18c449-cd23-45f7-954b-549bcd19534e admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:24.832184 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97efdd-a6af-422d-a865-a29f317948db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:24.833074 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97efdd-a6af-422d-a865-a29f317948db admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:24.833355 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97efdd-a6af-422d-a865-a29f317948db admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:24.833630 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97efdd-a6af-422d-a865-a29f317948db admin admin] PATH_INFO: `/v3/projects/9d7ac7a518134b6c88c39077e371ffa9/users/7d99d9b7e6704cd780b2d54a831a64f4/roles/702e5e78b5d744529384b96a390ae92f` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:24.835772 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b97efdd-a6af-422d-a865-a29f317948db admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d7ac7a518134b6c88c39077e371ffa9, user_id=7d99d9b7e6704cd780b2d54a831a64f4, role_id=702e5e78b5d744529384b96a390ae92f)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:24.838582 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b97efdd-a6af-422d-a865-a29f317948db admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:24.850603 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1293/2597] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:52:24 2022] PUT /identity/v3/projects/9d7ac7a518134b6c88c39077e371ffa9/users/7d99d9b7e6704cd780b2d54a831a64f4/roles/702e5e78b5d744529384b96a390ae92f => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:52:26.436629 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b363b-192b-430d-a40c-8b73877b9e9b None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:26.437743 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b363b-192b-430d-a40c-8b73877b9e9b None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:26.437871 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b363b-192b-430d-a40c-8b73877b9e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:26.473318 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-a79b363b-192b-430d-a40c-8b73877b9e9b None None] MFA Rules not processed for user `7d99d9b7e6704cd780b2d54a831a64f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:52:26.473739 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a79b363b-192b-430d-a40c-8b73877b9e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:26.550562 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1305/2598] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:52:26 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:52:26.563871 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97efdd-a6af-422d-a865-a29f317948db admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:26.565837 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-1b97efdd-a6af-422d-a865-a29f317948db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:26.625402 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97efdd-a6af-422d-a865-a29f317948db admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:26.630252 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ae086d-36c2-40d8-b0b5-82611c85be35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '950b5b5f690d41509ead753065a0b793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:26.630990 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae086d-36c2-40d8-b0b5-82611c85be35 service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:26.631277 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae086d-36c2-40d8-b0b5-82611c85be35 service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:26.631615 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae086d-36c2-40d8-b0b5-82611c85be35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:26.696691 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ae086d-36c2-40d8-b0b5-82611c85be35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:26.698127 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ae086d-36c2-40d8-b0b5-82611c85be35 service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:26.707332 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1294/2599] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:52:26 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:52:29.563674 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79b363b-192b-430d-a40c-8b73877b9e9b None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:29.573363 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79b363b-192b-430d-a40c-8b73877b9e9b None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:29.577811 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a22c49-c5f1-49ba-aa59-954624b19992 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '950b5b5f690d41509ead753065a0b793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:29.579947 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a22c49-c5f1-49ba-aa59-954624b19992 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:29.579947 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a22c49-c5f1-49ba-aa59-954624b19992 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:29.579947 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a22c49-c5f1-49ba-aa59-954624b19992 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:29.589659 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a22c49-c5f1-49ba-aa59-954624b19992 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:29.591110 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a22c49-c5f1-49ba-aa59-954624b19992 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:29.604434 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1306/2600] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:52:29 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:52:47.258632 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ae086d-36c2-40d8-b0b5-82611c85be35 service cinder] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:47.321980 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ae086d-36c2-40d8-b0b5-82611c85be35 service cinder] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:47.326344 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b76cf8-7c1d-4bad-84ee-86419bfd0084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:47.327254 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b76cf8-7c1d-4bad-84ee-86419bfd0084 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:47.327692 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b76cf8-7c1d-4bad-84ee-86419bfd0084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:47.328089 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b76cf8-7c1d-4bad-84ee-86419bfd0084 admin admin] PATH_INFO: `/v3/users/249ffa59e27446aa9ed72a882f6eed47` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:47.329295 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b76cf8-7c1d-4bad-84ee-86419bfd0084 admin admin] RBAC: Authorizing `identity:delete_user(user_id=249ffa59e27446aa9ed72a882f6eed47)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:47.331184 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b76cf8-7c1d-4bad-84ee-86419bfd0084 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:47.541848 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-89b76cf8-7c1d-4bad-84ee-86419bfd0084 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '249ffa59e27446aa9ed72a882f6eed47'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:47.651847 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-89b76cf8-7c1d-4bad-84ee-86419bfd0084 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '249ffa59e27446aa9ed72a882f6eed47'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:47.660102 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-89b76cf8-7c1d-4bad-84ee-86419bfd0084 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '249ffa59e27446aa9ed72a882f6eed47'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:47.660737 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-89b76cf8-7c1d-4bad-84ee-86419bfd0084 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '249ffa59e27446aa9ed72a882f6eed47'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:47.672810 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-89b76cf8-7c1d-4bad-84ee-86419bfd0084 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '249ffa59e27446aa9ed72a882f6eed47'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:47.678763 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1295/2601] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:52:47 2022] DELETE /identity/v3/users/249ffa59e27446aa9ed72a882f6eed47 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:52:47.961774 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a22c49-c5f1-49ba-aa59-954624b19992 service cinder] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:47.974424 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a22c49-c5f1-49ba-aa59-954624b19992 service cinder] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:48.033259 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e1f924-7c42-4c55-9ff6-feed0b4aa081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:48.034146 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e1f924-7c42-4c55-9ff6-feed0b4aa081 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:48.034422 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e1f924-7c42-4c55-9ff6-feed0b4aa081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:48.034695 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e1f924-7c42-4c55-9ff6-feed0b4aa081 admin admin] PATH_INFO: `/v3/projects/1ef8ee4852e647178750688b27f452f3` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:48.036213 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e1f924-7c42-4c55-9ff6-feed0b4aa081 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ef8ee4852e647178750688b27f452f3)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:48.038095 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e1f924-7c42-4c55-9ff6-feed0b4aa081 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:48.191584 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-59e1f924-7c42-4c55-9ff6-feed0b4aa081 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ef8ee4852e647178750688b27f452f3', 'request_id': 'req-59e1f924-7c42-4c55-9ff6-feed0b4aa081'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:48.198169 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-59e1f924-7c42-4c55-9ff6-feed0b4aa081 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ef8ee4852e647178750688b27f452f3', 'request_id': 'req-59e1f924-7c42-4c55-9ff6-feed0b4aa081'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:48.286114 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-59e1f924-7c42-4c55-9ff6-feed0b4aa081 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ef8ee4852e647178750688b27f452f3', 'request_id': 'req-59e1f924-7c42-4c55-9ff6-feed0b4aa081'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:48.298763 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-59e1f924-7c42-4c55-9ff6-feed0b4aa081 admin admin] The token cache is being invalidate because project 1ef8ee4852e647178750688b27f452f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:52:48.300398 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-59e1f924-7c42-4c55-9ff6-feed0b4aa081 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:48.300398 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-59e1f924-7c42-4c55-9ff6-feed0b4aa081 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:48.301392 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1307/2602] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:52:47 2022] DELETE /identity/v3/projects/1ef8ee4852e647178750688b27f452f3 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:52:48.306559 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b76cf8-7c1d-4bad-84ee-86419bfd0084 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:48.308068 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-89b76cf8-7c1d-4bad-84ee-86419bfd0084 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:48.321789 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b76cf8-7c1d-4bad-84ee-86419bfd0084 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:48.379087 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d6bcf7-62ad-4a33-afb5-4c348e283358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:48.380000 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d6bcf7-62ad-4a33-afb5-4c348e283358 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:48.380286 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d6bcf7-62ad-4a33-afb5-4c348e283358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:48.380564 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d6bcf7-62ad-4a33-afb5-4c348e283358 admin admin] PATH_INFO: `/v3/users/7d99d9b7e6704cd780b2d54a831a64f4` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:48.381805 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d6bcf7-62ad-4a33-afb5-4c348e283358 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d99d9b7e6704cd780b2d54a831a64f4)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:48.383753 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d6bcf7-62ad-4a33-afb5-4c348e283358 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:48.557034 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b5d6bcf7-62ad-4a33-afb5-4c348e283358 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d99d9b7e6704cd780b2d54a831a64f4'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:48.652884 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b5d6bcf7-62ad-4a33-afb5-4c348e283358 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d99d9b7e6704cd780b2d54a831a64f4'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:48.661828 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b5d6bcf7-62ad-4a33-afb5-4c348e283358 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d99d9b7e6704cd780b2d54a831a64f4'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:48.662502 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b5d6bcf7-62ad-4a33-afb5-4c348e283358 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d99d9b7e6704cd780b2d54a831a64f4'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:48.675014 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b5d6bcf7-62ad-4a33-afb5-4c348e283358 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d99d9b7e6704cd780b2d54a831a64f4'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:48.681147 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1296/2603] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:52:48 2022] DELETE /identity/v3/users/7d99d9b7e6704cd780b2d54a831a64f4 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:52:48.980496 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e1f924-7c42-4c55-9ff6-feed0b4aa081 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:48.982260 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-59e1f924-7c42-4c55-9ff6-feed0b4aa081 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:48.996285 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e1f924-7c42-4c55-9ff6-feed0b4aa081 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:49.074115 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b21f355-442a-4d82-88e2-71e544415528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:49.075000 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21f355-442a-4d82-88e2-71e544415528 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:49.075286 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21f355-442a-4d82-88e2-71e544415528 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:49.075590 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21f355-442a-4d82-88e2-71e544415528 admin admin] PATH_INFO: `/v3/projects/9d7ac7a518134b6c88c39077e371ffa9` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:49.077402 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b21f355-442a-4d82-88e2-71e544415528 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d7ac7a518134b6c88c39077e371ffa9)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:49.079487 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b21f355-442a-4d82-88e2-71e544415528 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:49.188706 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-8b21f355-442a-4d82-88e2-71e544415528 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d7ac7a518134b6c88c39077e371ffa9', 'request_id': 'req-8b21f355-442a-4d82-88e2-71e544415528'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:49.194055 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-8b21f355-442a-4d82-88e2-71e544415528 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d7ac7a518134b6c88c39077e371ffa9', 'request_id': 'req-8b21f355-442a-4d82-88e2-71e544415528'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:49.292128 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-8b21f355-442a-4d82-88e2-71e544415528 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d7ac7a518134b6c88c39077e371ffa9', 'request_id': 'req-8b21f355-442a-4d82-88e2-71e544415528'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:49.305139 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-8b21f355-442a-4d82-88e2-71e544415528 admin admin] The token cache is being invalidate because project 9d7ac7a518134b6c88c39077e371ffa9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:52:49.305419 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-8b21f355-442a-4d82-88e2-71e544415528 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:49.306071 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-8b21f355-442a-4d82-88e2-71e544415528 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:49.307674 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1308/2604] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:52:48 2022] DELETE /identity/v3/projects/9d7ac7a518134b6c88c39077e371ffa9 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:52:49.313781 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a609fa2-96ad-403c-834e-387b0e99e7a4 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:49.314295 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a609fa2-96ad-403c-834e-387b0e99e7a4 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:49.314425 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a609fa2-96ad-403c-834e-387b0e99e7a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:49.332763 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-4a609fa2-96ad-403c-834e-387b0e99e7a4 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:52:49.334000 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-4a609fa2-96ad-403c-834e-387b0e99e7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:49.394617 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1297/2605] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:52:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:52:49.403471 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98807e86-9fd1-4cc0-9301-c29582711fc1 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:49.403792 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98807e86-9fd1-4cc0-9301-c29582711fc1 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:49.404067 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98807e86-9fd1-4cc0-9301-c29582711fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:49.423951 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-98807e86-9fd1-4cc0-9301-c29582711fc1 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:52:49.425160 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-98807e86-9fd1-4cc0-9301-c29582711fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:49.433142 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1309/2606] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:52:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:52:49.437789 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a609fa2-96ad-403c-834e-387b0e99e7a4 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:49.447670 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a609fa2-96ad-403c-834e-387b0e99e7a4 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:49.452405 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec35826-462b-4fc1-9c7c-4194a444eee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:49.453071 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec35826-462b-4fc1-9c7c-4194a444eee5 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:49.453351 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec35826-462b-4fc1-9c7c-4194a444eee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:49.453623 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec35826-462b-4fc1-9c7c-4194a444eee5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:49.454346 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec35826-462b-4fc1-9c7c-4194a444eee5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:52:49.454649 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec35826-462b-4fc1-9c7c-4194a444eee5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:49.456324 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec35826-462b-4fc1-9c7c-4194a444eee5 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:49.468830 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1298/2607] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Apr 11 16:52:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:52:49.473361 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98807e86-9fd1-4cc0-9301-c29582711fc1 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:49.483887 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98807e86-9fd1-4cc0-9301-c29582711fc1 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:49.494279 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e621229-7e37-40e7-88ee-34a709de5b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:49.494953 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e621229-7e37-40e7-88ee-34a709de5b1d admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:49.495237 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e621229-7e37-40e7-88ee-34a709de5b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:49.495592 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e621229-7e37-40e7-88ee-34a709de5b1d admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:49.496295 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e621229-7e37-40e7-88ee-34a709de5b1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:49.498372 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e621229-7e37-40e7-88ee-34a709de5b1d admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:49.618437 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1310/2608] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:52:49 2022] POST /identity/v3/projects => generated 361 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:52:49.622555 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec35826-462b-4fc1-9c7c-4194a444eee5 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:49.633080 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec35826-462b-4fc1-9c7c-4194a444eee5 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:49.691370 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243a5aa5-b688-4743-889c-195c62840142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:49.692088 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a5aa5-b688-4743-889c-195c62840142 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:49.692368 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a5aa5-b688-4743-889c-195c62840142 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:49.692641 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a5aa5-b688-4743-889c-195c62840142 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:49.693332 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243a5aa5-b688-4743-889c-195c62840142 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:49.695243 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243a5aa5-b688-4743-889c-195c62840142 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:49.800262 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1299/2609] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:52:49 2022] POST /identity/v3/users => generated 281 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:52:49.804532 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e621229-7e37-40e7-88ee-34a709de5b1d admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:49.814988 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e621229-7e37-40e7-88ee-34a709de5b1d admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:49.819773 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7984bb1-102b-42e6-bdd3-2ba55b37f473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:49.820439 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7984bb1-102b-42e6-bdd3-2ba55b37f473 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:49.820720 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7984bb1-102b-42e6-bdd3-2ba55b37f473 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:49.820995 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7984bb1-102b-42e6-bdd3-2ba55b37f473 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:49.821902 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7984bb1-102b-42e6-bdd3-2ba55b37f473 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:49.823502 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7984bb1-102b-42e6-bdd3-2ba55b37f473 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:49.835086 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1311/2610] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:52:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:52:49.839153 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243a5aa5-b688-4743-889c-195c62840142 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:49.850052 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243a5aa5-b688-4743-889c-195c62840142 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:49.854772 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fca3ccc-c030-4579-83e2-95926f9b3a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:49.855431 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca3ccc-c030-4579-83e2-95926f9b3a87 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:49.855740 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca3ccc-c030-4579-83e2-95926f9b3a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:49.856016 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca3ccc-c030-4579-83e2-95926f9b3a87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:49.856739 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fca3ccc-c030-4579-83e2-95926f9b3a87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:49.858386 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fca3ccc-c030-4579-83e2-95926f9b3a87 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:49.868663 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1300/2611] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:52:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:52:49.872897 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7984bb1-102b-42e6-bdd3-2ba55b37f473 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:49.882924 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7984bb1-102b-42e6-bdd3-2ba55b37f473 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:49.887650 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c54f376-9f0f-4d3b-8278-0910840147a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:49.888540 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c54f376-9f0f-4d3b-8278-0910840147a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:49.888952 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c54f376-9f0f-4d3b-8278-0910840147a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:49.889756 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c54f376-9f0f-4d3b-8278-0910840147a7 admin admin] PATH_INFO: `/v3/projects/8c87196c1595487abd9d29182c24e6c2/users/df54914668694e269f6d835959f9ff98/roles/0d41da7bec094450b5bff4e4831be52c` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:49.908548 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c54f376-9f0f-4d3b-8278-0910840147a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c87196c1595487abd9d29182c24e6c2, user_id=df54914668694e269f6d835959f9ff98, role_id=0d41da7bec094450b5bff4e4831be52c)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:49.911719 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c54f376-9f0f-4d3b-8278-0910840147a7 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:49.984795 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1312/2612] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:52:49 2022] PUT /identity/v3/projects/8c87196c1595487abd9d29182c24e6c2/users/df54914668694e269f6d835959f9ff98/roles/0d41da7bec094450b5bff4e4831be52c => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:52:49.995892 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccad616-a594-462d-8958-8a64332072a9 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:49.996229 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccad616-a594-462d-8958-8a64332072a9 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:49.996515 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccad616-a594-462d-8958-8a64332072a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:50.026724 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-1ccad616-a594-462d-8958-8a64332072a9 None None] MFA Rules not processed for user `df54914668694e269f6d835959f9ff98`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:52:50.027989 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-1ccad616-a594-462d-8958-8a64332072a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:50.101556 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1301/2613] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:52:49 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:52:50.134825 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c54f376-9f0f-4d3b-8278-0910840147a7 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:50.136490 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-3c54f376-9f0f-4d3b-8278-0910840147a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:50.223410 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c54f376-9f0f-4d3b-8278-0910840147a7 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:50.227828 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1237c283-244e-4d5d-a4f4-798e24081ce9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '950b5b5f690d41509ead753065a0b793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:50.228511 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1237c283-244e-4d5d-a4f4-798e24081ce9 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:50.228785 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1237c283-244e-4d5d-a4f4-798e24081ce9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:50.229221 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1237c283-244e-4d5d-a4f4-798e24081ce9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:50.241540 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1237c283-244e-4d5d-a4f4-798e24081ce9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:50.243102 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1237c283-244e-4d5d-a4f4-798e24081ce9 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:50.254669 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1313/2614] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:52:50 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:52:50.280898 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccad616-a594-462d-8958-8a64332072a9 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:50.357566 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccad616-a594-462d-8958-8a64332072a9 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:50.362454 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a24fb61-171e-4e76-9dc6-481c454a5d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:50.363340 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a24fb61-171e-4e76-9dc6-481c454a5d2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:50.363664 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a24fb61-171e-4e76-9dc6-481c454a5d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:50.363945 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a24fb61-171e-4e76-9dc6-481c454a5d2a admin admin] PATH_INFO: `/v3/users/df54914668694e269f6d835959f9ff98` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:50.365384 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a24fb61-171e-4e76-9dc6-481c454a5d2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=df54914668694e269f6d835959f9ff98)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:50.367314 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a24fb61-171e-4e76-9dc6-481c454a5d2a admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:50.631575 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-7a24fb61-171e-4e76-9dc6-481c454a5d2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df54914668694e269f6d835959f9ff98'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:50.747884 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-7a24fb61-171e-4e76-9dc6-481c454a5d2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df54914668694e269f6d835959f9ff98'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:50.757503 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-7a24fb61-171e-4e76-9dc6-481c454a5d2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df54914668694e269f6d835959f9ff98'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:50.758441 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-7a24fb61-171e-4e76-9dc6-481c454a5d2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df54914668694e269f6d835959f9ff98'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:50.774093 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-7a24fb61-171e-4e76-9dc6-481c454a5d2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df54914668694e269f6d835959f9ff98'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:50.781009 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1302/2615] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:52:50 2022] DELETE /identity/v3/users/df54914668694e269f6d835959f9ff98 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:52:50.786974 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cfd736-b476-4131-90d2-9024802dafe8 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:50.787248 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cfd736-b476-4131-90d2-9024802dafe8 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:50.787555 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cfd736-b476-4131-90d2-9024802dafe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:50.812432 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-16cfd736-b476-4131-90d2-9024802dafe8 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:52:50.814451 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-16cfd736-b476-4131-90d2-9024802dafe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:50.891187 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1314/2616] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:52:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:52:50.902073 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a24fb61-171e-4e76-9dc6-481c454a5d2a admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:50.903590 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-7a24fb61-171e-4e76-9dc6-481c454a5d2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:50.987337 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a24fb61-171e-4e76-9dc6-481c454a5d2a admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:50.988119 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede7183f-622f-4972-a31b-26f611ca7247 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:50.988810 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede7183f-622f-4972-a31b-26f611ca7247 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:50.989097 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede7183f-622f-4972-a31b-26f611ca7247 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:50.989376 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede7183f-622f-4972-a31b-26f611ca7247 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:50.999424 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede7183f-622f-4972-a31b-26f611ca7247 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:51.000863 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede7183f-622f-4972-a31b-26f611ca7247 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:51.010505 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1303/2617] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:52:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:52:51.490368 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cfd736-b476-4131-90d2-9024802dafe8 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:51.498836 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-16cfd736-b476-4131-90d2-9024802dafe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:51.505343 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cfd736-b476-4131-90d2-9024802dafe8 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:51.510512 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8c424e-eaf0-4a85-b785-468a9dd97705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:51.511366 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c424e-eaf0-4a85-b785-468a9dd97705 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:51.511649 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c424e-eaf0-4a85-b785-468a9dd97705 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:51.511931 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c424e-eaf0-4a85-b785-468a9dd97705 admin admin] PATH_INFO: `/v3/projects/8c87196c1595487abd9d29182c24e6c2` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:51.513236 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8c424e-eaf0-4a85-b785-468a9dd97705 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c87196c1595487abd9d29182c24e6c2)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:51.516563 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8c424e-eaf0-4a85-b785-468a9dd97705 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:51.670130 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-af8c424e-eaf0-4a85-b785-468a9dd97705 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c87196c1595487abd9d29182c24e6c2', 'request_id': 'req-af8c424e-eaf0-4a85-b785-468a9dd97705'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:51.676117 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-af8c424e-eaf0-4a85-b785-468a9dd97705 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c87196c1595487abd9d29182c24e6c2', 'request_id': 'req-af8c424e-eaf0-4a85-b785-468a9dd97705'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:51.766739 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-af8c424e-eaf0-4a85-b785-468a9dd97705 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c87196c1595487abd9d29182c24e6c2', 'request_id': 'req-af8c424e-eaf0-4a85-b785-468a9dd97705'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:51.778346 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-af8c424e-eaf0-4a85-b785-468a9dd97705 admin admin] The token cache is being invalidate because project 8c87196c1595487abd9d29182c24e6c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:52:51.778638 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-af8c424e-eaf0-4a85-b785-468a9dd97705 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:51.779319 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-af8c424e-eaf0-4a85-b785-468a9dd97705 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:51.781000 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1315/2618] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:52:51 2022] DELETE /identity/v3/projects/8c87196c1595487abd9d29182c24e6c2 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:52:51.786094 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca758a-d3eb-4810-81bc-b1c9e11d269b None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:51.786614 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca758a-d3eb-4810-81bc-b1c9e11d269b None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:51.786614 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca758a-d3eb-4810-81bc-b1c9e11d269b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:51.804428 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-fcca758a-d3eb-4810-81bc-b1c9e11d269b None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:52:51.808770 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-fcca758a-d3eb-4810-81bc-b1c9e11d269b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:51.865805 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1304/2619] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:52:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:52:51.874578 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1416987-a386-4764-9b45-2176eb1e129f None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:51.874955 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1416987-a386-4764-9b45-2176eb1e129f None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:51.875239 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1416987-a386-4764-9b45-2176eb1e129f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:51.894356 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-f1416987-a386-4764-9b45-2176eb1e129f None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:52:51.895630 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-f1416987-a386-4764-9b45-2176eb1e129f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:51.903843 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1316/2620] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:52:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:52:51.908426 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcca758a-d3eb-4810-81bc-b1c9e11d269b None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:51.918916 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcca758a-d3eb-4810-81bc-b1c9e11d269b None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:51.925124 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfadb02-e780-4005-b8d5-976a2279edf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:51.925845 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfadb02-e780-4005-b8d5-976a2279edf5 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:51.926092 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfadb02-e780-4005-b8d5-976a2279edf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:51.926365 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfadb02-e780-4005-b8d5-976a2279edf5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:51.927099 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfadb02-e780-4005-b8d5-976a2279edf5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:52:51.927408 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfadb02-e780-4005-b8d5-976a2279edf5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:51.929042 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfadb02-e780-4005-b8d5-976a2279edf5 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:51.942090 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1305/2621] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Apr 11 16:52:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:52:51.946566 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1416987-a386-4764-9b45-2176eb1e129f None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:51.957086 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1416987-a386-4764-9b45-2176eb1e129f None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:51.963087 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d933928-dd8d-47c4-86a0-93b451f4c229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:51.963783 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d933928-dd8d-47c4-86a0-93b451f4c229 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:51.964065 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d933928-dd8d-47c4-86a0-93b451f4c229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:51.964393 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d933928-dd8d-47c4-86a0-93b451f4c229 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:51.965132 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d933928-dd8d-47c4-86a0-93b451f4c229 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:51.967181 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d933928-dd8d-47c4-86a0-93b451f4c229 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:52.054437 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1317/2622] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:52:51 2022] POST /identity/v3/projects => generated 383 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:52:52.062754 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfadb02-e780-4005-b8d5-976a2279edf5 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:52.074378 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfadb02-e780-4005-b8d5-976a2279edf5 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:52.141028 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3a994a-8573-423d-a378-3185adc18a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:52.141747 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a994a-8573-423d-a378-3185adc18a59 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:52.142024 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a994a-8573-423d-a378-3185adc18a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:52.142311 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a994a-8573-423d-a378-3185adc18a59 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:52.143099 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3a994a-8573-423d-a378-3185adc18a59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:52.145096 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3a994a-8573-423d-a378-3185adc18a59 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:52.281469 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1306/2623] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:52:52 2022] POST /identity/v3/users => generated 292 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:52:52.286430 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d933928-dd8d-47c4-86a0-93b451f4c229 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:52.297172 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d933928-dd8d-47c4-86a0-93b451f4c229 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:52.301843 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acec856a-0c27-4120-bd39-c985147539a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:52.302499 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec856a-0c27-4120-bd39-c985147539a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:52.302807 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec856a-0c27-4120-bd39-c985147539a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:52.303057 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec856a-0c27-4120-bd39-c985147539a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:52.303827 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acec856a-0c27-4120-bd39-c985147539a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:52.305964 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acec856a-0c27-4120-bd39-c985147539a1 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:52.319678 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1318/2624] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:52:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:52:52.327364 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3a994a-8573-423d-a378-3185adc18a59 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:52.337896 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3a994a-8573-423d-a378-3185adc18a59 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:52.344594 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912aefb5-290b-445d-8bb0-2ed33f2dc600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:52.345710 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912aefb5-290b-445d-8bb0-2ed33f2dc600 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:52.346173 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912aefb5-290b-445d-8bb0-2ed33f2dc600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:52.346673 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912aefb5-290b-445d-8bb0-2ed33f2dc600 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:52.348007 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912aefb5-290b-445d-8bb0-2ed33f2dc600 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:52.350750 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912aefb5-290b-445d-8bb0-2ed33f2dc600 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:52.363958 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1307/2625] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:52:52 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 16:52:52.368714 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acec856a-0c27-4120-bd39-c985147539a1 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:52.381427 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acec856a-0c27-4120-bd39-c985147539a1 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:52.391317 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a12aa0e-66f4-4336-a235-efb7e23a7ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:52.392441 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12aa0e-66f4-4336-a235-efb7e23a7ede admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:52.392986 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12aa0e-66f4-4336-a235-efb7e23a7ede admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:52.393471 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12aa0e-66f4-4336-a235-efb7e23a7ede admin admin] PATH_INFO: `/v3/projects/69e5f7ec0c5d41f3806fcd8486da832b/users/2301e0f443af4614b91e3ff98da0c04f/roles/0d41da7bec094450b5bff4e4831be52c` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:52.418303 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a12aa0e-66f4-4336-a235-efb7e23a7ede admin admin] RBAC: Authorizing `identity:create_grant(project_id=69e5f7ec0c5d41f3806fcd8486da832b, user_id=2301e0f443af4614b91e3ff98da0c04f, role_id=0d41da7bec094450b5bff4e4831be52c)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:52.420390 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a12aa0e-66f4-4336-a235-efb7e23a7ede admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:52.533974 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1319/2626] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:52:52 2022] PUT /identity/v3/projects/69e5f7ec0c5d41f3806fcd8486da832b/users/2301e0f443af4614b91e3ff98da0c04f/roles/0d41da7bec094450b5bff4e4831be52c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:52:52.553630 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bebc50f-cc8b-4b1e-8f67-6242e696f38c None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:52.553921 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bebc50f-cc8b-4b1e-8f67-6242e696f38c None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:52.554391 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bebc50f-cc8b-4b1e-8f67-6242e696f38c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:52.584091 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-5bebc50f-cc8b-4b1e-8f67-6242e696f38c None None] MFA Rules not processed for user `2301e0f443af4614b91e3ff98da0c04f`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:52:52.585863 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-5bebc50f-cc8b-4b1e-8f67-6242e696f38c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:52.684129 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1308/2627] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:52:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:52:52.686493 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a12aa0e-66f4-4336-a235-efb7e23a7ede admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:52.766717 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a12aa0e-66f4-4336-a235-efb7e23a7ede admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:52.771664 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affdf603-fec8-434b-ac3f-01627a5c253b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:52.772343 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affdf603-fec8-434b-ac3f-01627a5c253b admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:52.772630 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affdf603-fec8-434b-ac3f-01627a5c253b admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:52.772910 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affdf603-fec8-434b-ac3f-01627a5c253b admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:52.773607 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affdf603-fec8-434b-ac3f-01627a5c253b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:52.775503 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affdf603-fec8-434b-ac3f-01627a5c253b admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:52.882038 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1320/2628] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:52:52 2022] POST /identity/v3/projects => generated 385 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:52:52.886863 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bebc50f-cc8b-4b1e-8f67-6242e696f38c None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:52.899879 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bebc50f-cc8b-4b1e-8f67-6242e696f38c None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:52.964684 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9d491d-b7eb-4eda-b3d5-e1eebde38d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:52.965366 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d491d-b7eb-4eda-b3d5-e1eebde38d91 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:52.965646 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d491d-b7eb-4eda-b3d5-e1eebde38d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:52.965921 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d491d-b7eb-4eda-b3d5-e1eebde38d91 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:52.966664 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9d491d-b7eb-4eda-b3d5-e1eebde38d91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:52.969477 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9d491d-b7eb-4eda-b3d5-e1eebde38d91 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:53.082971 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1309/2629] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:52:52 2022] POST /identity/v3/users => generated 293 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:52:53.087122 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affdf603-fec8-434b-ac3f-01627a5c253b admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:53.098696 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affdf603-fec8-434b-ac3f-01627a5c253b admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:53.103360 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2665f4c7-de22-49af-b1a7-a3ae05a35a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:53.104221 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2665f4c7-de22-49af-b1a7-a3ae05a35a2f admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:53.104380 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2665f4c7-de22-49af-b1a7-a3ae05a35a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:53.104642 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2665f4c7-de22-49af-b1a7-a3ae05a35a2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:53.105367 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2665f4c7-de22-49af-b1a7-a3ae05a35a2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:53.106964 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2665f4c7-de22-49af-b1a7-a3ae05a35a2f admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:53.121705 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1321/2630] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:52:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:52:53.128369 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9d491d-b7eb-4eda-b3d5-e1eebde38d91 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:53.141357 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9d491d-b7eb-4eda-b3d5-e1eebde38d91 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:53.144737 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3216db3-fcf5-4639-b0a1-fa2140ae26ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:53.145417 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3216db3-fcf5-4639-b0a1-fa2140ae26ea admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:53.145703 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3216db3-fcf5-4639-b0a1-fa2140ae26ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:53.145981 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3216db3-fcf5-4639-b0a1-fa2140ae26ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:53.146717 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3216db3-fcf5-4639-b0a1-fa2140ae26ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:53.148486 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3216db3-fcf5-4639-b0a1-fa2140ae26ea admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:53.159610 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1310/2631] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:52:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:52:53.164199 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2665f4c7-de22-49af-b1a7-a3ae05a35a2f admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:53.174620 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2665f4c7-de22-49af-b1a7-a3ae05a35a2f admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:53.179246 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5ae7ca-1683-4833-b9db-2ad8a54e5e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:53.180157 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ae7ca-1683-4833-b9db-2ad8a54e5e9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:53.180443 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ae7ca-1683-4833-b9db-2ad8a54e5e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:53.180721 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ae7ca-1683-4833-b9db-2ad8a54e5e9e admin admin] PATH_INFO: `/v3/projects/3c601a6410ee4a1eb77093caa42235a9/users/4f007a72592a48828173d77974cb28dd/roles/0d41da7bec094450b5bff4e4831be52c` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:53.195673 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5ae7ca-1683-4833-b9db-2ad8a54e5e9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c601a6410ee4a1eb77093caa42235a9, user_id=4f007a72592a48828173d77974cb28dd, role_id=0d41da7bec094450b5bff4e4831be52c)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:53.198329 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5ae7ca-1683-4833-b9db-2ad8a54e5e9e admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:53.332120 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1322/2632] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:52:53 2022] PUT /identity/v3/projects/3c601a6410ee4a1eb77093caa42235a9/users/4f007a72592a48828173d77974cb28dd/roles/0d41da7bec094450b5bff4e4831be52c => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:52:53.343448 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6f3912-a47e-4fd3-877c-277d5c58c216 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:53.343768 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6f3912-a47e-4fd3-877c-277d5c58c216 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:53.344046 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6f3912-a47e-4fd3-877c-277d5c58c216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:53.373015 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-2b6f3912-a47e-4fd3-877c-277d5c58c216 None None] MFA Rules not processed for user `4f007a72592a48828173d77974cb28dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:52:53.374958 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-2b6f3912-a47e-4fd3-877c-277d5c58c216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:53.451048 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1311/2633] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:52:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:52:53.457501 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5ae7ca-1683-4833-b9db-2ad8a54e5e9e admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:53.531833 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5ae7ca-1683-4833-b9db-2ad8a54e5e9e admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:53.536785 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17a9c54-d9f6-4fc0-8761-eb9198c3d1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:53.537437 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17a9c54-d9f6-4fc0-8761-eb9198c3d1c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:53.537724 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17a9c54-d9f6-4fc0-8761-eb9198c3d1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:53.538003 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17a9c54-d9f6-4fc0-8761-eb9198c3d1c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:53.538737 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17a9c54-d9f6-4fc0-8761-eb9198c3d1c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:53.540692 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17a9c54-d9f6-4fc0-8761-eb9198c3d1c7 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:53.679742 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1323/2634] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:52:53 2022] POST /identity/v3/projects => generated 383 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:52:53.689495 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6f3912-a47e-4fd3-877c-277d5c58c216 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:53.708915 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6f3912-a47e-4fd3-877c-277d5c58c216 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:53.772345 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ebdd32-0ab2-4cd0-ab8f-444f2ba4fc6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:53.773045 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ebdd32-0ab2-4cd0-ab8f-444f2ba4fc6a admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:53.773332 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ebdd32-0ab2-4cd0-ab8f-444f2ba4fc6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:53.773615 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ebdd32-0ab2-4cd0-ab8f-444f2ba4fc6a admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:53.774329 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ebdd32-0ab2-4cd0-ab8f-444f2ba4fc6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:53.776646 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ebdd32-0ab2-4cd0-ab8f-444f2ba4fc6a admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:53.853577 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1312/2635] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:52:53 2022] POST /identity/v3/users => generated 298 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:52:53.858290 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17a9c54-d9f6-4fc0-8761-eb9198c3d1c7 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:53.869362 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17a9c54-d9f6-4fc0-8761-eb9198c3d1c7 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:53.875227 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928de6ad-c25a-4fe1-a351-04b530ff424e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:53.876555 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928de6ad-c25a-4fe1-a351-04b530ff424e admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:53.876555 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928de6ad-c25a-4fe1-a351-04b530ff424e admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:53.876555 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928de6ad-c25a-4fe1-a351-04b530ff424e admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:53.877268 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928de6ad-c25a-4fe1-a351-04b530ff424e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:53.878949 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928de6ad-c25a-4fe1-a351-04b530ff424e admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:53.890697 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1324/2636] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:52:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:52:53.895508 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ebdd32-0ab2-4cd0-ab8f-444f2ba4fc6a admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:53.907837 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ebdd32-0ab2-4cd0-ab8f-444f2ba4fc6a admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:53.913598 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1008e79-da48-44c0-aa61-4f098e1556dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:53.914584 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1008e79-da48-44c0-aa61-4f098e1556dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:53.914880 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1008e79-da48-44c0-aa61-4f098e1556dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:53.915157 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1008e79-da48-44c0-aa61-4f098e1556dd admin admin] PATH_INFO: `/v3/projects/a27fe0aca80a41f08f8587cc7fa289b9/users/a5be9674040c439ab703798635db903a/roles/702e5e78b5d744529384b96a390ae92f` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:53.933600 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1008e79-da48-44c0-aa61-4f098e1556dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a27fe0aca80a41f08f8587cc7fa289b9, user_id=a5be9674040c439ab703798635db903a, role_id=702e5e78b5d744529384b96a390ae92f)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:53.936791 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1008e79-da48-44c0-aa61-4f098e1556dd admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:54.013363 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1313/2637] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:52:53 2022] PUT /identity/v3/projects/a27fe0aca80a41f08f8587cc7fa289b9/users/a5be9674040c439ab703798635db903a/roles/702e5e78b5d744529384b96a390ae92f => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:52:54.017612 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928de6ad-c25a-4fe1-a351-04b530ff424e admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:54.027896 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928de6ad-c25a-4fe1-a351-04b530ff424e admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:54.086633 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c2216-88b8-4555-95d1-96b303f85c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:54.087670 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c2216-88b8-4555-95d1-96b303f85c0c admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:54.087954 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c2216-88b8-4555-95d1-96b303f85c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:54.088237 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c2216-88b8-4555-95d1-96b303f85c0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:54.088969 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659c2216-88b8-4555-95d1-96b303f85c0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:54.090559 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659c2216-88b8-4555-95d1-96b303f85c0c admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:54.101171 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1325/2638] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:52:54 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:52:54.105572 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1008e79-da48-44c0-aa61-4f098e1556dd admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:54.116784 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1008e79-da48-44c0-aa61-4f098e1556dd admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:54.121549 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2f93df-c3db-413f-b704-5e624805d887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:54.122433 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f93df-c3db-413f-b704-5e624805d887 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:54.122714 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f93df-c3db-413f-b704-5e624805d887 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:54.122988 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f93df-c3db-413f-b704-5e624805d887 admin admin] PATH_INFO: `/v3/projects/a27fe0aca80a41f08f8587cc7fa289b9/users/a5be9674040c439ab703798635db903a/roles/702e5e78b5d744529384b96a390ae92f` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:54.125233 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2f93df-c3db-413f-b704-5e624805d887 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a27fe0aca80a41f08f8587cc7fa289b9, user_id=a5be9674040c439ab703798635db903a, role_id=702e5e78b5d744529384b96a390ae92f)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:54.128009 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2f93df-c3db-413f-b704-5e624805d887 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:54.139297 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1314/2639] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:52:54 2022] PUT /identity/v3/projects/a27fe0aca80a41f08f8587cc7fa289b9/users/a5be9674040c439ab703798635db903a/roles/702e5e78b5d744529384b96a390ae92f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:52:54.205724 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1746c65-5994-4ed2-9b04-fbc0216fb649 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:54.206012 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1746c65-5994-4ed2-9b04-fbc0216fb649 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:54.206294 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1746c65-5994-4ed2-9b04-fbc0216fb649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:54.234540 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-a1746c65-5994-4ed2-9b04-fbc0216fb649 None None] MFA Rules not processed for user `a5be9674040c439ab703798635db903a`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:52:54.235805 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a1746c65-5994-4ed2-9b04-fbc0216fb649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:54.305211 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1326/2640] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:52:54 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:52:54.316988 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2f93df-c3db-413f-b704-5e624805d887 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:54.318713 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-cc2f93df-c3db-413f-b704-5e624805d887 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:54.376966 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2f93df-c3db-413f-b704-5e624805d887 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:54.380631 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0756122e-060c-4303-925e-a8cfc10feb4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '950b5b5f690d41509ead753065a0b793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:54.381279 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0756122e-060c-4303-925e-a8cfc10feb4d service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:54.381565 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0756122e-060c-4303-925e-a8cfc10feb4d service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:54.381884 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0756122e-060c-4303-925e-a8cfc10feb4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:54.438220 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0756122e-060c-4303-925e-a8cfc10feb4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:54.439694 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0756122e-060c-4303-925e-a8cfc10feb4d service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:54.448693 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1315/2641] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:52:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:52:56.598248 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1746c65-5994-4ed2-9b04-fbc0216fb649 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:56.599792 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a1746c65-5994-4ed2-9b04-fbc0216fb649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:56.612507 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1746c65-5994-4ed2-9b04-fbc0216fb649 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:56.616230 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a0df81-7022-45b4-b035-9ecdb973b740 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '950b5b5f690d41509ead753065a0b793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:56.616898 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0df81-7022-45b4-b035-9ecdb973b740 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:56.617176 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0df81-7022-45b4-b035-9ecdb973b740 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:56.617459 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0df81-7022-45b4-b035-9ecdb973b740 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:56.675190 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a0df81-7022-45b4-b035-9ecdb973b740 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:56.676704 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a0df81-7022-45b4-b035-9ecdb973b740 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:56.687954 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1327/2642] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:52:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:52:58.379208 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0756122e-060c-4303-925e-a8cfc10feb4d service cinder] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:58.387816 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0756122e-060c-4303-925e-a8cfc10feb4d service cinder] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:58.392378 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd473be-f8b6-45c6-b257-17b0a2d9658d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '950b5b5f690d41509ead753065a0b793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:58.393026 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd473be-f8b6-45c6-b257-17b0a2d9658d service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:58.393308 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd473be-f8b6-45c6-b257-17b0a2d9658d service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:58.393585 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd473be-f8b6-45c6-b257-17b0a2d9658d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:58.402969 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd473be-f8b6-45c6-b257-17b0a2d9658d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:58.404428 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd473be-f8b6-45c6-b257-17b0a2d9658d service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:58.419486 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1316/2643] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:52:58 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:53:04.555984 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a0df81-7022-45b4-b035-9ecdb973b740 service cinder] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:53:04.618525 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a0df81-7022-45b4-b035-9ecdb973b740 service cinder] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:53:04.624578 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14fc8d8-6efe-4749-9b4d-1f9c6e937fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:53:04.625432 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14fc8d8-6efe-4749-9b4d-1f9c6e937fb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:53:04.625719 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14fc8d8-6efe-4749-9b4d-1f9c6e937fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:53:04.625998 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14fc8d8-6efe-4749-9b4d-1f9c6e937fb3 admin admin] PATH_INFO: `/v3/users/2301e0f443af4614b91e3ff98da0c04f` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:53:04.627180 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14fc8d8-6efe-4749-9b4d-1f9c6e937fb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2301e0f443af4614b91e3ff98da0c04f)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:53:04.629106 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14fc8d8-6efe-4749-9b4d-1f9c6e937fb3 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:53:04.854323 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c14fc8d8-6efe-4749-9b4d-1f9c6e937fb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2301e0f443af4614b91e3ff98da0c04f'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:53:04.854987 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c14fc8d8-6efe-4749-9b4d-1f9c6e937fb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2301e0f443af4614b91e3ff98da0c04f'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:53:04.943032 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c14fc8d8-6efe-4749-9b4d-1f9c6e937fb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2301e0f443af4614b91e3ff98da0c04f'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:53:04.950235 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c14fc8d8-6efe-4749-9b4d-1f9c6e937fb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2301e0f443af4614b91e3ff98da0c04f'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:53:04.961641 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c14fc8d8-6efe-4749-9b4d-1f9c6e937fb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2301e0f443af4614b91e3ff98da0c04f'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:53:04.967676 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1328/2644] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:53:04 2022] DELETE /identity/v3/users/2301e0f443af4614b91e3ff98da0c04f => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:53:04.972239 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fda59c-a183-466d-8c21-a6397fd363b8 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:53:04.972728 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fda59c-a183-466d-8c21-a6397fd363b8 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:53:04.972835 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fda59c-a183-466d-8c21-a6397fd363b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:53:04.990084 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-34fda59c-a183-466d-8c21-a6397fd363b8 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:53:04.991322 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-34fda59c-a183-466d-8c21-a6397fd363b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:53:05.051670 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1317/2645] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:53:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:53:05.062040 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14fc8d8-6efe-4749-9b4d-1f9c6e937fb3 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:53:05.063472 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-c14fc8d8-6efe-4749-9b4d-1f9c6e937fb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:53:05.118666 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14fc8d8-6efe-4749-9b4d-1f9c6e937fb3 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:53:05.122180 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62134d9-52e3-4dfa-8ea8-a701cccf7768 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:53:05.122832 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62134d9-52e3-4dfa-8ea8-a701cccf7768 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:53:05.123823 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62134d9-52e3-4dfa-8ea8-a701cccf7768 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:53:05.124110 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62134d9-52e3-4dfa-8ea8-a701cccf7768 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:53:05.133651 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62134d9-52e3-4dfa-8ea8-a701cccf7768 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:53:05.135065 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62134d9-52e3-4dfa-8ea8-a701cccf7768 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:53:05.144473 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1329/2646] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:53:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:53:05.716183 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fda59c-a183-466d-8c21-a6397fd363b8 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:53:05.718245 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-34fda59c-a183-466d-8c21-a6397fd363b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:53:05.734330 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fda59c-a183-466d-8c21-a6397fd363b8 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:53:05.737437 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5fd931-3de5-457b-8f3a-526d0f63ef56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:53:05.738430 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5fd931-3de5-457b-8f3a-526d0f63ef56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:53:05.738779 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5fd931-3de5-457b-8f3a-526d0f63ef56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:53:05.739193 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5fd931-3de5-457b-8f3a-526d0f63ef56 admin admin] PATH_INFO: `/v3/projects/69e5f7ec0c5d41f3806fcd8486da832b` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:53:05.740463 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5fd931-3de5-457b-8f3a-526d0f63ef56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69e5f7ec0c5d41f3806fcd8486da832b)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:53:05.742566 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5fd931-3de5-457b-8f3a-526d0f63ef56 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:53:05.908937 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-cd5fd931-3de5-457b-8f3a-526d0f63ef56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69e5f7ec0c5d41f3806fcd8486da832b', 'request_id': 'req-cd5fd931-3de5-457b-8f3a-526d0f63ef56'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:53:05.977267 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-cd5fd931-3de5-457b-8f3a-526d0f63ef56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69e5f7ec0c5d41f3806fcd8486da832b', 'request_id': 'req-cd5fd931-3de5-457b-8f3a-526d0f63ef56'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:53:05.983643 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-cd5fd931-3de5-457b-8f3a-526d0f63ef56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69e5f7ec0c5d41f3806fcd8486da832b', 'request_id': 'req-cd5fd931-3de5-457b-8f3a-526d0f63ef56'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:53:05.994731 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-cd5fd931-3de5-457b-8f3a-526d0f63ef56 admin admin] The token cache is being invalidate because project 69e5f7ec0c5d41f3806fcd8486da832b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:53:05.995047 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-cd5fd931-3de5-457b-8f3a-526d0f63ef56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:53:05.995706 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-cd5fd931-3de5-457b-8f3a-526d0f63ef56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:53:05.997528 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1318/2647] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:53:05 2022] DELETE /identity/v3/projects/69e5f7ec0c5d41f3806fcd8486da832b => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:53:06.001848 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62134d9-52e3-4dfa-8ea8-a701cccf7768 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:53:06.012274 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62134d9-52e3-4dfa-8ea8-a701cccf7768 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:53:06.068381 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f5907-a003-4760-9074-9aeae1322d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:53:06.070071 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f5907-a003-4760-9074-9aeae1322d6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:53:06.070366 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f5907-a003-4760-9074-9aeae1322d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:53:06.070645 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f5907-a003-4760-9074-9aeae1322d6d admin admin] PATH_INFO: `/v3/users/4f007a72592a48828173d77974cb28dd` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:53:06.071880 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435f5907-a003-4760-9074-9aeae1322d6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f007a72592a48828173d77974cb28dd)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:53:06.073778 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435f5907-a003-4760-9074-9aeae1322d6d admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:53:06.291944 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-435f5907-a003-4760-9074-9aeae1322d6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f007a72592a48828173d77974cb28dd'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:53:06.293223 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-435f5907-a003-4760-9074-9aeae1322d6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f007a72592a48828173d77974cb28dd'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:53:06.365700 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-435f5907-a003-4760-9074-9aeae1322d6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f007a72592a48828173d77974cb28dd'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:53:06.372914 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-435f5907-a003-4760-9074-9aeae1322d6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f007a72592a48828173d77974cb28dd'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:53:06.384865 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-435f5907-a003-4760-9074-9aeae1322d6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f007a72592a48828173d77974cb28dd'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:53:06.390614 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1330/2648] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:53:06 2022] DELETE /identity/v3/users/4f007a72592a48828173d77974cb28dd => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:53:06.820691 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5fd931-3de5-457b-8f3a-526d0f63ef56 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:53:06.824780 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-cd5fd931-3de5-457b-8f3a-526d0f63ef56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:53:06.840754 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5fd931-3de5-457b-8f3a-526d0f63ef56 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:53:06.909837 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e412501-5a60-4831-b053-6fa65f1f4722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:53:06.911024 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e412501-5a60-4831-b053-6fa65f1f4722 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:53:06.911146 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e412501-5a60-4831-b053-6fa65f1f4722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:53:06.911395 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e412501-5a60-4831-b053-6fa65f1f4722 admin admin] PATH_INFO: `/v3/projects/3c601a6410ee4a1eb77093caa42235a9` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:53:06.912618 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e412501-5a60-4831-b053-6fa65f1f4722 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c601a6410ee4a1eb77093caa42235a9)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:53:06.914607 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e412501-5a60-4831-b053-6fa65f1f4722 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:53:07.062594 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-4e412501-5a60-4831-b053-6fa65f1f4722 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c601a6410ee4a1eb77093caa42235a9', 'request_id': 'req-4e412501-5a60-4831-b053-6fa65f1f4722'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:53:07.131502 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-4e412501-5a60-4831-b053-6fa65f1f4722 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c601a6410ee4a1eb77093caa42235a9', 'request_id': 'req-4e412501-5a60-4831-b053-6fa65f1f4722'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:53:07.137477 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-4e412501-5a60-4831-b053-6fa65f1f4722 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c601a6410ee4a1eb77093caa42235a9', 'request_id': 'req-4e412501-5a60-4831-b053-6fa65f1f4722'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:53:07.149218 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-4e412501-5a60-4831-b053-6fa65f1f4722 admin admin] The token cache is being invalidate because project 3c601a6410ee4a1eb77093caa42235a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:53:07.149508 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-4e412501-5a60-4831-b053-6fa65f1f4722 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:53:07.150195 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-4e412501-5a60-4831-b053-6fa65f1f4722 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:53:07.151776 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1319/2649] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:53:06 2022] DELETE /identity/v3/projects/3c601a6410ee4a1eb77093caa42235a9 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:53:07.156699 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f5907-a003-4760-9074-9aeae1322d6d admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:53:07.158129 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-435f5907-a003-4760-9074-9aeae1322d6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:53:07.171135 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f5907-a003-4760-9074-9aeae1322d6d admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:53:07.226031 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a1197-bf8b-4ba5-a6f5-09ebdbad436e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:53:07.227042 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a1197-bf8b-4ba5-a6f5-09ebdbad436e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:53:07.227333 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a1197-bf8b-4ba5-a6f5-09ebdbad436e admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:53:07.227644 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a1197-bf8b-4ba5-a6f5-09ebdbad436e admin admin] PATH_INFO: `/v3/users/a5be9674040c439ab703798635db903a` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:53:07.228833 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01a1197-bf8b-4ba5-a6f5-09ebdbad436e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5be9674040c439ab703798635db903a)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:53:07.230759 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01a1197-bf8b-4ba5-a6f5-09ebdbad436e admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:53:07.482321 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c01a1197-bf8b-4ba5-a6f5-09ebdbad436e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5be9674040c439ab703798635db903a'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:53:07.482975 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c01a1197-bf8b-4ba5-a6f5-09ebdbad436e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5be9674040c439ab703798635db903a'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:53:07.629007 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c01a1197-bf8b-4ba5-a6f5-09ebdbad436e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5be9674040c439ab703798635db903a'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:53:07.636502 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c01a1197-bf8b-4ba5-a6f5-09ebdbad436e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5be9674040c439ab703798635db903a'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:53:07.649103 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c01a1197-bf8b-4ba5-a6f5-09ebdbad436e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5be9674040c439ab703798635db903a'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:53:07.654828 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1331/2650] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:53:07 2022] DELETE /identity/v3/users/a5be9674040c439ab703798635db903a => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:53:08.089398 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e412501-5a60-4831-b053-6fa65f1f4722 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:53:08.090925 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-4e412501-5a60-4831-b053-6fa65f1f4722 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:53:08.104357 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e412501-5a60-4831-b053-6fa65f1f4722 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:53:08.167071 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd500f-8d02-46a2-99b4-85311436192b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:53:08.168310 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd500f-8d02-46a2-99b4-85311436192b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:53:08.168662 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd500f-8d02-46a2-99b4-85311436192b admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:53:08.168783 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd500f-8d02-46a2-99b4-85311436192b admin admin] PATH_INFO: `/v3/projects/a27fe0aca80a41f08f8587cc7fa289b9` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:53:08.170003 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bd500f-8d02-46a2-99b4-85311436192b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a27fe0aca80a41f08f8587cc7fa289b9)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:53:08.173415 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bd500f-8d02-46a2-99b4-85311436192b admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:53:08.285570 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c0bd500f-8d02-46a2-99b4-85311436192b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a27fe0aca80a41f08f8587cc7fa289b9', 'request_id': 'req-c0bd500f-8d02-46a2-99b4-85311436192b'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:53:08.371326 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c0bd500f-8d02-46a2-99b4-85311436192b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a27fe0aca80a41f08f8587cc7fa289b9', 'request_id': 'req-c0bd500f-8d02-46a2-99b4-85311436192b'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:53:08.377252 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c0bd500f-8d02-46a2-99b4-85311436192b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a27fe0aca80a41f08f8587cc7fa289b9', 'request_id': 'req-c0bd500f-8d02-46a2-99b4-85311436192b'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:53:08.388067 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c0bd500f-8d02-46a2-99b4-85311436192b admin admin] The token cache is being invalidate because project a27fe0aca80a41f08f8587cc7fa289b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:53:08.388355 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c0bd500f-8d02-46a2-99b4-85311436192b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:53:08.388982 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c0bd500f-8d02-46a2-99b4-85311436192b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:53:08.390672 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1320/2651] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:53:08 2022] DELETE /identity/v3/projects/a27fe0aca80a41f08f8587cc7fa289b9 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:53:08.395704 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b0853-69ad-4d56-b7a9-8c004ea93093 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:53:08.396181 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b0853-69ad-4d56-b7a9-8c004ea93093 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:53:08.396304 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b0853-69ad-4d56-b7a9-8c004ea93093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:53:08.414406 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-fd7b0853-69ad-4d56-b7a9-8c004ea93093 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:53:08.415617 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-fd7b0853-69ad-4d56-b7a9-8c004ea93093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:53:08.475280 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1332/2652] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:53:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:53:08.483039 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c845d595-ce63-49bb-a15a-1f4bae5171f6 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:53:08.483409 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c845d595-ce63-49bb-a15a-1f4bae5171f6 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:53:08.483784 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c845d595-ce63-49bb-a15a-1f4bae5171f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:53:08.502849 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-c845d595-ce63-49bb-a15a-1f4bae5171f6 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:53:08.504205 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-c845d595-ce63-49bb-a15a-1f4bae5171f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:53:08.512389 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1321/2653] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:53:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:53:08.517349 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b0853-69ad-4d56-b7a9-8c004ea93093 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:53:08.527085 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b0853-69ad-4d56-b7a9-8c004ea93093 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:53:08.532481 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1055f8a-90fe-4b7f-84fd-f6435c4b7153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:53:08.533135 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1055f8a-90fe-4b7f-84fd-f6435c4b7153 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:53:08.533419 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1055f8a-90fe-4b7f-84fd-f6435c4b7153 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:53:08.533697 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1055f8a-90fe-4b7f-84fd-f6435c4b7153 admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:53:08.534420 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1055f8a-90fe-4b7f-84fd-f6435c4b7153 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:53:08.534728 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1055f8a-90fe-4b7f-84fd-f6435c4b7153 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:53:08.542745 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1055f8a-90fe-4b7f-84fd-f6435c4b7153 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:53:08.547847 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1333/2654] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Apr 11 16:53:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:53:08.552154 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c845d595-ce63-49bb-a15a-1f4bae5171f6 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:53:08.561222 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c845d595-ce63-49bb-a15a-1f4bae5171f6 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:53:08.566028 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c31bd8-9b55-4dd0-85a7-7805eeeed3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:53:08.566680 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c31bd8-9b55-4dd0-85a7-7805eeeed3d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:53:08.566964 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c31bd8-9b55-4dd0-85a7-7805eeeed3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:53:08.567239 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c31bd8-9b55-4dd0-85a7-7805eeeed3d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:53:08.567963 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c31bd8-9b55-4dd0-85a7-7805eeeed3d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:53:08.569863 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c31bd8-9b55-4dd0-85a7-7805eeeed3d4 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:53:08.675501 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1322/2655] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:53:08 2022] POST /identity/v3/projects => generated 365 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:53:08.679995 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1055f8a-90fe-4b7f-84fd-f6435c4b7153 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:53:08.690400 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1055f8a-90fe-4b7f-84fd-f6435c4b7153 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:53:08.745414 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568fe7f4-702a-4f48-af7b-92950445c4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:53:08.746078 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568fe7f4-702a-4f48-af7b-92950445c4e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:53:08.746362 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568fe7f4-702a-4f48-af7b-92950445c4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:53:08.746644 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568fe7f4-702a-4f48-af7b-92950445c4e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:53:08.747338 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568fe7f4-702a-4f48-af7b-92950445c4e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:53:08.749256 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568fe7f4-702a-4f48-af7b-92950445c4e4 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:53:08.863876 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1334/2656] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:53:08 2022] POST /identity/v3/users => generated 283 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:53:08.868078 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c31bd8-9b55-4dd0-85a7-7805eeeed3d4 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:53:08.878987 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c31bd8-9b55-4dd0-85a7-7805eeeed3d4 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:53:08.884208 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e09885-384a-4791-991d-c778447a6127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:53:08.884906 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e09885-384a-4791-991d-c778447a6127 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:53:08.885190 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e09885-384a-4791-991d-c778447a6127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:53:08.885476 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e09885-384a-4791-991d-c778447a6127 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:53:08.886225 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e09885-384a-4791-991d-c778447a6127 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:53:08.887849 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e09885-384a-4791-991d-c778447a6127 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:53:08.898849 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1323/2657] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:53:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:53:08.902887 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568fe7f4-702a-4f48-af7b-92950445c4e4 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:53:08.913393 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568fe7f4-702a-4f48-af7b-92950445c4e4 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:53:08.918239 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aa0e0f-34c3-4b96-a453-56579ba48ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:53:08.918918 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa0e0f-34c3-4b96-a453-56579ba48ce1 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:53:08.919255 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa0e0f-34c3-4b96-a453-56579ba48ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:53:08.919555 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa0e0f-34c3-4b96-a453-56579ba48ce1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:53:08.920327 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aa0e0f-34c3-4b96-a453-56579ba48ce1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:53:08.922143 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aa0e0f-34c3-4b96-a453-56579ba48ce1 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:53:08.932143 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1335/2658] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:53:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:53:08.936177 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e09885-384a-4791-991d-c778447a6127 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:53:08.946682 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e09885-384a-4791-991d-c778447a6127 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:53:08.951258 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fadbde5-fa2e-4470-9626-0663bcc4851f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:53:08.952163 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fadbde5-fa2e-4470-9626-0663bcc4851f admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:53:08.952447 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fadbde5-fa2e-4470-9626-0663bcc4851f admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:53:08.952721 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fadbde5-fa2e-4470-9626-0663bcc4851f admin admin] PATH_INFO: `/v3/projects/760dbefb73e6480993dfc2c698eb1ed3/users/9922aba5a0c643dfbed7b8d74e3d987b/roles/0d41da7bec094450b5bff4e4831be52c` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:53:08.967727 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fadbde5-fa2e-4470-9626-0663bcc4851f admin admin] RBAC: Authorizing `identity:create_grant(project_id=760dbefb73e6480993dfc2c698eb1ed3, user_id=9922aba5a0c643dfbed7b8d74e3d987b, role_id=0d41da7bec094450b5bff4e4831be52c)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:53:08.970430 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fadbde5-fa2e-4470-9626-0663bcc4851f admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:53:09.074970 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1324/2659] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:53:08 2022] PUT /identity/v3/projects/760dbefb73e6480993dfc2c698eb1ed3/users/9922aba5a0c643dfbed7b8d74e3d987b/roles/0d41da7bec094450b5bff4e4831be52c => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:53:09.086080 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9874fbb-5e04-47b0-8e8c-fb0afffecb84 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:53:09.086374 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9874fbb-5e04-47b0-8e8c-fb0afffecb84 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:53:09.086693 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9874fbb-5e04-47b0-8e8c-fb0afffecb84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:53:09.116386 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-f9874fbb-5e04-47b0-8e8c-fb0afffecb84 None None] MFA Rules not processed for user `9922aba5a0c643dfbed7b8d74e3d987b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:53:09.117517 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-f9874fbb-5e04-47b0-8e8c-fb0afffecb84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:53:09.180455 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1336/2660] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:53:09 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:53:09.193378 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fadbde5-fa2e-4470-9626-0663bcc4851f admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:53:09.195138 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-1fadbde5-fa2e-4470-9626-0663bcc4851f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:53:09.253748 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fadbde5-fa2e-4470-9626-0663bcc4851f admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:53:09.257765 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ffe3bc-d8b0-436f-80f6-c3704df1edd0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f7cf98d5394b28a475fd67e30fc9c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:53:09.258425 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ffe3bc-d8b0-436f-80f6-c3704df1edd0 service glance] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:53:09.258707 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ffe3bc-d8b0-436f-80f6-c3704df1edd0 service glance] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:53:09.258984 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ffe3bc-d8b0-436f-80f6-c3704df1edd0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:53:09.267822 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ffe3bc-d8b0-436f-80f6-c3704df1edd0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:53:09.269253 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ffe3bc-d8b0-436f-80f6-c3704df1edd0 service glance] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:53:09.278266 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1325/2661] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:53:09 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:53:17.662650 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a06a30d-afc7-42dc-8bca-8d80a262fe7a None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:53:17.663156 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a06a30d-afc7-42dc-8bca-8d80a262fe7a None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:53:17.663263 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a06a30d-afc7-42dc-8bca-8d80a262fe7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:53:17.682243 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-3a06a30d-afc7-42dc-8bca-8d80a262fe7a None None] MFA Rules not processed for user `3252c48fdd5747a29fe4ba89e7162216`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:53:17.683376 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-3a06a30d-afc7-42dc-8bca-8d80a262fe7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:53:17.738037 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1337/2662] 10.222.0.43 () {58 vars in 1009 bytes} [Mon Apr 11 16:53:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:53:17.884615 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ffe3bc-d8b0-436f-80f6-c3704df1edd0 service glance] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:53:17.886026 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-88ffe3bc-d8b0-436f-80f6-c3704df1edd0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:53:17.957043 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ffe3bc-d8b0-436f-80f6-c3704df1edd0 service glance] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:53:17.962154 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8cae54-7565-4fd2-a98e-7fdadc94c826 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb193a1a7abd430fbbcccab970e4f37c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:53:17.962799 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8cae54-7565-4fd2-a98e-7fdadc94c826 service swift] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:53:17.963080 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8cae54-7565-4fd2-a98e-7fdadc94c826 service swift] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:53:17.963356 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8cae54-7565-4fd2-a98e-7fdadc94c826 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:53:17.971399 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8cae54-7565-4fd2-a98e-7fdadc94c826 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:53:17.972991 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8cae54-7565-4fd2-a98e-7fdadc94c826 service swift] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:53:17.981535 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1326/2663] 10.222.0.43 () {60 vars in 1384 bytes} [Mon Apr 11 16:53:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 11 16:53:18.654861 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a06a30d-afc7-42dc-8bca-8d80a262fe7a None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:53:18.656403 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-3a06a30d-afc7-42dc-8bca-8d80a262fe7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:53:18.740216 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a06a30d-afc7-42dc-8bca-8d80a262fe7a None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:53:18.747578 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008faf6c-96a1-4ef1-921e-3914369d8fd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:53:18.748259 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008faf6c-96a1-4ef1-921e-3914369d8fd8 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:53:18.748540 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008faf6c-96a1-4ef1-921e-3914369d8fd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:53:18.748818 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008faf6c-96a1-4ef1-921e-3914369d8fd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:53:18.750678 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-008faf6c-96a1-4ef1-921e-3914369d8fd8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:53:18.868378 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008faf6c-96a1-4ef1-921e-3914369d8fd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:53:18.870387 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008faf6c-96a1-4ef1-921e-3914369d8fd8 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:53:18.885468 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1338/2664] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:53:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:53:20.188690 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8cae54-7565-4fd2-a98e-7fdadc94c826 service swift] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:53:20.190270 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-7d8cae54-7565-4fd2-a98e-7fdadc94c826 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:53:20.204822 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8cae54-7565-4fd2-a98e-7fdadc94c826 service swift] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:53:20.209653 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe15772-6f5d-4689-8071-951114c988dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:53:20.210332 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe15772-6f5d-4689-8071-951114c988dc service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:53:20.210621 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe15772-6f5d-4689-8071-951114c988dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:53:20.210904 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe15772-6f5d-4689-8071-951114c988dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:53:20.212807 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-dbe15772-6f5d-4689-8071-951114c988dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:53:20.228697 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe15772-6f5d-4689-8071-951114c988dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:53:20.230161 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe15772-6f5d-4689-8071-951114c988dc service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:53:20.259663 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1327/2665] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:53:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:53:28.571640 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008faf6c-96a1-4ef1-921e-3914369d8fd8 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:53:28.573143 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-008faf6c-96a1-4ef1-921e-3914369d8fd8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:53:28.591344 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008faf6c-96a1-4ef1-921e-3914369d8fd8 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:53:28.597724 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc9bb8-c180-4e52-bd3b-459dfb011fbc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1be2652c984a4283aeee0b937f0555e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:53:28.598414 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc9bb8-c180-4e52-bd3b-459dfb011fbc service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:53:28.598696 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc9bb8-c180-4e52-bd3b-459dfb011fbc service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:53:28.598974 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc9bb8-c180-4e52-bd3b-459dfb011fbc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:53:28.601438 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e9bc9bb8-c180-4e52-bd3b-459dfb011fbc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:53:28.687406 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bc9bb8-c180-4e52-bd3b-459dfb011fbc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:53:28.689176 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bc9bb8-c180-4e52-bd3b-459dfb011fbc service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:53:28.712411 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1339/2666] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:53:28 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:53:38.853730 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74beb895-7c43-4dac-8d6f-b924102ae03e None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:53:38.854847 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74beb895-7c43-4dac-8d6f-b924102ae03e None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:53:38.854847 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74beb895-7c43-4dac-8d6f-b924102ae03e None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:53:38.855595 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1328/2667] 10.222.0.43 () {54 vars in 921 bytes} [Mon Apr 11 16:53:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:53:38.863220 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70231269-49c1-4699-8f57-dad9fa27f008 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:53:38.863727 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70231269-49c1-4699-8f57-dad9fa27f008 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:53:38.884799 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70231269-49c1-4699-8f57-dad9fa27f008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:53:38.884799 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-70231269-49c1-4699-8f57-dad9fa27f008 None None] MFA Rules not processed for user `1be2652c984a4283aeee0b937f0555e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:53:38.884799 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-70231269-49c1-4699-8f57-dad9fa27f008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:53:38.893309 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1340/2668] 10.222.0.43 () {58 vars in 1018 bytes} [Mon Apr 11 16:53:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:53:38.904869 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74beb895-7c43-4dac-8d6f-b924102ae03e None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:53:38.906599 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-74beb895-7c43-4dac-8d6f-b924102ae03e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:53:38.920840 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74beb895-7c43-4dac-8d6f-b924102ae03e None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:53:38.924923 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0940b4-ab1b-4d62-85bb-c74bbefbcee2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f7cf98d5394b28a475fd67e30fc9c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:53:38.925563 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0940b4-ab1b-4d62-85bb-c74bbefbcee2 service glance] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:53:38.925849 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0940b4-ab1b-4d62-85bb-c74bbefbcee2 service glance] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:53:38.926129 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0940b4-ab1b-4d62-85bb-c74bbefbcee2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:53:38.936300 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0940b4-ab1b-4d62-85bb-c74bbefbcee2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:53:38.937707 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0940b4-ab1b-4d62-85bb-c74bbefbcee2 service glance] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:53:38.949032 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1329/2669] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:53:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:53:39.275482 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c25f23c-b336-49eb-8557-6f0008ca8ca5 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:53:39.275808 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c25f23c-b336-49eb-8557-6f0008ca8ca5 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:53:39.276092 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c25f23c-b336-49eb-8557-6f0008ca8ca5 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:53:39.277462 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1341/2670] 10.222.0.43 () {54 vars in 921 bytes} [Mon Apr 11 16:53:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:53:39.282522 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea792b-8068-4b91-a13d-a4993979e0ed None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:53:39.285556 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea792b-8068-4b91-a13d-a4993979e0ed None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:53:39.285556 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea792b-8068-4b91-a13d-a4993979e0ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:53:39.320339 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-82ea792b-8068-4b91-a13d-a4993979e0ed None None] MFA Rules not processed for user `f8c213711e794a1ba47ecf46ecb57769`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:53:39.321558 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-82ea792b-8068-4b91-a13d-a4993979e0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:53:39.328360 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1330/2671] 10.222.0.43 () {58 vars in 1018 bytes} [Mon Apr 11 16:53:39 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:53:39.340023 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c25f23c-b336-49eb-8557-6f0008ca8ca5 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:53:39.353009 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c25f23c-b336-49eb-8557-6f0008ca8ca5 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:53:39.360768 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dc62c5-ea5a-4e6c-8f13-9172bcf69174 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:53:39.362277 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc62c5-ea5a-4e6c-8f13-9172bcf69174 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:53:39.362575 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc62c5-ea5a-4e6c-8f13-9172bcf69174 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:53:39.362838 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc62c5-ea5a-4e6c-8f13-9172bcf69174 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:53:39.370555 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dc62c5-ea5a-4e6c-8f13-9172bcf69174 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:53:39.372025 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dc62c5-ea5a-4e6c-8f13-9172bcf69174 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:53:39.380365 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1342/2672] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:53:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:53:39.462787 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc002d3-25b5-4dd7-81d9-5be13e43b091 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:53:39.463093 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc002d3-25b5-4dd7-81d9-5be13e43b091 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:53:39.463432 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc002d3-25b5-4dd7-81d9-5be13e43b091 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:53:39.464926 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1331/2673] 10.222.0.43 () {54 vars in 921 bytes} [Mon Apr 11 16:53:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:53:39.471128 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b1cdf-3e7d-4ef5-88cc-c3f4146fd7dc None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:53:39.471531 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b1cdf-3e7d-4ef5-88cc-c3f4146fd7dc None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:53:39.471909 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b1cdf-3e7d-4ef5-88cc-c3f4146fd7dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:53:39.490910 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-c72b1cdf-3e7d-4ef5-88cc-c3f4146fd7dc None None] MFA Rules not processed for user `1be2652c984a4283aeee0b937f0555e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:53:39.492066 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-c72b1cdf-3e7d-4ef5-88cc-c3f4146fd7dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:53:39.502919 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1343/2674] 10.222.0.43 () {58 vars in 1018 bytes} [Mon Apr 11 16:53:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:53:39.513781 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc002d3-25b5-4dd7-81d9-5be13e43b091 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:53:39.525527 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc002d3-25b5-4dd7-81d9-5be13e43b091 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:53:39.529246 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db62f103-f157-4f67-aaa7-556adeeb02aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:53:39.529887 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62f103-f157-4f67-aaa7-556adeeb02aa service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:53:39.530175 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62f103-f157-4f67-aaa7-556adeeb02aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:53:39.530448 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62f103-f157-4f67-aaa7-556adeeb02aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:53:39.541111 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db62f103-f157-4f67-aaa7-556adeeb02aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:53:39.542793 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db62f103-f157-4f67-aaa7-556adeeb02aa service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:53:39.553837 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1332/2675] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:53:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:53:39.618851 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72b1cdf-3e7d-4ef5-88cc-c3f4146fd7dc None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:53:39.620446 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-c72b1cdf-3e7d-4ef5-88cc-c3f4146fd7dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:53:39.688975 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72b1cdf-3e7d-4ef5-88cc-c3f4146fd7dc None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:53:39.694848 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf7d381-8e2e-40a1-b4a4-1096dd11cef9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6589debd41bf496085c7339ab5409666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:53:39.695577 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7d381-8e2e-40a1-b4a4-1096dd11cef9 service placement] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:53:39.695868 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7d381-8e2e-40a1-b4a4-1096dd11cef9 service placement] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:53:39.696154 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7d381-8e2e-40a1-b4a4-1096dd11cef9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:53:39.697947 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-4bf7d381-8e2e-40a1-b4a4-1096dd11cef9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:53:39.709506 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf7d381-8e2e-40a1-b4a4-1096dd11cef9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:53:39.711073 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf7d381-8e2e-40a1-b4a4-1096dd11cef9 service placement] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:53:39.721456 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1344/2676] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:53:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:53:41.266331 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db62f103-f157-4f67-aaa7-556adeeb02aa service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:53:41.275667 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db62f103-f157-4f67-aaa7-556adeeb02aa service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:53:41.279425 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaae8b9-7a88-487b-9bdb-5946071a206b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:53:41.280089 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaae8b9-7a88-487b-9bdb-5946071a206b service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:53:41.280377 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaae8b9-7a88-487b-9bdb-5946071a206b service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:53:41.280660 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaae8b9-7a88-487b-9bdb-5946071a206b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:53:41.282457 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-cfaae8b9-7a88-487b-9bdb-5946071a206b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:53:41.293068 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaae8b9-7a88-487b-9bdb-5946071a206b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:53:41.294516 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaae8b9-7a88-487b-9bdb-5946071a206b service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:53:41.303249 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1333/2677] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:53:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:53:42.178689 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83fd83b-cbbc-4653-a90a-51df1fdafb0c None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:53:42.179226 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83fd83b-cbbc-4653-a90a-51df1fdafb0c None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:53:42.179226 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83fd83b-cbbc-4653-a90a-51df1fdafb0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:53:42.197210 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-f83fd83b-cbbc-4653-a90a-51df1fdafb0c None None] MFA Rules not processed for user `3252c48fdd5747a29fe4ba89e7162216`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:53:42.198405 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-f83fd83b-cbbc-4653-a90a-51df1fdafb0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:53:42.205579 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1345/2678] 10.222.0.43 () {58 vars in 1009 bytes} [Mon Apr 11 16:53:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:53:42.218363 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaae8b9-7a88-487b-9bdb-5946071a206b service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:53:42.231283 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaae8b9-7a88-487b-9bdb-5946071a206b service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:53:42.237337 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bde4e7-4140-4994-a3b7-54477cac1a3c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb193a1a7abd430fbbcccab970e4f37c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:53:42.238012 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bde4e7-4140-4994-a3b7-54477cac1a3c service swift] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:53:42.238294 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bde4e7-4140-4994-a3b7-54477cac1a3c service swift] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:53:42.238576 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bde4e7-4140-4994-a3b7-54477cac1a3c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:53:42.246655 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bde4e7-4140-4994-a3b7-54477cac1a3c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:53:42.248258 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bde4e7-4140-4994-a3b7-54477cac1a3c service swift] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:53:42.259413 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1334/2679] 10.222.0.43 () {60 vars in 1384 bytes} [Mon Apr 11 16:53:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 11 16:54:02.744194 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83fd83b-cbbc-4653-a90a-51df1fdafb0c None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:54:02.810239 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83fd83b-cbbc-4653-a90a-51df1fdafb0c None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:54:02.814696 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0583c332-63d5-461c-8158-a02abeadefb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:54:02.815584 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0583c332-63d5-461c-8158-a02abeadefb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:02.815938 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0583c332-63d5-461c-8158-a02abeadefb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:02.816211 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0583c332-63d5-461c-8158-a02abeadefb5 admin admin] PATH_INFO: `/v3/users/9922aba5a0c643dfbed7b8d74e3d987b` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:02.817385 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0583c332-63d5-461c-8158-a02abeadefb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9922aba5a0c643dfbed7b8d74e3d987b)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:54:02.820249 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0583c332-63d5-461c-8158-a02abeadefb5 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:54:03.028509 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0583c332-63d5-461c-8158-a02abeadefb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9922aba5a0c643dfbed7b8d74e3d987b'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:54:03.029128 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0583c332-63d5-461c-8158-a02abeadefb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9922aba5a0c643dfbed7b8d74e3d987b'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:54:03.114290 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0583c332-63d5-461c-8158-a02abeadefb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9922aba5a0c643dfbed7b8d74e3d987b'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:54:03.123022 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0583c332-63d5-461c-8158-a02abeadefb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9922aba5a0c643dfbed7b8d74e3d987b'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:54:03.134575 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0583c332-63d5-461c-8158-a02abeadefb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9922aba5a0c643dfbed7b8d74e3d987b'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:54:03.140547 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1346/2680] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:54:02 2022] DELETE /identity/v3/users/9922aba5a0c643dfbed7b8d74e3d987b => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:54:03.145045 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919e85a7-14d5-46b0-9397-d50e173f3768 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:03.145570 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919e85a7-14d5-46b0-9397-d50e173f3768 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:03.145679 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919e85a7-14d5-46b0-9397-d50e173f3768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:03.164414 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-919e85a7-14d5-46b0-9397-d50e173f3768 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:54:03.165649 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-919e85a7-14d5-46b0-9397-d50e173f3768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:54:03.225329 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1335/2681] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:54:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:54:03.235163 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0583c332-63d5-461c-8158-a02abeadefb5 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:54:03.236585 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0583c332-63d5-461c-8158-a02abeadefb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:54:03.291006 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0583c332-63d5-461c-8158-a02abeadefb5 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:54:03.294777 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7111b3-7f65-4bf3-abc5-601dfaeb82f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:54:03.295418 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7111b3-7f65-4bf3-abc5-601dfaeb82f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:03.295736 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7111b3-7f65-4bf3-abc5-601dfaeb82f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:03.296015 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7111b3-7f65-4bf3-abc5-601dfaeb82f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:03.305726 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7111b3-7f65-4bf3-abc5-601dfaeb82f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:54:03.307137 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7111b3-7f65-4bf3-abc5-601dfaeb82f1 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:54:03.317521 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1347/2682] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:54:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:54:03.775763 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060dd220-3800-4015-863e-3ace90f916f2 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:03.778017 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060dd220-3800-4015-863e-3ace90f916f2 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:03.778017 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060dd220-3800-4015-863e-3ace90f916f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:03.793728 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-060dd220-3800-4015-863e-3ace90f916f2 None None] MFA Rules not processed for user `3252c48fdd5747a29fe4ba89e7162216`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:54:03.794950 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-060dd220-3800-4015-863e-3ace90f916f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:54:03.812511 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7111b3-7f65-4bf3-abc5-601dfaeb82f1 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:54:03.822935 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-2e7111b3-7f65-4bf3-abc5-601dfaeb82f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:54:03.837810 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7111b3-7f65-4bf3-abc5-601dfaeb82f1 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:54:03.844360 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44fea10-d350-44bf-aef5-be2a93c8d342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:54:03.845238 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44fea10-d350-44bf-aef5-be2a93c8d342 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:03.845716 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44fea10-d350-44bf-aef5-be2a93c8d342 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:03.846114 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44fea10-d350-44bf-aef5-be2a93c8d342 admin admin] PATH_INFO: `/v3/projects/760dbefb73e6480993dfc2c698eb1ed3` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:03.847375 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44fea10-d350-44bf-aef5-be2a93c8d342 admin admin] RBAC: Authorizing `identity:delete_project(project_id=760dbefb73e6480993dfc2c698eb1ed3)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:54:03.849339 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44fea10-d350-44bf-aef5-be2a93c8d342 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:54:03.859838 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1336/2683] 10.222.0.43 () {58 vars in 967 bytes} [Mon Apr 11 16:54:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:54:03.873697 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060dd220-3800-4015-863e-3ace90f916f2 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:54:03.875095 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-060dd220-3800-4015-863e-3ace90f916f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:54:03.944963 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060dd220-3800-4015-863e-3ace90f916f2 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:54:03.950156 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207359a6-5252-40c6-86b4-fdaa2129f16a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb193a1a7abd430fbbcccab970e4f37c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:54:03.950879 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207359a6-5252-40c6-86b4-fdaa2129f16a service swift] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:03.951169 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207359a6-5252-40c6-86b4-fdaa2129f16a service swift] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:03.951447 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207359a6-5252-40c6-86b4-fdaa2129f16a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:03.959770 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207359a6-5252-40c6-86b4-fdaa2129f16a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:54:03.961642 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207359a6-5252-40c6-86b4-fdaa2129f16a service swift] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:54:03.969677 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1337/2684] 10.222.0.43 () {60 vars in 1384 bytes} [Mon Apr 11 16:54:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 11 16:54:04.005516 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f44fea10-d350-44bf-aef5-be2a93c8d342 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '760dbefb73e6480993dfc2c698eb1ed3', 'request_id': 'req-f44fea10-d350-44bf-aef5-be2a93c8d342'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:54:04.011064 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f44fea10-d350-44bf-aef5-be2a93c8d342 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '760dbefb73e6480993dfc2c698eb1ed3', 'request_id': 'req-f44fea10-d350-44bf-aef5-be2a93c8d342'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:54:04.080044 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f44fea10-d350-44bf-aef5-be2a93c8d342 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '760dbefb73e6480993dfc2c698eb1ed3', 'request_id': 'req-f44fea10-d350-44bf-aef5-be2a93c8d342'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:54:04.091767 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f44fea10-d350-44bf-aef5-be2a93c8d342 admin admin] The token cache is being invalidate because project 760dbefb73e6480993dfc2c698eb1ed3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:54:04.092062 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f44fea10-d350-44bf-aef5-be2a93c8d342 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:54:04.092708 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f44fea10-d350-44bf-aef5-be2a93c8d342 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:54:04.094304 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1348/2685] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:54:03 2022] DELETE /identity/v3/projects/760dbefb73e6480993dfc2c698eb1ed3 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:54:04.099493 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5aabb-da91-4406-b230-6c5042c81dcf None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:04.099823 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5aabb-da91-4406-b230-6c5042c81dcf None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:04.100104 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5aabb-da91-4406-b230-6c5042c81dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:04.119529 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-b5c5aabb-da91-4406-b230-6c5042c81dcf None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:54:04.120772 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-b5c5aabb-da91-4406-b230-6c5042c81dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:54:04.180711 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1338/2686] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:54:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:54:04.188565 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb4d5c-170f-4c23-8608-88e388b0ad0e None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:04.188856 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb4d5c-170f-4c23-8608-88e388b0ad0e None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:04.189135 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb4d5c-170f-4c23-8608-88e388b0ad0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:04.207621 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-e9bb4d5c-170f-4c23-8608-88e388b0ad0e None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:54:04.208821 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e9bb4d5c-170f-4c23-8608-88e388b0ad0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:54:04.217444 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1349/2687] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:54:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:54:04.221509 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c5aabb-da91-4406-b230-6c5042c81dcf None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:54:04.231954 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c5aabb-da91-4406-b230-6c5042c81dcf None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:54:04.236582 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9e6e14-fe1b-4977-ae67-ad2868b29758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:54:04.237242 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e6e14-fe1b-4977-ae67-ad2868b29758 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:04.237529 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e6e14-fe1b-4977-ae67-ad2868b29758 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:04.237802 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e6e14-fe1b-4977-ae67-ad2868b29758 admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:04.238529 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9e6e14-fe1b-4977-ae67-ad2868b29758 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:54:04.238831 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9e6e14-fe1b-4977-ae67-ad2868b29758 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:54:04.240436 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9e6e14-fe1b-4977-ae67-ad2868b29758 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:54:04.252727 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1339/2688] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Apr 11 16:54:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:54:04.257321 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bb4d5c-170f-4c23-8608-88e388b0ad0e None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:54:04.267216 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bb4d5c-170f-4c23-8608-88e388b0ad0e None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:54:04.271967 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edfe9fb-2df2-403a-8291-36d22cec1117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:54:04.273136 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edfe9fb-2df2-403a-8291-36d22cec1117 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:04.273422 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edfe9fb-2df2-403a-8291-36d22cec1117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:04.273723 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edfe9fb-2df2-403a-8291-36d22cec1117 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:04.274402 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edfe9fb-2df2-403a-8291-36d22cec1117 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:54:04.276409 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edfe9fb-2df2-403a-8291-36d22cec1117 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:54:04.390101 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1350/2689] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:54:04 2022] POST /identity/v3/projects => generated 385 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:54:04.398348 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9e6e14-fe1b-4977-ae67-ad2868b29758 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:54:04.404886 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9e6e14-fe1b-4977-ae67-ad2868b29758 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:54:04.458310 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c6cfbc-cad3-4f87-99c8-b0032860f788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:54:04.458969 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c6cfbc-cad3-4f87-99c8-b0032860f788 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:04.459251 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c6cfbc-cad3-4f87-99c8-b0032860f788 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:04.459550 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c6cfbc-cad3-4f87-99c8-b0032860f788 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:04.460784 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c6cfbc-cad3-4f87-99c8-b0032860f788 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:54:04.462673 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c6cfbc-cad3-4f87-99c8-b0032860f788 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:54:04.548960 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1340/2690] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:54:04 2022] POST /identity/v3/users => generated 293 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:54:04.553096 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edfe9fb-2df2-403a-8291-36d22cec1117 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:54:04.563552 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edfe9fb-2df2-403a-8291-36d22cec1117 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:54:04.568268 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61426f42-73ac-448f-836f-a34a0f61db99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:54:04.568915 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61426f42-73ac-448f-836f-a34a0f61db99 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:04.569196 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61426f42-73ac-448f-836f-a34a0f61db99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:04.570106 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61426f42-73ac-448f-836f-a34a0f61db99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:04.570935 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61426f42-73ac-448f-836f-a34a0f61db99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:54:04.572668 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61426f42-73ac-448f-836f-a34a0f61db99 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:54:04.583474 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1351/2691] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:54:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:54:04.588088 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c6cfbc-cad3-4f87-99c8-b0032860f788 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:54:04.598742 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c6cfbc-cad3-4f87-99c8-b0032860f788 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:54:04.603790 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce77085-049c-4896-9ed9-df86211a55f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:54:04.604460 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce77085-049c-4896-9ed9-df86211a55f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:04.604747 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce77085-049c-4896-9ed9-df86211a55f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:04.605027 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce77085-049c-4896-9ed9-df86211a55f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:04.605791 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce77085-049c-4896-9ed9-df86211a55f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:54:04.607413 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce77085-049c-4896-9ed9-df86211a55f7 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:54:04.617606 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1341/2692] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:54:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 16:54:04.622061 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61426f42-73ac-448f-836f-a34a0f61db99 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:54:04.632871 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61426f42-73ac-448f-836f-a34a0f61db99 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:54:04.637548 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885067cc-ffde-406e-8ec6-1aa3aaa50afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:54:04.638503 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885067cc-ffde-406e-8ec6-1aa3aaa50afd admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:04.638787 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885067cc-ffde-406e-8ec6-1aa3aaa50afd admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:04.639067 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885067cc-ffde-406e-8ec6-1aa3aaa50afd admin admin] PATH_INFO: `/v3/projects/dda959d146164e97855de4f0d05a0516/users/85b65e4e233c4b308e128c8e246d58dc/roles/0d41da7bec094450b5bff4e4831be52c` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:04.654323 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885067cc-ffde-406e-8ec6-1aa3aaa50afd admin admin] RBAC: Authorizing `identity:create_grant(project_id=dda959d146164e97855de4f0d05a0516, user_id=85b65e4e233c4b308e128c8e246d58dc, role_id=0d41da7bec094450b5bff4e4831be52c)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:54:04.657057 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885067cc-ffde-406e-8ec6-1aa3aaa50afd admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:54:04.777957 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1352/2693] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:54:04 2022] PUT /identity/v3/projects/dda959d146164e97855de4f0d05a0516/users/85b65e4e233c4b308e128c8e246d58dc/roles/0d41da7bec094450b5bff4e4831be52c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:54:04.783167 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beecad0-5c3e-4e82-8b3a-17380da8d0aa None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:04.783465 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beecad0-5c3e-4e82-8b3a-17380da8d0aa None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:04.783783 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beecad0-5c3e-4e82-8b3a-17380da8d0aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:04.801952 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-9beecad0-5c3e-4e82-8b3a-17380da8d0aa None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:54:04.803178 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-9beecad0-5c3e-4e82-8b3a-17380da8d0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:54:04.862584 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1342/2694] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:54:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:54:04.873245 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885067cc-ffde-406e-8ec6-1aa3aaa50afd admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:54:04.875018 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-885067cc-ffde-406e-8ec6-1aa3aaa50afd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:54:04.933280 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885067cc-ffde-406e-8ec6-1aa3aaa50afd admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:54:04.937216 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e577f6-8231-49b1-965f-08865f831f7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:54:04.937863 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e577f6-8231-49b1-965f-08865f831f7b service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:04.938147 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e577f6-8231-49b1-965f-08865f831f7b service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:04.938423 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e577f6-8231-49b1-965f-08865f831f7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:04.948047 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e577f6-8231-49b1-965f-08865f831f7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:54:04.949508 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e577f6-8231-49b1-965f-08865f831f7b service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:54:04.959480 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1353/2695] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:54:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 16:54:10.581623 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c06c2f9-9e04-4fa0-8b44-2c89c62bec76 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:10.582141 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c06c2f9-9e04-4fa0-8b44-2c89c62bec76 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:10.582602 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c06c2f9-9e04-4fa0-8b44-2c89c62bec76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:10.611598 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-3c06c2f9-9e04-4fa0-8b44-2c89c62bec76 None None] MFA Rules not processed for user `85b65e4e233c4b308e128c8e246d58dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:54:10.612893 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-3c06c2f9-9e04-4fa0-8b44-2c89c62bec76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:54:10.681965 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1343/2696] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:54:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:54:10.686661 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e577f6-8231-49b1-965f-08865f831f7b service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:54:10.696542 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e577f6-8231-49b1-965f-08865f831f7b service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:54:10.701394 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc98abc-6cc1-4feb-a3b1-382af1a25da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:54:10.702060 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc98abc-6cc1-4feb-a3b1-382af1a25da9 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:10.702345 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc98abc-6cc1-4feb-a3b1-382af1a25da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:10.702626 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc98abc-6cc1-4feb-a3b1-382af1a25da9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:10.703329 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc98abc-6cc1-4feb-a3b1-382af1a25da9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:54:10.705828 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc98abc-6cc1-4feb-a3b1-382af1a25da9 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:54:10.811862 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1354/2697] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:54:10 2022] POST /identity/v3/projects => generated 381 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:54:10.813152 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c06c2f9-9e04-4fa0-8b44-2c89c62bec76 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:54:10.824929 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c06c2f9-9e04-4fa0-8b44-2c89c62bec76 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:54:10.880621 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df9d9ce-6c50-464c-a1fc-39d4fbc63686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:54:10.881292 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9d9ce-6c50-464c-a1fc-39d4fbc63686 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:10.881574 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9d9ce-6c50-464c-a1fc-39d4fbc63686 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:10.882607 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9d9ce-6c50-464c-a1fc-39d4fbc63686 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:10.883446 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df9d9ce-6c50-464c-a1fc-39d4fbc63686 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:54:10.885364 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df9d9ce-6c50-464c-a1fc-39d4fbc63686 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:54:10.966103 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1344/2698] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:54:10 2022] POST /identity/v3/users => generated 297 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:54:10.970105 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc98abc-6cc1-4feb-a3b1-382af1a25da9 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:54:10.980643 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc98abc-6cc1-4feb-a3b1-382af1a25da9 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:54:10.985324 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e576cdd6-f67d-4856-82e6-c203cbc19a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:54:10.986004 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e576cdd6-f67d-4856-82e6-c203cbc19a07 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:10.986288 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e576cdd6-f67d-4856-82e6-c203cbc19a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:10.986565 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e576cdd6-f67d-4856-82e6-c203cbc19a07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:10.987288 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e576cdd6-f67d-4856-82e6-c203cbc19a07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:54:10.988997 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e576cdd6-f67d-4856-82e6-c203cbc19a07 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:54:11.000761 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1355/2699] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:54:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:54:11.004993 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df9d9ce-6c50-464c-a1fc-39d4fbc63686 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:54:11.016297 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df9d9ce-6c50-464c-a1fc-39d4fbc63686 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:54:11.020958 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2a7263-8fc1-44fb-bd43-15d4a0b577e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:54:11.021834 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a7263-8fc1-44fb-bd43-15d4a0b577e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:11.022114 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a7263-8fc1-44fb-bd43-15d4a0b577e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:11.022464 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a7263-8fc1-44fb-bd43-15d4a0b577e4 admin admin] PATH_INFO: `/v3/projects/0b7e7755430140048ee1566c5fd7e82b/users/85d28fbdf735462399b63f053d787a4a/roles/702e5e78b5d744529384b96a390ae92f` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:11.037491 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2a7263-8fc1-44fb-bd43-15d4a0b577e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b7e7755430140048ee1566c5fd7e82b, user_id=85d28fbdf735462399b63f053d787a4a, role_id=702e5e78b5d744529384b96a390ae92f)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:54:11.040390 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2a7263-8fc1-44fb-bd43-15d4a0b577e4 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:54:11.137640 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1345/2700] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:54:11 2022] PUT /identity/v3/projects/0b7e7755430140048ee1566c5fd7e82b/users/85d28fbdf735462399b63f053d787a4a/roles/702e5e78b5d744529384b96a390ae92f => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:54:11.141615 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e576cdd6-f67d-4856-82e6-c203cbc19a07 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:54:11.151879 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e576cdd6-f67d-4856-82e6-c203cbc19a07 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:54:11.208585 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f09948a-35f2-41fa-955b-6f2c0a5cb345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:54:11.209265 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09948a-35f2-41fa-955b-6f2c0a5cb345 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:11.209552 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09948a-35f2-41fa-955b-6f2c0a5cb345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:11.209882 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09948a-35f2-41fa-955b-6f2c0a5cb345 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:11.210732 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f09948a-35f2-41fa-955b-6f2c0a5cb345 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:54:11.212453 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f09948a-35f2-41fa-955b-6f2c0a5cb345 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:54:11.222739 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1356/2701] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:54:11 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 16:54:11.227105 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2a7263-8fc1-44fb-bd43-15d4a0b577e4 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:54:11.237888 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2a7263-8fc1-44fb-bd43-15d4a0b577e4 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:54:11.243371 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828d5deb-b9d8-4a52-bd7b-ac28ab7b4eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:54:11.244282 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d5deb-b9d8-4a52-bd7b-ac28ab7b4eea admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:11.244609 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d5deb-b9d8-4a52-bd7b-ac28ab7b4eea admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:11.245074 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d5deb-b9d8-4a52-bd7b-ac28ab7b4eea admin admin] PATH_INFO: `/v3/projects/0b7e7755430140048ee1566c5fd7e82b/users/85d28fbdf735462399b63f053d787a4a/roles/702e5e78b5d744529384b96a390ae92f` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:11.246802 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828d5deb-b9d8-4a52-bd7b-ac28ab7b4eea admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b7e7755430140048ee1566c5fd7e82b, user_id=85d28fbdf735462399b63f053d787a4a, role_id=702e5e78b5d744529384b96a390ae92f)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:54:11.249523 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828d5deb-b9d8-4a52-bd7b-ac28ab7b4eea admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:54:11.261111 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1346/2702] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:54:11 2022] PUT /identity/v3/projects/0b7e7755430140048ee1566c5fd7e82b/users/85d28fbdf735462399b63f053d787a4a/roles/702e5e78b5d744529384b96a390ae92f => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:54:17.292850 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd88ffd-f947-423b-b336-1405a4358894 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:17.293386 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd88ffd-f947-423b-b336-1405a4358894 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:17.293506 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd88ffd-f947-423b-b336-1405a4358894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:17.322831 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-9bd88ffd-f947-423b-b336-1405a4358894 None None] MFA Rules not processed for user `85d28fbdf735462399b63f053d787a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:54:17.324101 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-9bd88ffd-f947-423b-b336-1405a4358894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:54:17.402345 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1357/2703] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:54:17 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:54:17.415368 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828d5deb-b9d8-4a52-bd7b-ac28ab7b4eea admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:54:17.417453 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-828d5deb-b9d8-4a52-bd7b-ac28ab7b4eea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:54:17.478949 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828d5deb-b9d8-4a52-bd7b-ac28ab7b4eea admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:54:17.483093 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634824d7-b0e6-4544-b66f-a8003028f374 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f7cf98d5394b28a475fd67e30fc9c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:54:17.483852 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634824d7-b0e6-4544-b66f-a8003028f374 service glance] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:17.484137 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634824d7-b0e6-4544-b66f-a8003028f374 service glance] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:17.484416 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634824d7-b0e6-4544-b66f-a8003028f374 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:17.544186 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634824d7-b0e6-4544-b66f-a8003028f374 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:54:17.545647 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634824d7-b0e6-4544-b66f-a8003028f374 service glance] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:54:17.557838 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1347/2704] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:54:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:54:17.885023 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0074596-bfb8-4942-a818-a5d613ae990f None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:17.885316 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0074596-bfb8-4942-a818-a5d613ae990f None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:17.885595 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0074596-bfb8-4942-a818-a5d613ae990f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:17.904632 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-d0074596-bfb8-4942-a818-a5d613ae990f None None] MFA Rules not processed for user `3252c48fdd5747a29fe4ba89e7162216`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:54:17.905865 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-d0074596-bfb8-4942-a818-a5d613ae990f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:54:17.964880 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1358/2705] 10.222.0.43 () {58 vars in 1009 bytes} [Mon Apr 11 16:54:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:54:17.988272 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634824d7-b0e6-4544-b66f-a8003028f374 service glance] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:54:17.989716 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-634824d7-b0e6-4544-b66f-a8003028f374 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:54:18.071380 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634824d7-b0e6-4544-b66f-a8003028f374 service glance] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:54:18.076980 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64c6877-4c78-432e-abff-b1ebb6ea9017 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb193a1a7abd430fbbcccab970e4f37c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:54:18.077643 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c6877-4c78-432e-abff-b1ebb6ea9017 service swift] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:18.077931 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c6877-4c78-432e-abff-b1ebb6ea9017 service swift] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:18.078209 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c6877-4c78-432e-abff-b1ebb6ea9017 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:18.088029 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64c6877-4c78-432e-abff-b1ebb6ea9017 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:54:18.089616 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64c6877-4c78-432e-abff-b1ebb6ea9017 service swift] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:54:18.097798 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1348/2706] 10.222.0.43 () {60 vars in 1384 bytes} [Mon Apr 11 16:54:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 11 16:54:30.122566 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37474878-2cad-45c9-adfb-eb949b797c93 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:30.123132 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37474878-2cad-45c9-adfb-eb949b797c93 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:30.123132 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37474878-2cad-45c9-adfb-eb949b797c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:30.141456 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-37474878-2cad-45c9-adfb-eb949b797c93 None None] MFA Rules not processed for user `85b65e4e233c4b308e128c8e246d58dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:54:30.142647 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-37474878-2cad-45c9-adfb-eb949b797c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:54:30.149954 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1359/2707] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:54:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:54:30.400692 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64c6877-4c78-432e-abff-b1ebb6ea9017 service swift] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:54:30.455801 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64c6877-4c78-432e-abff-b1ebb6ea9017 service swift] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:54:30.459726 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254817e-40f0-4414-9313-1f71649dab17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:54:30.460525 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254817e-40f0-4414-9313-1f71649dab17 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:30.460806 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254817e-40f0-4414-9313-1f71649dab17 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:30.461080 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254817e-40f0-4414-9313-1f71649dab17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:30.463275 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-9254817e-40f0-4414-9313-1f71649dab17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:54:30.473495 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9254817e-40f0-4414-9313-1f71649dab17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:54:30.474923 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9254817e-40f0-4414-9313-1f71649dab17 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:54:30.484112 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1349/2708] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:54:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:54:34.033631 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b8be7-1652-4eeb-8a7a-29bacb032c65 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:34.034082 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b8be7-1652-4eeb-8a7a-29bacb032c65 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:34.034193 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b8be7-1652-4eeb-8a7a-29bacb032c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:34.051901 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-595b8be7-1652-4eeb-8a7a-29bacb032c65 None None] MFA Rules not processed for user `3252c48fdd5747a29fe4ba89e7162216`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:54:34.053114 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-595b8be7-1652-4eeb-8a7a-29bacb032c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:54:34.060997 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1360/2709] 10.222.0.43 () {58 vars in 1009 bytes} [Mon Apr 11 16:54:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:54:34.073685 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254817e-40f0-4414-9313-1f71649dab17 service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:54:34.085698 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254817e-40f0-4414-9313-1f71649dab17 service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:54:34.090887 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb71dd-5869-4b6f-a2ea-ebfa2a3a6f57 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb193a1a7abd430fbbcccab970e4f37c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:54:34.095912 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb71dd-5869-4b6f-a2ea-ebfa2a3a6f57 service swift] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:34.095912 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb71dd-5869-4b6f-a2ea-ebfa2a3a6f57 service swift] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:34.095912 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb71dd-5869-4b6f-a2ea-ebfa2a3a6f57 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:34.100682 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bb71dd-5869-4b6f-a2ea-ebfa2a3a6f57 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:54:34.102278 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bb71dd-5869-4b6f-a2ea-ebfa2a3a6f57 service swift] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:54:34.111298 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1350/2710] 10.222.0.43 () {60 vars in 1384 bytes} [Mon Apr 11 16:54:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 11 16:54:48.131635 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595b8be7-1652-4eeb-8a7a-29bacb032c65 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:54:48.133624 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-595b8be7-1652-4eeb-8a7a-29bacb032c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:54:48.282367 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595b8be7-1652-4eeb-8a7a-29bacb032c65 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:54:48.289341 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00c1cbf-6476-4b1f-896a-94351a0e7726 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1be2652c984a4283aeee0b937f0555e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:54:48.290012 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c1cbf-6476-4b1f-896a-94351a0e7726 service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:48.290331 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c1cbf-6476-4b1f-896a-94351a0e7726 service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:48.290614 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c1cbf-6476-4b1f-896a-94351a0e7726 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:48.294169 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-c00c1cbf-6476-4b1f-896a-94351a0e7726 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:54:48.308435 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00c1cbf-6476-4b1f-896a-94351a0e7726 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:54:48.310031 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00c1cbf-6476-4b1f-896a-94351a0e7726 service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:54:48.321198 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1361/2711] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:54:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:54:53.906805 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb71dd-5869-4b6f-a2ea-ebfa2a3a6f57 service swift] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:54:53.951217 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb71dd-5869-4b6f-a2ea-ebfa2a3a6f57 service swift] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:54:53.956892 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50be5186-7c0d-4677-9e0a-b18846af8193 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1be2652c984a4283aeee0b937f0555e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:54:53.957539 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be5186-7c0d-4677-9e0a-b18846af8193 service nova] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:53.957828 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be5186-7c0d-4677-9e0a-b18846af8193 service nova] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:53.958109 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be5186-7c0d-4677-9e0a-b18846af8193 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:53.959951 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-50be5186-7c0d-4677-9e0a-b18846af8193 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:54:53.973254 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50be5186-7c0d-4677-9e0a-b18846af8193 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:54:53.974874 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50be5186-7c0d-4677-9e0a-b18846af8193 service nova] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:54:53.987085 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1351/2712] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:54:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:54:55.302820 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00c1cbf-6476-4b1f-896a-94351a0e7726 service nova] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:54:55.304420 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-c00c1cbf-6476-4b1f-896a-94351a0e7726 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:54:55.338226 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00c1cbf-6476-4b1f-896a-94351a0e7726 service nova] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:54:55.342693 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff3646e-1917-4421-85fd-46409b446cab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:54:55.343335 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3646e-1917-4421-85fd-46409b446cab service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:55.343653 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3646e-1917-4421-85fd-46409b446cab service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:55.343929 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3646e-1917-4421-85fd-46409b446cab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:55.345722 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-4ff3646e-1917-4421-85fd-46409b446cab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:54:55.403234 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff3646e-1917-4421-85fd-46409b446cab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:54:55.404706 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff3646e-1917-4421-85fd-46409b446cab service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:54:55.414810 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1362/2713] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:54:55 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:54:56.577396 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50be5186-7c0d-4677-9e0a-b18846af8193 service nova] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:54:56.590025 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50be5186-7c0d-4677-9e0a-b18846af8193 service nova] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:54:56.597305 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b4d5ec-27d2-474e-9beb-4c578bf970ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1be2652c984a4283aeee0b937f0555e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:54:56.598333 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b4d5ec-27d2-474e-9beb-4c578bf970ba service nova] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:56.598455 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b4d5ec-27d2-474e-9beb-4c578bf970ba service nova] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:56.598733 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b4d5ec-27d2-474e-9beb-4c578bf970ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:56.600689 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-90b4d5ec-27d2-474e-9beb-4c578bf970ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:54:56.614402 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b4d5ec-27d2-474e-9beb-4c578bf970ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:54:56.616208 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b4d5ec-27d2-474e-9beb-4c578bf970ba service nova] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:54:56.628704 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1352/2714] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:54:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:55:01.970784 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff3646e-1917-4421-85fd-46409b446cab service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:55:01.979726 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff3646e-1917-4421-85fd-46409b446cab service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:55:01.983413 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c8346d-989d-4fc2-ad80-8a20f104d9ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:55:01.984149 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8346d-989d-4fc2-ad80-8a20f104d9ff service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:55:01.984431 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8346d-989d-4fc2-ad80-8a20f104d9ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:55:01.984706 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8346d-989d-4fc2-ad80-8a20f104d9ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:55:01.986495 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-07c8346d-989d-4fc2-ad80-8a20f104d9ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:55:02.069161 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c8346d-989d-4fc2-ad80-8a20f104d9ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:55:02.070667 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c8346d-989d-4fc2-ad80-8a20f104d9ff service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:55:02.091131 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1363/2715] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:55:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:55:09.847570 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b4d5ec-27d2-474e-9beb-4c578bf970ba service nova] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:55:09.849233 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-90b4d5ec-27d2-474e-9beb-4c578bf970ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:55:09.864142 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b4d5ec-27d2-474e-9beb-4c578bf970ba service nova] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:55:09.869400 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee39587-8f58-407b-8e5c-dd2e39a60627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:55:09.870929 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee39587-8f58-407b-8e5c-dd2e39a60627 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:55:09.871467 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee39587-8f58-407b-8e5c-dd2e39a60627 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:55:09.872006 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee39587-8f58-407b-8e5c-dd2e39a60627 admin admin] PATH_INFO: `/v3/users/4ff4a686fcd9483dbeaf1881f683a298` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:55:09.873531 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee39587-8f58-407b-8e5c-dd2e39a60627 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ff4a686fcd9483dbeaf1881f683a298)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:55:09.875870 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee39587-8f58-407b-8e5c-dd2e39a60627 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:55:10.067686 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-bee39587-8f58-407b-8e5c-dd2e39a60627 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ff4a686fcd9483dbeaf1881f683a298'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:55:10.147748 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-bee39587-8f58-407b-8e5c-dd2e39a60627 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ff4a686fcd9483dbeaf1881f683a298'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:55:10.155770 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-bee39587-8f58-407b-8e5c-dd2e39a60627 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ff4a686fcd9483dbeaf1881f683a298'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:55:10.156435 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-bee39587-8f58-407b-8e5c-dd2e39a60627 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ff4a686fcd9483dbeaf1881f683a298'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:55:10.168796 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-bee39587-8f58-407b-8e5c-dd2e39a60627 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ff4a686fcd9483dbeaf1881f683a298'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:55:10.175222 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1353/2716] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:55:09 2022] DELETE /identity/v3/users/4ff4a686fcd9483dbeaf1881f683a298 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:55:10.253668 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c8346d-989d-4fc2-ad80-8a20f104d9ff service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:55:10.262924 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c8346d-989d-4fc2-ad80-8a20f104d9ff service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:55:10.316412 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4d200b-38d9-4866-ac3e-762f63c830e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:55:10.317696 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d200b-38d9-4866-ac3e-762f63c830e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:55:10.318151 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d200b-38d9-4866-ac3e-762f63c830e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:55:10.318727 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d200b-38d9-4866-ac3e-762f63c830e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:55:10.321298 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-7c4d200b-38d9-4866-ac3e-762f63c830e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:55:10.383724 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4d200b-38d9-4866-ac3e-762f63c830e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:55:10.385680 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4d200b-38d9-4866-ac3e-762f63c830e0 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:55:10.395099 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1364/2717] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:55:10 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:55:10.440506 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee39587-8f58-407b-8e5c-dd2e39a60627 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:55:10.442543 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-bee39587-8f58-407b-8e5c-dd2e39a60627 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:55:10.513848 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee39587-8f58-407b-8e5c-dd2e39a60627 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:55:10.518555 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725f0482-8244-4d1a-ac8f-7a61350cf71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:55:10.519406 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f0482-8244-4d1a-ac8f-7a61350cf71c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:55:10.519717 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f0482-8244-4d1a-ac8f-7a61350cf71c admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:55:10.520017 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f0482-8244-4d1a-ac8f-7a61350cf71c admin admin] PATH_INFO: `/v3/projects/e519d5dba1a84daba1dfce70b3133bdb` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:55:10.521217 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725f0482-8244-4d1a-ac8f-7a61350cf71c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e519d5dba1a84daba1dfce70b3133bdb)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:55:10.523100 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725f0482-8244-4d1a-ac8f-7a61350cf71c admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:55:10.742905 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-725f0482-8244-4d1a-ac8f-7a61350cf71c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e519d5dba1a84daba1dfce70b3133bdb', 'request_id': 'req-725f0482-8244-4d1a-ac8f-7a61350cf71c'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:55:10.848838 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-725f0482-8244-4d1a-ac8f-7a61350cf71c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e519d5dba1a84daba1dfce70b3133bdb', 'request_id': 'req-725f0482-8244-4d1a-ac8f-7a61350cf71c'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:55:10.855330 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-725f0482-8244-4d1a-ac8f-7a61350cf71c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e519d5dba1a84daba1dfce70b3133bdb', 'request_id': 'req-725f0482-8244-4d1a-ac8f-7a61350cf71c'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:55:10.867059 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-725f0482-8244-4d1a-ac8f-7a61350cf71c admin admin] The token cache is being invalidate because project e519d5dba1a84daba1dfce70b3133bdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:55:10.867345 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-725f0482-8244-4d1a-ac8f-7a61350cf71c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:55:10.868151 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-725f0482-8244-4d1a-ac8f-7a61350cf71c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:55:10.870109 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1354/2718] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:55:10 2022] DELETE /identity/v3/projects/e519d5dba1a84daba1dfce70b3133bdb => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:55:10.874096 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4d200b-38d9-4866-ac3e-762f63c830e0 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:55:10.884758 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4d200b-38d9-4866-ac3e-762f63c830e0 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:55:10.943694 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6b7620-dd9f-47a3-b231-6eb606b8ba56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:55:10.944600 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b7620-dd9f-47a3-b231-6eb606b8ba56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:55:10.944888 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b7620-dd9f-47a3-b231-6eb606b8ba56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:55:10.945168 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b7620-dd9f-47a3-b231-6eb606b8ba56 admin admin] PATH_INFO: `/v3/users/ab2342a2e68b4c0ea39cac8fefc6aaad` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:55:10.946423 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6b7620-dd9f-47a3-b231-6eb606b8ba56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab2342a2e68b4c0ea39cac8fefc6aaad)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:55:10.949089 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6b7620-dd9f-47a3-b231-6eb606b8ba56 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:55:11.173714 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-ef6b7620-dd9f-47a3-b231-6eb606b8ba56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab2342a2e68b4c0ea39cac8fefc6aaad'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:55:11.174406 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-ef6b7620-dd9f-47a3-b231-6eb606b8ba56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab2342a2e68b4c0ea39cac8fefc6aaad'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:55:11.256628 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-ef6b7620-dd9f-47a3-b231-6eb606b8ba56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab2342a2e68b4c0ea39cac8fefc6aaad'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:55:11.274237 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-ef6b7620-dd9f-47a3-b231-6eb606b8ba56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab2342a2e68b4c0ea39cac8fefc6aaad'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:55:11.287545 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-ef6b7620-dd9f-47a3-b231-6eb606b8ba56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab2342a2e68b4c0ea39cac8fefc6aaad'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:55:11.297688 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1365/2719] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:55:10 2022] DELETE /identity/v3/users/ab2342a2e68b4c0ea39cac8fefc6aaad => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:55:11.595988 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725f0482-8244-4d1a-ac8f-7a61350cf71c admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:55:11.600032 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-725f0482-8244-4d1a-ac8f-7a61350cf71c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:55:11.625217 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725f0482-8244-4d1a-ac8f-7a61350cf71c admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:55:11.687201 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f6b281-915e-4c24-8649-b28032015e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:55:11.688100 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6b281-915e-4c24-8649-b28032015e96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:55:11.688386 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6b281-915e-4c24-8649-b28032015e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:55:11.688724 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6b281-915e-4c24-8649-b28032015e96 admin admin] PATH_INFO: `/v3/projects/e6e861e727af4a5e9c5adca5c1a99835` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:55:11.693535 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f6b281-915e-4c24-8649-b28032015e96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6e861e727af4a5e9c5adca5c1a99835)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:55:11.695561 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f6b281-915e-4c24-8649-b28032015e96 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:55:11.823213 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-94f6b281-915e-4c24-8649-b28032015e96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6e861e727af4a5e9c5adca5c1a99835', 'request_id': 'req-94f6b281-915e-4c24-8649-b28032015e96'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:55:11.924930 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-94f6b281-915e-4c24-8649-b28032015e96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6e861e727af4a5e9c5adca5c1a99835', 'request_id': 'req-94f6b281-915e-4c24-8649-b28032015e96'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:55:11.930981 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-94f6b281-915e-4c24-8649-b28032015e96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6e861e727af4a5e9c5adca5c1a99835', 'request_id': 'req-94f6b281-915e-4c24-8649-b28032015e96'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:55:11.942930 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-94f6b281-915e-4c24-8649-b28032015e96 admin admin] The token cache is being invalidate because project e6e861e727af4a5e9c5adca5c1a99835 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:55:11.943219 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-94f6b281-915e-4c24-8649-b28032015e96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:55:11.943894 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-94f6b281-915e-4c24-8649-b28032015e96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:55:11.945458 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1355/2720] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:55:11 2022] DELETE /identity/v3/projects/e6e861e727af4a5e9c5adca5c1a99835 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:55:11.951126 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872b56e-1834-4772-b139-64f891684c32 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:55:11.951420 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872b56e-1834-4772-b139-64f891684c32 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:55:11.951798 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872b56e-1834-4772-b139-64f891684c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:55:12.010945 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-d872b56e-1834-4772-b139-64f891684c32 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:55:12.012190 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-d872b56e-1834-4772-b139-64f891684c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:55:12.080301 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1366/2721] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:55:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:55:12.082160 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048dadd1-61e2-46d7-a7b9-52aaa4080c9b None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:55:12.082455 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048dadd1-61e2-46d7-a7b9-52aaa4080c9b None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:55:12.082742 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048dadd1-61e2-46d7-a7b9-52aaa4080c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:55:12.103174 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-048dadd1-61e2-46d7-a7b9-52aaa4080c9b None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:55:12.104800 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-048dadd1-61e2-46d7-a7b9-52aaa4080c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:55:12.113080 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1356/2722] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:55:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:55:12.117417 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d872b56e-1834-4772-b139-64f891684c32 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:55:12.127909 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d872b56e-1834-4772-b139-64f891684c32 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:55:12.132825 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af348da7-d593-4f1d-b419-5d8bf188946c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:55:12.133501 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af348da7-d593-4f1d-b419-5d8bf188946c admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:55:12.133783 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af348da7-d593-4f1d-b419-5d8bf188946c admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:55:12.134060 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af348da7-d593-4f1d-b419-5d8bf188946c admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:55:12.134862 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af348da7-d593-4f1d-b419-5d8bf188946c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:55:12.135742 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af348da7-d593-4f1d-b419-5d8bf188946c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:55:12.137393 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af348da7-d593-4f1d-b419-5d8bf188946c admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:55:12.149447 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1367/2723] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Apr 11 16:55:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:55:12.153748 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048dadd1-61e2-46d7-a7b9-52aaa4080c9b None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:55:12.163145 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048dadd1-61e2-46d7-a7b9-52aaa4080c9b None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:55:12.168412 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35956cf-dc6f-4244-83f4-671b549d81c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:55:12.169586 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35956cf-dc6f-4244-83f4-671b549d81c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:55:12.169586 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35956cf-dc6f-4244-83f4-671b549d81c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:55:12.169799 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35956cf-dc6f-4244-83f4-671b549d81c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:55:12.170426 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35956cf-dc6f-4244-83f4-671b549d81c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:55:12.172279 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35956cf-dc6f-4244-83f4-671b549d81c1 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:55:12.303772 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1357/2724] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:55:12 2022] POST /identity/v3/projects => generated 379 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:55:12.309033 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af348da7-d593-4f1d-b419-5d8bf188946c admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:55:12.318873 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af348da7-d593-4f1d-b419-5d8bf188946c admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:55:12.375339 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37776e65-ee73-426f-8369-84edf5bb3e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:55:12.376056 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37776e65-ee73-426f-8369-84edf5bb3e84 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:55:12.376346 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37776e65-ee73-426f-8369-84edf5bb3e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:55:12.376626 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37776e65-ee73-426f-8369-84edf5bb3e84 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:55:12.377325 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37776e65-ee73-426f-8369-84edf5bb3e84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:55:12.379301 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37776e65-ee73-426f-8369-84edf5bb3e84 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:55:12.480423 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1368/2725] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:55:12 2022] POST /identity/v3/users => generated 290 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:55:12.485491 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35956cf-dc6f-4244-83f4-671b549d81c1 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:55:12.497323 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35956cf-dc6f-4244-83f4-671b549d81c1 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:55:12.502796 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc1e16e-7fd0-412c-a251-c8f07832e2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:55:12.503507 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc1e16e-7fd0-412c-a251-c8f07832e2d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:55:12.503931 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc1e16e-7fd0-412c-a251-c8f07832e2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:55:12.504210 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc1e16e-7fd0-412c-a251-c8f07832e2d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:55:12.504952 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc1e16e-7fd0-412c-a251-c8f07832e2d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:55:12.506557 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc1e16e-7fd0-412c-a251-c8f07832e2d1 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:55:12.518018 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1358/2726] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:55:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 16:55:12.522108 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37776e65-ee73-426f-8369-84edf5bb3e84 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:55:12.532813 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37776e65-ee73-426f-8369-84edf5bb3e84 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:55:12.537760 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc5bcd-6f65-4e1b-b65d-9f4c08f456f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:55:12.538610 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc5bcd-6f65-4e1b-b65d-9f4c08f456f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:55:12.538895 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc5bcd-6f65-4e1b-b65d-9f4c08f456f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:55:12.539174 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc5bcd-6f65-4e1b-b65d-9f4c08f456f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:55:12.539939 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cc5bcd-6f65-4e1b-b65d-9f4c08f456f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:55:12.541804 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cc5bcd-6f65-4e1b-b65d-9f4c08f456f5 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:55:12.552181 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1369/2727] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:55:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 16:55:12.556294 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc1e16e-7fd0-412c-a251-c8f07832e2d1 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:55:12.566628 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc1e16e-7fd0-412c-a251-c8f07832e2d1 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:55:12.571507 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc423a4-3085-492e-91d2-3c3c38718979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:55:12.577738 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc423a4-3085-492e-91d2-3c3c38718979 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:55:12.577738 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc423a4-3085-492e-91d2-3c3c38718979 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:55:12.577738 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc423a4-3085-492e-91d2-3c3c38718979 admin admin] PATH_INFO: `/v3/projects/8a9151e87a0144caa9be07aa21c76b5b/users/25e7976dd30c4c2688a681474b766461/roles/0d41da7bec094450b5bff4e4831be52c` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:55:12.590417 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc423a4-3085-492e-91d2-3c3c38718979 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a9151e87a0144caa9be07aa21c76b5b, user_id=25e7976dd30c4c2688a681474b766461, role_id=0d41da7bec094450b5bff4e4831be52c)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:55:12.593322 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc423a4-3085-492e-91d2-3c3c38718979 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:55:12.703293 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1359/2728] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:55:12 2022] PUT /identity/v3/projects/8a9151e87a0144caa9be07aa21c76b5b/users/25e7976dd30c4c2688a681474b766461/roles/0d41da7bec094450b5bff4e4831be52c => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:55:12.709409 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291cdda4-f1e3-4260-a958-77c912433c34 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:55:12.709409 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291cdda4-f1e3-4260-a958-77c912433c34 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:55:12.709409 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291cdda4-f1e3-4260-a958-77c912433c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:55:12.730715 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-291cdda4-f1e3-4260-a958-77c912433c34 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:55:12.732057 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-291cdda4-f1e3-4260-a958-77c912433c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:55:12.792972 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1370/2729] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:55:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:55:12.803761 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc423a4-3085-492e-91d2-3c3c38718979 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:55:12.805516 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-ccc423a4-3085-492e-91d2-3c3c38718979 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:55:12.876372 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc423a4-3085-492e-91d2-3c3c38718979 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:55:12.880612 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a523bd47-2e62-41a0-ae26-58db845d6393 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:55:12.881331 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523bd47-2e62-41a0-ae26-58db845d6393 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:55:12.881620 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523bd47-2e62-41a0-ae26-58db845d6393 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:55:12.881947 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523bd47-2e62-41a0-ae26-58db845d6393 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:55:12.892709 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a523bd47-2e62-41a0-ae26-58db845d6393 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:55:12.894527 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a523bd47-2e62-41a0-ae26-58db845d6393 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:55:12.905554 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1360/2730] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:55:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:55:20.143038 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba8032-84ab-486f-94fc-a5db649a7f32 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:55:20.143497 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba8032-84ab-486f-94fc-a5db649a7f32 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:55:20.143753 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba8032-84ab-486f-94fc-a5db649a7f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:55:20.182404 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-7eba8032-84ab-486f-94fc-a5db649a7f32 None None] MFA Rules not processed for user `25e7976dd30c4c2688a681474b766461`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:55:20.183904 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-7eba8032-84ab-486f-94fc-a5db649a7f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:55:20.271281 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1371/2731] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:55:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:55:20.276078 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a523bd47-2e62-41a0-ae26-58db845d6393 service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:55:20.286425 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a523bd47-2e62-41a0-ae26-58db845d6393 service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:55:20.292482 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025ca003-494a-413a-bb32-2bf7116d8b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:55:20.293155 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ca003-494a-413a-bb32-2bf7116d8b2a admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:55:20.293436 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ca003-494a-413a-bb32-2bf7116d8b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:55:20.293709 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ca003-494a-413a-bb32-2bf7116d8b2a admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:55:20.294399 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025ca003-494a-413a-bb32-2bf7116d8b2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:55:20.296416 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025ca003-494a-413a-bb32-2bf7116d8b2a admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:55:20.435992 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1361/2732] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:55:20 2022] POST /identity/v3/projects => generated 379 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:55:20.440033 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eba8032-84ab-486f-94fc-a5db649a7f32 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:55:20.451709 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eba8032-84ab-486f-94fc-a5db649a7f32 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:55:20.513955 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c095a3d8-f84d-4205-8b4c-5e8ddc6790a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:55:20.514954 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c095a3d8-f84d-4205-8b4c-5e8ddc6790a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:55:20.515459 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c095a3d8-f84d-4205-8b4c-5e8ddc6790a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:55:20.515909 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c095a3d8-f84d-4205-8b4c-5e8ddc6790a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:55:20.516470 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c095a3d8-f84d-4205-8b4c-5e8ddc6790a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:55:20.518463 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c095a3d8-f84d-4205-8b4c-5e8ddc6790a1 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:55:20.609662 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1372/2733] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:55:20 2022] POST /identity/v3/users => generated 296 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:55:20.613605 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025ca003-494a-413a-bb32-2bf7116d8b2a admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:55:20.625025 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025ca003-494a-413a-bb32-2bf7116d8b2a admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:55:20.629620 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0bc9d6-6a4d-4b4b-9726-692a86e09b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:55:20.630282 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0bc9d6-6a4d-4b4b-9726-692a86e09b62 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:55:20.630567 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0bc9d6-6a4d-4b4b-9726-692a86e09b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:55:20.630835 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0bc9d6-6a4d-4b4b-9726-692a86e09b62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:55:20.631584 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0bc9d6-6a4d-4b4b-9726-692a86e09b62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:55:20.633315 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0bc9d6-6a4d-4b4b-9726-692a86e09b62 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:55:20.644248 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1362/2734] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:55:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:55:20.648872 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c095a3d8-f84d-4205-8b4c-5e8ddc6790a1 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:55:20.659446 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c095a3d8-f84d-4205-8b4c-5e8ddc6790a1 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:55:20.664081 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b862cdc7-5f81-4796-b6ab-90ae12df127d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:55:20.664956 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862cdc7-5f81-4796-b6ab-90ae12df127d admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:55:20.665235 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862cdc7-5f81-4796-b6ab-90ae12df127d admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:55:20.665507 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862cdc7-5f81-4796-b6ab-90ae12df127d admin admin] PATH_INFO: `/v3/projects/62a9f569ed5743f9be16af92d7f7e194/users/6e50b7bf7ce44174bd4f35c3b46ef2be/roles/702e5e78b5d744529384b96a390ae92f` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:55:20.681150 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b862cdc7-5f81-4796-b6ab-90ae12df127d admin admin] RBAC: Authorizing `identity:create_grant(project_id=62a9f569ed5743f9be16af92d7f7e194, user_id=6e50b7bf7ce44174bd4f35c3b46ef2be, role_id=702e5e78b5d744529384b96a390ae92f)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:55:20.684518 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b862cdc7-5f81-4796-b6ab-90ae12df127d admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:55:20.774248 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1373/2735] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:55:20 2022] PUT /identity/v3/projects/62a9f569ed5743f9be16af92d7f7e194/users/6e50b7bf7ce44174bd4f35c3b46ef2be/roles/702e5e78b5d744529384b96a390ae92f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:55:20.778333 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0bc9d6-6a4d-4b4b-9726-692a86e09b62 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:55:20.789047 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0bc9d6-6a4d-4b4b-9726-692a86e09b62 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:55:20.851197 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2ca0cb-2b3f-431d-a322-bd3db1896413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:55:20.851911 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ca0cb-2b3f-431d-a322-bd3db1896413 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:55:20.852258 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ca0cb-2b3f-431d-a322-bd3db1896413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:55:20.852542 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ca0cb-2b3f-431d-a322-bd3db1896413 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:55:20.853283 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2ca0cb-2b3f-431d-a322-bd3db1896413 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:55:20.854898 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2ca0cb-2b3f-431d-a322-bd3db1896413 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:55:20.864942 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1363/2736] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:55:20 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:55:20.869290 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b862cdc7-5f81-4796-b6ab-90ae12df127d admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:55:20.879812 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b862cdc7-5f81-4796-b6ab-90ae12df127d admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:55:20.885660 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c71186c-1eef-4086-a138-56a725614246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:55:20.886496 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c71186c-1eef-4086-a138-56a725614246 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:55:20.886775 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c71186c-1eef-4086-a138-56a725614246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:55:20.887054 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c71186c-1eef-4086-a138-56a725614246 admin admin] PATH_INFO: `/v3/projects/62a9f569ed5743f9be16af92d7f7e194/users/6e50b7bf7ce44174bd4f35c3b46ef2be/roles/702e5e78b5d744529384b96a390ae92f` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:55:20.889220 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c71186c-1eef-4086-a138-56a725614246 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62a9f569ed5743f9be16af92d7f7e194, user_id=6e50b7bf7ce44174bd4f35c3b46ef2be, role_id=702e5e78b5d744529384b96a390ae92f)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:55:20.891911 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c71186c-1eef-4086-a138-56a725614246 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:55:20.903501 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1374/2737] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:55:20 2022] PUT /identity/v3/projects/62a9f569ed5743f9be16af92d7f7e194/users/6e50b7bf7ce44174bd4f35c3b46ef2be/roles/702e5e78b5d744529384b96a390ae92f => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:55:21.037074 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2ca0cb-2b3f-431d-a322-bd3db1896413 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:55:21.101037 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2ca0cb-2b3f-431d-a322-bd3db1896413 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:55:21.155454 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c524abda-22b8-4085-9c38-07a55e250f97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:55:21.156141 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524abda-22b8-4085-9c38-07a55e250f97 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:55:21.156430 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524abda-22b8-4085-9c38-07a55e250f97 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:55:21.156704 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524abda-22b8-4085-9c38-07a55e250f97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:55:21.159076 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-c524abda-22b8-4085-9c38-07a55e250f97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:55:21.226677 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c524abda-22b8-4085-9c38-07a55e250f97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:55:21.228192 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c524abda-22b8-4085-9c38-07a55e250f97 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:55:21.243423 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1364/2738] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:55:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:55:26.236099 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c71186c-1eef-4086-a138-56a725614246 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:55:26.238300 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-2c71186c-1eef-4086-a138-56a725614246 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:55:26.263308 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c71186c-1eef-4086-a138-56a725614246 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:55:26.273598 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f269a82f-d283-4dd8-9158-73435f2e4533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:55:26.274815 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269a82f-d283-4dd8-9158-73435f2e4533 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:55:26.275291 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269a82f-d283-4dd8-9158-73435f2e4533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:55:26.275965 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269a82f-d283-4dd8-9158-73435f2e4533 admin admin] PATH_INFO: `/v3/users/de39f6406f414bc68ee956c7639dab5b` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:55:26.277998 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f269a82f-d283-4dd8-9158-73435f2e4533 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de39f6406f414bc68ee956c7639dab5b)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:55:26.280062 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f269a82f-d283-4dd8-9158-73435f2e4533 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:55:26.503077 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f269a82f-d283-4dd8-9158-73435f2e4533 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de39f6406f414bc68ee956c7639dab5b'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:55:26.503843 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f269a82f-d283-4dd8-9158-73435f2e4533 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de39f6406f414bc68ee956c7639dab5b'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:55:26.564813 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f269a82f-d283-4dd8-9158-73435f2e4533 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de39f6406f414bc68ee956c7639dab5b'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:55:26.577232 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f269a82f-d283-4dd8-9158-73435f2e4533 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de39f6406f414bc68ee956c7639dab5b'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:55:26.600941 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f269a82f-d283-4dd8-9158-73435f2e4533 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de39f6406f414bc68ee956c7639dab5b'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:55:26.614622 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1375/2739] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:55:26 2022] DELETE /identity/v3/users/de39f6406f414bc68ee956c7639dab5b => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:55:26.905319 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c524abda-22b8-4085-9c38-07a55e250f97 service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:55:26.925744 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c524abda-22b8-4085-9c38-07a55e250f97 service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:55:27.004604 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9922750-cea4-4f96-ba64-638a0e8c0e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:55:27.005479 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9922750-cea4-4f96-ba64-638a0e8c0e00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:55:27.005758 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9922750-cea4-4f96-ba64-638a0e8c0e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:55:27.006030 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9922750-cea4-4f96-ba64-638a0e8c0e00 admin admin] PATH_INFO: `/v3/projects/e54efcd6582349b9a9d7131150d8aa6f` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:55:27.007267 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9922750-cea4-4f96-ba64-638a0e8c0e00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e54efcd6582349b9a9d7131150d8aa6f)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:55:27.009253 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9922750-cea4-4f96-ba64-638a0e8c0e00 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:55:27.157144 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a9922750-cea4-4f96-ba64-638a0e8c0e00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e54efcd6582349b9a9d7131150d8aa6f', 'request_id': 'req-a9922750-cea4-4f96-ba64-638a0e8c0e00'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:55:27.261097 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a9922750-cea4-4f96-ba64-638a0e8c0e00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e54efcd6582349b9a9d7131150d8aa6f', 'request_id': 'req-a9922750-cea4-4f96-ba64-638a0e8c0e00'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:55:27.261097 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a9922750-cea4-4f96-ba64-638a0e8c0e00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e54efcd6582349b9a9d7131150d8aa6f', 'request_id': 'req-a9922750-cea4-4f96-ba64-638a0e8c0e00'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:55:27.272754 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a9922750-cea4-4f96-ba64-638a0e8c0e00 admin admin] The token cache is being invalidate because project e54efcd6582349b9a9d7131150d8aa6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:55:27.273046 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a9922750-cea4-4f96-ba64-638a0e8c0e00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:55:27.273706 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a9922750-cea4-4f96-ba64-638a0e8c0e00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:55:27.276153 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1365/2740] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:55:26 2022] DELETE /identity/v3/projects/e54efcd6582349b9a9d7131150d8aa6f => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:55:27.281173 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2cfc9-c99e-4050-a8e6-7e32774a375f None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:55:27.281744 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2cfc9-c99e-4050-a8e6-7e32774a375f None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:55:27.281847 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2cfc9-c99e-4050-a8e6-7e32774a375f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:55:27.301469 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-2cf2cfc9-c99e-4050-a8e6-7e32774a375f None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:55:27.302671 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-2cf2cfc9-c99e-4050-a8e6-7e32774a375f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:55:27.360020 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1376/2741] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:55:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:55:27.368738 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d959178a-7a5f-4890-81a4-6050e23fe1d5 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:55:27.369161 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d959178a-7a5f-4890-81a4-6050e23fe1d5 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:55:27.369706 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d959178a-7a5f-4890-81a4-6050e23fe1d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:55:27.389712 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-d959178a-7a5f-4890-81a4-6050e23fe1d5 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:55:27.391077 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-d959178a-7a5f-4890-81a4-6050e23fe1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:55:27.403190 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1366/2742] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:55:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:55:27.407754 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2cfc9-c99e-4050-a8e6-7e32774a375f None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:55:27.419732 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2cfc9-c99e-4050-a8e6-7e32774a375f None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:55:27.424764 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a801b3-0f51-48e7-9f03-52e278320656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:55:27.425444 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a801b3-0f51-48e7-9f03-52e278320656 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:55:27.426116 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a801b3-0f51-48e7-9f03-52e278320656 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:55:27.426116 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a801b3-0f51-48e7-9f03-52e278320656 admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:55:27.426734 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a801b3-0f51-48e7-9f03-52e278320656 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:55:27.427047 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a801b3-0f51-48e7-9f03-52e278320656 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:55:27.428757 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a801b3-0f51-48e7-9f03-52e278320656 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:55:27.446334 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1377/2743] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Apr 11 16:55:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:55:27.446502 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d959178a-7a5f-4890-81a4-6050e23fe1d5 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:55:27.457155 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d959178a-7a5f-4890-81a4-6050e23fe1d5 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:55:27.464072 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a2162-19c0-4e71-8c1f-921427572946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:55:27.464910 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a2162-19c0-4e71-8c1f-921427572946 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:55:27.465295 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a2162-19c0-4e71-8c1f-921427572946 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:55:27.465630 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a2162-19c0-4e71-8c1f-921427572946 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:55:27.466396 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7a2162-19c0-4e71-8c1f-921427572946 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:55:27.470805 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7a2162-19c0-4e71-8c1f-921427572946 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:55:27.579115 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1367/2744] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 16:55:27 2022] POST /identity/v3/projects => generated 375 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:55:27.583321 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a801b3-0f51-48e7-9f03-52e278320656 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:55:27.594478 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a801b3-0f51-48e7-9f03-52e278320656 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:55:27.660602 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867ef26e-46dc-43a0-93d1-41d3333a87ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:55:27.661411 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ef26e-46dc-43a0-93d1-41d3333a87ff admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:55:27.661808 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ef26e-46dc-43a0-93d1-41d3333a87ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:55:27.662273 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ef26e-46dc-43a0-93d1-41d3333a87ff admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:55:27.663057 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867ef26e-46dc-43a0-93d1-41d3333a87ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:55:27.665364 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867ef26e-46dc-43a0-93d1-41d3333a87ff admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:55:27.768640 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1378/2745] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 16:55:27 2022] POST /identity/v3/users => generated 288 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:55:27.772849 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a2162-19c0-4e71-8c1f-921427572946 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:55:27.786557 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a2162-19c0-4e71-8c1f-921427572946 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:55:27.792852 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccf0187-03dd-496d-a773-b1f905a0233c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:55:27.793768 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf0187-03dd-496d-a773-b1f905a0233c admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:55:27.794290 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf0187-03dd-496d-a773-b1f905a0233c admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:55:27.794745 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf0187-03dd-496d-a773-b1f905a0233c admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:55:27.796001 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccf0187-03dd-496d-a773-b1f905a0233c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:55:27.797809 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccf0187-03dd-496d-a773-b1f905a0233c admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:55:27.827791 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1368/2746] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:55:27 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:55:27.829841 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867ef26e-46dc-43a0-93d1-41d3333a87ff admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:55:27.841474 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867ef26e-46dc-43a0-93d1-41d3333a87ff admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:55:27.846238 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db07da5-ea18-48e3-a8d6-3ce6fba235ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:55:27.846913 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db07da5-ea18-48e3-a8d6-3ce6fba235ab admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:55:27.847205 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db07da5-ea18-48e3-a8d6-3ce6fba235ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:55:27.847490 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db07da5-ea18-48e3-a8d6-3ce6fba235ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:55:27.848258 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db07da5-ea18-48e3-a8d6-3ce6fba235ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:55:27.849867 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db07da5-ea18-48e3-a8d6-3ce6fba235ab admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:55:27.864783 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1379/2747] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 16:55:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 16:55:27.869828 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccf0187-03dd-496d-a773-b1f905a0233c admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:55:27.886485 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccf0187-03dd-496d-a773-b1f905a0233c admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:55:27.889939 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb2d88e-848a-4a01-a99a-d0ba9f73db87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:55:27.890805 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2d88e-848a-4a01-a99a-d0ba9f73db87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:55:27.890993 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2d88e-848a-4a01-a99a-d0ba9f73db87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:55:27.891270 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2d88e-848a-4a01-a99a-d0ba9f73db87 admin admin] PATH_INFO: `/v3/projects/d7c652a8e00241a68c25698bca5e7ffe/users/fb07a1ed0154461ea06c835552186a52/roles/0d41da7bec094450b5bff4e4831be52c` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:55:27.904973 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190848a-278a-495f-a4bb-b2fcb9c18390 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:55:27.905483 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190848a-278a-495f-a4bb-b2fcb9c18390 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:55:27.905765 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190848a-278a-495f-a4bb-b2fcb9c18390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:55:27.912625 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb2d88e-848a-4a01-a99a-d0ba9f73db87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7c652a8e00241a68c25698bca5e7ffe, user_id=fb07a1ed0154461ea06c835552186a52, role_id=0d41da7bec094450b5bff4e4831be52c)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:55:27.916049 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb2d88e-848a-4a01-a99a-d0ba9f73db87 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:55:27.935550 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-0190848a-278a-495f-a4bb-b2fcb9c18390 None None] MFA Rules not processed for user `6e50b7bf7ce44174bd4f35c3b46ef2be`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:55:27.937009 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0190848a-278a-495f-a4bb-b2fcb9c18390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:55:28.023333 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1369/2748] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 16:55:27 2022] PUT /identity/v3/projects/d7c652a8e00241a68c25698bca5e7ffe/users/fb07a1ed0154461ea06c835552186a52/roles/0d41da7bec094450b5bff4e4831be52c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:55:28.028560 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e1f93-9155-42d4-ab1f-b5c16b079c9c None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:55:28.028854 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e1f93-9155-42d4-ab1f-b5c16b079c9c None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:55:28.029132 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e1f93-9155-42d4-ab1f-b5c16b079c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:55:28.053161 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-9e6e1f93-9155-42d4-ab1f-b5c16b079c9c None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:55:28.053989 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1380/2749] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:55:27 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:55:28.054765 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-9e6e1f93-9155-42d4-ab1f-b5c16b079c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:55:28.063002 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0190848a-278a-495f-a4bb-b2fcb9c18390 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:55:28.064412 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0190848a-278a-495f-a4bb-b2fcb9c18390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:55:28.154067 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1370/2750] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:55:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:55:28.162884 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6e1f93-9155-42d4-ab1f-b5c16b079c9c None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:55:28.173433 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-9e6e1f93-9155-42d4-ab1f-b5c16b079c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:55:28.247045 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0190848a-278a-495f-a4bb-b2fcb9c18390 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:55:28.256544 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6e1f93-9155-42d4-ab1f-b5c16b079c9c None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:55:28.261757 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e27a3a-6e02-4180-bd37-b0525c36b85a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:55:28.262558 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e27a3a-6e02-4180-bd37-b0525c36b85a service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:55:28.262959 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e27a3a-6e02-4180-bd37-b0525c36b85a service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:55:28.263345 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e27a3a-6e02-4180-bd37-b0525c36b85a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:55:28.275932 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e27a3a-6e02-4180-bd37-b0525c36b85a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:55:28.277579 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e27a3a-6e02-4180-bd37-b0525c36b85a service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:55:28.288235 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1371/2751] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:55:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:55:28.324750 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c06222-02a4-40d7-9052-d2990fecc546 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1be2652c984a4283aeee0b937f0555e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:55:28.325440 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c06222-02a4-40d7-9052-d2990fecc546 service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:55:28.325706 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c06222-02a4-40d7-9052-d2990fecc546 service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:55:28.325986 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c06222-02a4-40d7-9052-d2990fecc546 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:55:28.327994 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a1c06222-02a4-40d7-9052-d2990fecc546 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:55:28.392038 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c06222-02a4-40d7-9052-d2990fecc546 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:55:28.393667 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c06222-02a4-40d7-9052-d2990fecc546 service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:55:28.404494 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1381/2752] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:55:28 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 16:55:34.902274 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b5cd2-86d2-422c-a7c0-34c0b497e17e None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:55:34.904243 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b5cd2-86d2-422c-a7c0-34c0b497e17e None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:55:34.904924 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b5cd2-86d2-422c-a7c0-34c0b497e17e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:55:34.943860 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-8c5b5cd2-86d2-422c-a7c0-34c0b497e17e None None] MFA Rules not processed for user `fb07a1ed0154461ea06c835552186a52`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:55:34.945162 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-8c5b5cd2-86d2-422c-a7c0-34c0b497e17e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:55:35.014231 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1372/2753] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:55:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:55:35.025966 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c06222-02a4-40d7-9052-d2990fecc546 service nova] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:55:35.027508 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a1c06222-02a4-40d7-9052-d2990fecc546 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:55:35.041914 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c06222-02a4-40d7-9052-d2990fecc546 service nova] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:55:35.048208 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d56e012-0b7f-4de1-93ff-2ad5f61dde74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1be2652c984a4283aeee0b937f0555e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:55:35.048875 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56e012-0b7f-4de1-93ff-2ad5f61dde74 service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:55:35.049162 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56e012-0b7f-4de1-93ff-2ad5f61dde74 service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:55:35.049555 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56e012-0b7f-4de1-93ff-2ad5f61dde74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:55:35.060139 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d56e012-0b7f-4de1-93ff-2ad5f61dde74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:55:35.061728 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d56e012-0b7f-4de1-93ff-2ad5f61dde74 service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:55:35.077795 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1382/2754] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:55:35 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:55:38.105516 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af362c7e-9071-4b7a-a0c5-b44744f8b859 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:55:38.106342 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af362c7e-9071-4b7a-a0c5-b44744f8b859 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:55:38.106342 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af362c7e-9071-4b7a-a0c5-b44744f8b859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:55:38.123852 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-af362c7e-9071-4b7a-a0c5-b44744f8b859 None None] MFA Rules not processed for user `fb07a1ed0154461ea06c835552186a52`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:55:38.125064 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-af362c7e-9071-4b7a-a0c5-b44744f8b859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:55:38.132062 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1373/2755] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:55:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:55:57.379903 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c985d709-6576-4d68-a575-9cb56d2accfb None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:55:57.380517 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c985d709-6576-4d68-a575-9cb56d2accfb None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:55:57.380517 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c985d709-6576-4d68-a575-9cb56d2accfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:55:57.399620 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-c985d709-6576-4d68-a575-9cb56d2accfb None None] MFA Rules not processed for user `25e7976dd30c4c2688a681474b766461`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:55:57.400894 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-c985d709-6576-4d68-a575-9cb56d2accfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:55:57.408521 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1383/2756] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:55:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:56:19.771483 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af362c7e-9071-4b7a-a0c5-b44744f8b859 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:56:19.772969 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-af362c7e-9071-4b7a-a0c5-b44744f8b859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:56:19.830711 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c985d709-6576-4d68-a575-9cb56d2accfb None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:56:19.840812 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c985d709-6576-4d68-a575-9cb56d2accfb None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:56:19.844341 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea0bc7-3e85-4f38-9fc0-d51068021ef6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:56:19.844981 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea0bc7-3e85-4f38-9fc0-d51068021ef6 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:56:19.845263 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea0bc7-3e85-4f38-9fc0-d51068021ef6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:56:19.845539 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea0bc7-3e85-4f38-9fc0-d51068021ef6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:56:19.863116 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af362c7e-9071-4b7a-a0c5-b44744f8b859 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:56:19.869893 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb7c469-cf94-4c46-98c2-30ca949a2a90 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6589debd41bf496085c7339ab5409666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:56:19.870537 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb7c469-cf94-4c46-98c2-30ca949a2a90 service placement] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:56:19.870821 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb7c469-cf94-4c46-98c2-30ca949a2a90 service placement] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:56:19.871094 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb7c469-cf94-4c46-98c2-30ca949a2a90 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:56:19.872906 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-3eb7c469-cf94-4c46-98c2-30ca949a2a90 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:56:19.884437 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb7c469-cf94-4c46-98c2-30ca949a2a90 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:56:19.886001 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb7c469-cf94-4c46-98c2-30ca949a2a90 service placement] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:56:19.895755 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1374/2757] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:56:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:56:19.905063 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dea0bc7-3e85-4f38-9fc0-d51068021ef6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:56:19.906481 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dea0bc7-3e85-4f38-9fc0-d51068021ef6 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:56:19.916770 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1384/2758] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:56:19 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 16:58:04.867400 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7233ef-9729-46d7-94fa-ade616f365d3 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:58:04.867931 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7233ef-9729-46d7-94fa-ade616f365d3 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:58:04.868038 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7233ef-9729-46d7-94fa-ade616f365d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:58:04.926089 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-ac7233ef-9729-46d7-94fa-ade616f365d3 None None] MFA Rules not processed for user `3252c48fdd5747a29fe4ba89e7162216`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:58:04.927501 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-ac7233ef-9729-46d7-94fa-ade616f365d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:58:04.998313 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1375/2759] 10.222.0.43 () {58 vars in 967 bytes} [Mon Apr 11 16:58:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:58:05.039840 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea0bc7-3e85-4f38-9fc0-d51068021ef6 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:58:05.041251 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-7dea0bc7-3e85-4f38-9fc0-d51068021ef6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:58:05.130233 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea0bc7-3e85-4f38-9fc0-d51068021ef6 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:58:05.135174 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3039be8d-e33a-4617-b997-6a7f1057b37e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb193a1a7abd430fbbcccab970e4f37c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:58:05.135849 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3039be8d-e33a-4617-b997-6a7f1057b37e service swift] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:58:05.136127 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3039be8d-e33a-4617-b997-6a7f1057b37e service swift] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:58:05.136399 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3039be8d-e33a-4617-b997-6a7f1057b37e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:58:05.145104 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3039be8d-e33a-4617-b997-6a7f1057b37e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:58:05.146663 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3039be8d-e33a-4617-b997-6a7f1057b37e service swift] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:58:05.154888 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1385/2760] 10.222.0.43 () {60 vars in 1384 bytes} [Mon Apr 11 16:58:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 11 16:58:14.095010 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7233ef-9729-46d7-94fa-ade616f365d3 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:58:14.095010 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-ac7233ef-9729-46d7-94fa-ade616f365d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:58:14.109012 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7233ef-9729-46d7-94fa-ade616f365d3 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:58:14.113467 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d6965f-e045-418a-bbd1-41e505d8100f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:58:14.114346 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d6965f-e045-418a-bbd1-41e505d8100f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:58:14.114633 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d6965f-e045-418a-bbd1-41e505d8100f admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:58:14.114920 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d6965f-e045-418a-bbd1-41e505d8100f admin admin] PATH_INFO: `/v3/users/85b65e4e233c4b308e128c8e246d58dc` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:58:14.116151 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d6965f-e045-418a-bbd1-41e505d8100f admin admin] RBAC: Authorizing `identity:delete_user(user_id=85b65e4e233c4b308e128c8e246d58dc)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:58:14.118228 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d6965f-e045-418a-bbd1-41e505d8100f admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:58:14.367711 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b5d6965f-e045-418a-bbd1-41e505d8100f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85b65e4e233c4b308e128c8e246d58dc'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:58:14.444541 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b5d6965f-e045-418a-bbd1-41e505d8100f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85b65e4e233c4b308e128c8e246d58dc'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:58:14.452731 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b5d6965f-e045-418a-bbd1-41e505d8100f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85b65e4e233c4b308e128c8e246d58dc'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:58:14.453365 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b5d6965f-e045-418a-bbd1-41e505d8100f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85b65e4e233c4b308e128c8e246d58dc'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:58:14.465078 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b5d6965f-e045-418a-bbd1-41e505d8100f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85b65e4e233c4b308e128c8e246d58dc'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:58:14.471749 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1376/2761] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:58:14 2022] DELETE /identity/v3/users/85b65e4e233c4b308e128c8e246d58dc => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:58:14.743495 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3039be8d-e33a-4617-b997-6a7f1057b37e service swift] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:58:14.756120 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3039be8d-e33a-4617-b997-6a7f1057b37e service swift] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:58:14.813240 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2de98a7-7161-4d1b-acde-2accaa9545af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:58:14.814099 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de98a7-7161-4d1b-acde-2accaa9545af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:58:14.814376 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de98a7-7161-4d1b-acde-2accaa9545af admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:58:14.814647 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de98a7-7161-4d1b-acde-2accaa9545af admin admin] PATH_INFO: `/v3/projects/dda959d146164e97855de4f0d05a0516` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:58:14.815843 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2de98a7-7161-4d1b-acde-2accaa9545af admin admin] RBAC: Authorizing `identity:delete_project(project_id=dda959d146164e97855de4f0d05a0516)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:58:14.819289 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2de98a7-7161-4d1b-acde-2accaa9545af admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:58:15.130593 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c2de98a7-7161-4d1b-acde-2accaa9545af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dda959d146164e97855de4f0d05a0516', 'request_id': 'req-c2de98a7-7161-4d1b-acde-2accaa9545af'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:58:15.136732 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c2de98a7-7161-4d1b-acde-2accaa9545af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dda959d146164e97855de4f0d05a0516', 'request_id': 'req-c2de98a7-7161-4d1b-acde-2accaa9545af'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:58:15.250482 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c2de98a7-7161-4d1b-acde-2accaa9545af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dda959d146164e97855de4f0d05a0516', 'request_id': 'req-c2de98a7-7161-4d1b-acde-2accaa9545af'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:58:15.261837 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c2de98a7-7161-4d1b-acde-2accaa9545af admin admin] The token cache is being invalidate because project dda959d146164e97855de4f0d05a0516 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:58:15.262644 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c2de98a7-7161-4d1b-acde-2accaa9545af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:58:15.262846 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c2de98a7-7161-4d1b-acde-2accaa9545af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:58:15.264530 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1386/2762] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:58:14 2022] DELETE /identity/v3/projects/dda959d146164e97855de4f0d05a0516 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:58:15.268521 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d6965f-e045-418a-bbd1-41e505d8100f admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:58:15.269943 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-b5d6965f-e045-418a-bbd1-41e505d8100f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:58:15.283968 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d6965f-e045-418a-bbd1-41e505d8100f admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:58:15.340760 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf52011-6316-4e40-8e64-d11598ac92b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:58:15.341633 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf52011-6316-4e40-8e64-d11598ac92b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:58:15.341916 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf52011-6316-4e40-8e64-d11598ac92b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:58:15.342194 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf52011-6316-4e40-8e64-d11598ac92b3 admin admin] PATH_INFO: `/v3/users/85d28fbdf735462399b63f053d787a4a` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:58:15.344111 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf52011-6316-4e40-8e64-d11598ac92b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85d28fbdf735462399b63f053d787a4a)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:58:15.346044 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf52011-6316-4e40-8e64-d11598ac92b3 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:58:15.552873 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-0cf52011-6316-4e40-8e64-d11598ac92b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85d28fbdf735462399b63f053d787a4a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:58:15.657005 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-0cf52011-6316-4e40-8e64-d11598ac92b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85d28fbdf735462399b63f053d787a4a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:58:15.664899 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-0cf52011-6316-4e40-8e64-d11598ac92b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85d28fbdf735462399b63f053d787a4a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:58:15.668684 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-0cf52011-6316-4e40-8e64-d11598ac92b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85d28fbdf735462399b63f053d787a4a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:58:15.677673 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-0cf52011-6316-4e40-8e64-d11598ac92b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85d28fbdf735462399b63f053d787a4a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:58:15.683596 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1377/2763] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 16:58:15 2022] DELETE /identity/v3/users/85d28fbdf735462399b63f053d787a4a => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:58:15.960610 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2de98a7-7161-4d1b-acde-2accaa9545af admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:58:15.965043 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-c2de98a7-7161-4d1b-acde-2accaa9545af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:58:15.976300 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2de98a7-7161-4d1b-acde-2accaa9545af admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:58:16.038213 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557034eb-62dd-4a57-aa87-b31e2e61a9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:58:16.039079 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557034eb-62dd-4a57-aa87-b31e2e61a9be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:58:16.039359 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557034eb-62dd-4a57-aa87-b31e2e61a9be admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:58:16.039667 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557034eb-62dd-4a57-aa87-b31e2e61a9be admin admin] PATH_INFO: `/v3/projects/0b7e7755430140048ee1566c5fd7e82b` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:58:16.040844 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557034eb-62dd-4a57-aa87-b31e2e61a9be admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b7e7755430140048ee1566c5fd7e82b)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:58:16.042764 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557034eb-62dd-4a57-aa87-b31e2e61a9be admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:58:16.167313 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-557034eb-62dd-4a57-aa87-b31e2e61a9be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b7e7755430140048ee1566c5fd7e82b', 'request_id': 'req-557034eb-62dd-4a57-aa87-b31e2e61a9be'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:58:16.172941 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-557034eb-62dd-4a57-aa87-b31e2e61a9be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b7e7755430140048ee1566c5fd7e82b', 'request_id': 'req-557034eb-62dd-4a57-aa87-b31e2e61a9be'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:58:16.259110 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-557034eb-62dd-4a57-aa87-b31e2e61a9be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b7e7755430140048ee1566c5fd7e82b', 'request_id': 'req-557034eb-62dd-4a57-aa87-b31e2e61a9be'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:58:16.271414 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-557034eb-62dd-4a57-aa87-b31e2e61a9be admin admin] The token cache is being invalidate because project 0b7e7755430140048ee1566c5fd7e82b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:58:16.271726 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-557034eb-62dd-4a57-aa87-b31e2e61a9be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:58:16.272361 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-557034eb-62dd-4a57-aa87-b31e2e61a9be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:58:16.273929 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1387/2764] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 16:58:15 2022] DELETE /identity/v3/projects/0b7e7755430140048ee1566c5fd7e82b => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:58:50.561765 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf52011-6316-4e40-8e64-d11598ac92b3 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:58:50.563258 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-0cf52011-6316-4e40-8e64-d11598ac92b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:58:50.622136 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf52011-6316-4e40-8e64-d11598ac92b3 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:58:50.669918 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f92eff-a978-4c58-9426-ef61dbb8d137 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:58:50.670626 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f92eff-a978-4c58-9426-ef61dbb8d137 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:58:50.670915 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f92eff-a978-4c58-9426-ef61dbb8d137 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:58:50.671196 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f92eff-a978-4c58-9426-ef61dbb8d137 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:58:50.673032 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-d7f92eff-a978-4c58-9426-ef61dbb8d137 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:58:50.753377 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f92eff-a978-4c58-9426-ef61dbb8d137 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:58:50.754730 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f92eff-a978-4c58-9426-ef61dbb8d137 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:58:50.775201 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1378/2765] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:58:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 16:58:51.954970 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557034eb-62dd-4a57-aa87-b31e2e61a9be admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:58:51.956503 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-557034eb-62dd-4a57-aa87-b31e2e61a9be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:58:51.968965 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557034eb-62dd-4a57-aa87-b31e2e61a9be admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:58:51.972606 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0038ccfc-cb48-4f34-a582-36581bfd4ff0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:58:51.973246 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0038ccfc-cb48-4f34-a582-36581bfd4ff0 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:58:51.973535 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0038ccfc-cb48-4f34-a582-36581bfd4ff0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:58:51.973813 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0038ccfc-cb48-4f34-a582-36581bfd4ff0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:58:51.975624 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0038ccfc-cb48-4f34-a582-36581bfd4ff0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:58:51.989176 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0038ccfc-cb48-4f34-a582-36581bfd4ff0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:58:51.990587 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0038ccfc-cb48-4f34-a582-36581bfd4ff0 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:58:52.002265 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1388/2766] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:58:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:58:55.424828 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cea7d2-cad2-471b-9793-a6cfdf24e396 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:58:55.425317 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cea7d2-cad2-471b-9793-a6cfdf24e396 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:58:55.425419 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cea7d2-cad2-471b-9793-a6cfdf24e396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:58:55.443652 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-32cea7d2-cad2-471b-9793-a6cfdf24e396 None None] MFA Rules not processed for user `25e7976dd30c4c2688a681474b766461`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:58:55.444851 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-32cea7d2-cad2-471b-9793-a6cfdf24e396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:58:55.506864 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1379/2767] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 16:58:55 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:58:56.596508 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0038ccfc-cb48-4f34-a582-36581bfd4ff0 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:58:56.597904 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0038ccfc-cb48-4f34-a582-36581bfd4ff0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:58:56.671375 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0038ccfc-cb48-4f34-a582-36581bfd4ff0 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:58:56.677155 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471042af-36b6-404f-b3bc-1fad558333ec service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6589debd41bf496085c7339ab5409666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:58:56.677906 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471042af-36b6-404f-b3bc-1fad558333ec service placement] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:58:56.678190 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471042af-36b6-404f-b3bc-1fad558333ec service placement] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:58:56.678470 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471042af-36b6-404f-b3bc-1fad558333ec service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:58:56.681398 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-471042af-36b6-404f-b3bc-1fad558333ec service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:58:56.693219 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471042af-36b6-404f-b3bc-1fad558333ec service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:58:56.694755 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471042af-36b6-404f-b3bc-1fad558333ec service placement] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:58:56.705409 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1389/2768] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:58:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:58:59.899969 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cea7d2-cad2-471b-9793-a6cfdf24e396 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:58:59.921694 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cea7d2-cad2-471b-9793-a6cfdf24e396 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:58:59.928275 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1de06f-c700-47b5-afee-ad341aadefc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:58:59.928275 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1de06f-c700-47b5-afee-ad341aadefc7 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:58:59.928275 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1de06f-c700-47b5-afee-ad341aadefc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:58:59.928275 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1de06f-c700-47b5-afee-ad341aadefc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:58:59.930487 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-5f1de06f-c700-47b5-afee-ad341aadefc7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:58:59.945176 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1de06f-c700-47b5-afee-ad341aadefc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:58:59.946720 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1de06f-c700-47b5-afee-ad341aadefc7 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:58:59.957519 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1380/2769] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 16:58:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 17:00:17.529868 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471042af-36b6-404f-b3bc-1fad558333ec service placement] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:00:17.532386 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-471042af-36b6-404f-b3bc-1fad558333ec service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:00:17.556305 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471042af-36b6-404f-b3bc-1fad558333ec service placement] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:00:17.566029 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced44b9-7c68-4e19-927c-522459eec1d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1be2652c984a4283aeee0b937f0555e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:00:17.571683 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced44b9-7c68-4e19-927c-522459eec1d0 service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:00:17.571683 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced44b9-7c68-4e19-927c-522459eec1d0 service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:00:17.571683 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced44b9-7c68-4e19-927c-522459eec1d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:00:17.571683 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0ced44b9-7c68-4e19-927c-522459eec1d0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:00:17.594469 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ced44b9-7c68-4e19-927c-522459eec1d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:00:17.600674 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ced44b9-7c68-4e19-927c-522459eec1d0 service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:00:17.619992 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1390/2770] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 17:00:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 17:00:22.859607 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91241ce-48a1-478a-b4b8-73ddb163ba45 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:00:22.860627 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91241ce-48a1-478a-b4b8-73ddb163ba45 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:00:22.860627 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91241ce-48a1-478a-b4b8-73ddb163ba45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:00:22.880492 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-a91241ce-48a1-478a-b4b8-73ddb163ba45 None None] MFA Rules not processed for user `fb07a1ed0154461ea06c835552186a52`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 17:00:22.888782 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-a91241ce-48a1-478a-b4b8-73ddb163ba45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:00:22.940361 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1381/2771] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 17:00:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 17:00:23.280500 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced44b9-7c68-4e19-927c-522459eec1d0 service nova] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:00:23.282043 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0ced44b9-7c68-4e19-927c-522459eec1d0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:00:23.295375 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced44b9-7c68-4e19-927c-522459eec1d0 service nova] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:00:23.298997 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af93fdca-104b-4a11-81c6-b00cec286624 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:00:23.299686 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93fdca-104b-4a11-81c6-b00cec286624 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:00:23.299971 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93fdca-104b-4a11-81c6-b00cec286624 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:00:23.300247 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93fdca-104b-4a11-81c6-b00cec286624 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:00:23.302031 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-af93fdca-104b-4a11-81c6-b00cec286624 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:00:23.313000 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af93fdca-104b-4a11-81c6-b00cec286624 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:00:23.314424 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af93fdca-104b-4a11-81c6-b00cec286624 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:00:23.322840 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1391/2772] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 17:00:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 17:00:35.304525 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91241ce-48a1-478a-b4b8-73ddb163ba45 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:00:35.306027 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-a91241ce-48a1-478a-b4b8-73ddb163ba45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:00:35.322759 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91241ce-48a1-478a-b4b8-73ddb163ba45 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:00:35.328232 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4106174-cde3-4a84-9c5f-cc38085f88c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1be2652c984a4283aeee0b937f0555e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:00:35.328886 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4106174-cde3-4a84-9c5f-cc38085f88c9 service nova] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:00:35.329171 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4106174-cde3-4a84-9c5f-cc38085f88c9 service nova] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:00:35.329446 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4106174-cde3-4a84-9c5f-cc38085f88c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:00:35.331193 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-f4106174-cde3-4a84-9c5f-cc38085f88c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:00:35.343303 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4106174-cde3-4a84-9c5f-cc38085f88c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:00:35.344969 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4106174-cde3-4a84-9c5f-cc38085f88c9 service nova] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:00:35.355710 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1382/2773] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 17:00:35 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 17:00:35.812113 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af93fdca-104b-4a11-81c6-b00cec286624 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:00:35.825715 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af93fdca-104b-4a11-81c6-b00cec286624 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:00:35.831385 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad173baf-0c1f-4a44-865e-6f5fb9db280e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1be2652c984a4283aeee0b937f0555e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:00:35.832300 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad173baf-0c1f-4a44-865e-6f5fb9db280e service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:00:35.832429 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad173baf-0c1f-4a44-865e-6f5fb9db280e service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:00:35.832702 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad173baf-0c1f-4a44-865e-6f5fb9db280e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:00:35.834632 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ad173baf-0c1f-4a44-865e-6f5fb9db280e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:00:35.847710 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad173baf-0c1f-4a44-865e-6f5fb9db280e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:00:35.849307 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad173baf-0c1f-4a44-865e-6f5fb9db280e service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:00:35.861311 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1392/2774] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 17:00:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 17:01:08.656388 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4106174-cde3-4a84-9c5f-cc38085f88c9 service nova] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:01:08.657989 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-f4106174-cde3-4a84-9c5f-cc38085f88c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:01:08.759509 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4106174-cde3-4a84-9c5f-cc38085f88c9 service nova] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:01:08.763734 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45050f03-03b8-45a8-842a-b821f8706f1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '950b5b5f690d41509ead753065a0b793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:01:08.764480 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45050f03-03b8-45a8-842a-b821f8706f1c service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:01:08.764799 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45050f03-03b8-45a8-842a-b821f8706f1c service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:01:08.765201 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45050f03-03b8-45a8-842a-b821f8706f1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:01:08.767459 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-45050f03-03b8-45a8-842a-b821f8706f1c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:01:08.780448 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45050f03-03b8-45a8-842a-b821f8706f1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:01:08.782046 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45050f03-03b8-45a8-842a-b821f8706f1c service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:01:08.793010 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1383/2775] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 17:01:08 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 17:01:21.591297 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e32884-5756-4489-a7c4-dd0813e39f0a None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:01:21.592283 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e32884-5756-4489-a7c4-dd0813e39f0a None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:01:21.592283 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e32884-5756-4489-a7c4-dd0813e39f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:01:21.613507 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-a6e32884-5756-4489-a7c4-dd0813e39f0a None None] MFA Rules not processed for user `25e7976dd30c4c2688a681474b766461`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 17:01:21.614830 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a6e32884-5756-4489-a7c4-dd0813e39f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:01:21.622729 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1393/2776] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 17:01:21 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 17:01:21.996948 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45050f03-03b8-45a8-842a-b821f8706f1c service cinder] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:01:22.006887 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45050f03-03b8-45a8-842a-b821f8706f1c service cinder] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:01:22.011493 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ab1f8-0138-486c-be7d-dba481232371 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:01:22.012190 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ab1f8-0138-486c-be7d-dba481232371 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:01:22.012486 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ab1f8-0138-486c-be7d-dba481232371 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:01:22.012747 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ab1f8-0138-486c-be7d-dba481232371 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:01:22.014617 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-f12ab1f8-0138-486c-be7d-dba481232371 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:01:22.025323 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12ab1f8-0138-486c-be7d-dba481232371 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:01:22.026936 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12ab1f8-0138-486c-be7d-dba481232371 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:01:22.036034 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1384/2777] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 17:01:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 17:01:28.085748 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e32884-5756-4489-a7c4-dd0813e39f0a None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:01:28.099068 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e32884-5756-4489-a7c4-dd0813e39f0a None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:01:28.109813 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ebda35-bef9-40f4-a343-3dfae97df64a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6589debd41bf496085c7339ab5409666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:01:28.110622 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ebda35-bef9-40f4-a343-3dfae97df64a service placement] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:01:28.110967 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ebda35-bef9-40f4-a343-3dfae97df64a service placement] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:01:28.111321 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ebda35-bef9-40f4-a343-3dfae97df64a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:01:28.113763 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-61ebda35-bef9-40f4-a343-3dfae97df64a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:01:28.129443 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ebda35-bef9-40f4-a343-3dfae97df64a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:01:28.131548 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ebda35-bef9-40f4-a343-3dfae97df64a service placement] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:01:28.145871 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1394/2778] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 17:01:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 17:01:47.698199 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ab1f8-0138-486c-be7d-dba481232371 service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:01:47.706958 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ab1f8-0138-486c-be7d-dba481232371 service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:01:47.711411 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c304a9-a9fd-47fa-bc79-571b889e28b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:01:47.712165 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c304a9-a9fd-47fa-bc79-571b889e28b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:01:47.712571 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c304a9-a9fd-47fa-bc79-571b889e28b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:01:47.712911 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c304a9-a9fd-47fa-bc79-571b889e28b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:01:47.715057 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-83c304a9-a9fd-47fa-bc79-571b889e28b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:01:47.786666 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c304a9-a9fd-47fa-bc79-571b889e28b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:01:47.788266 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c304a9-a9fd-47fa-bc79-571b889e28b1 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:01:47.798903 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1385/2779] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 17:01:47 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 17:01:49.949245 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ebda35-bef9-40f4-a343-3dfae97df64a service placement] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:01:49.993438 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ebda35-bef9-40f4-a343-3dfae97df64a service placement] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:01:49.993438 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b706f3c-36f1-4251-b158-08d338835c08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1be2652c984a4283aeee0b937f0555e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:01:49.993438 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b706f3c-36f1-4251-b158-08d338835c08 service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:01:49.993438 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b706f3c-36f1-4251-b158-08d338835c08 service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:01:49.994396 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b706f3c-36f1-4251-b158-08d338835c08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:01:49.994396 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-5b706f3c-36f1-4251-b158-08d338835c08 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:01:49.994396 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b706f3c-36f1-4251-b158-08d338835c08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:01:49.994396 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b706f3c-36f1-4251-b158-08d338835c08 service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:01:50.003110 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1395/2780] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 17:01:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 17:02:47.700132 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c304a9-a9fd-47fa-bc79-571b889e28b1 service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:02:47.709503 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c304a9-a9fd-47fa-bc79-571b889e28b1 service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:02:47.713268 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e00b5d8-0e7b-4804-be5a-df596c174d30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:02:47.713963 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00b5d8-0e7b-4804-be5a-df596c174d30 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:47.714246 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00b5d8-0e7b-4804-be5a-df596c174d30 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:47.714522 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00b5d8-0e7b-4804-be5a-df596c174d30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:47.716547 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-6e00b5d8-0e7b-4804-be5a-df596c174d30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:02:47.782827 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e00b5d8-0e7b-4804-be5a-df596c174d30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:02:47.784282 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e00b5d8-0e7b-4804-be5a-df596c174d30 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:02:47.795592 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1386/2781] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 17:02:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 17:02:51.686243 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b706f3c-36f1-4251-b158-08d338835c08 service nova] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:02:51.687718 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-5b706f3c-36f1-4251-b158-08d338835c08 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:02:51.701865 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b706f3c-36f1-4251-b158-08d338835c08 service nova] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:02:51.706614 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea8c9e6-bb3b-48d5-94d6-9114438d9bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:02:51.707493 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea8c9e6-bb3b-48d5-94d6-9114438d9bab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:51.707850 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea8c9e6-bb3b-48d5-94d6-9114438d9bab admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:51.708717 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea8c9e6-bb3b-48d5-94d6-9114438d9bab admin admin] PATH_INFO: `/v3/users/fb07a1ed0154461ea06c835552186a52` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:51.710051 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea8c9e6-bb3b-48d5-94d6-9114438d9bab admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb07a1ed0154461ea06c835552186a52)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:02:51.712063 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea8c9e6-bb3b-48d5-94d6-9114438d9bab admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:02:51.881560 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-3ea8c9e6-bb3b-48d5-94d6-9114438d9bab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb07a1ed0154461ea06c835552186a52'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:51.882261 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-3ea8c9e6-bb3b-48d5-94d6-9114438d9bab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb07a1ed0154461ea06c835552186a52'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:51.940423 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-3ea8c9e6-bb3b-48d5-94d6-9114438d9bab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb07a1ed0154461ea06c835552186a52'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:51.949024 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-3ea8c9e6-bb3b-48d5-94d6-9114438d9bab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb07a1ed0154461ea06c835552186a52'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:51.962058 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-3ea8c9e6-bb3b-48d5-94d6-9114438d9bab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb07a1ed0154461ea06c835552186a52'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:51.969926 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1396/2782] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 17:02:51 2022] DELETE /identity/v3/users/fb07a1ed0154461ea06c835552186a52 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 17:02:52.247812 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e00b5d8-0e7b-4804-be5a-df596c174d30 service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:02:52.260545 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e00b5d8-0e7b-4804-be5a-df596c174d30 service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:02:52.320221 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4132bc-1dac-410c-b56f-9ebeae5d73c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:02:52.321095 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4132bc-1dac-410c-b56f-9ebeae5d73c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:52.321377 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4132bc-1dac-410c-b56f-9ebeae5d73c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:52.321655 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4132bc-1dac-410c-b56f-9ebeae5d73c0 admin admin] PATH_INFO: `/v3/projects/d7c652a8e00241a68c25698bca5e7ffe` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:52.322868 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4132bc-1dac-410c-b56f-9ebeae5d73c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7c652a8e00241a68c25698bca5e7ffe)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:02:52.324807 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4132bc-1dac-410c-b56f-9ebeae5d73c0 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:02:52.456412 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-4c4132bc-1dac-410c-b56f-9ebeae5d73c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7c652a8e00241a68c25698bca5e7ffe', 'request_id': 'req-4c4132bc-1dac-410c-b56f-9ebeae5d73c0'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:52.547330 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-4c4132bc-1dac-410c-b56f-9ebeae5d73c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7c652a8e00241a68c25698bca5e7ffe', 'request_id': 'req-4c4132bc-1dac-410c-b56f-9ebeae5d73c0'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:52.554234 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-4c4132bc-1dac-410c-b56f-9ebeae5d73c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7c652a8e00241a68c25698bca5e7ffe', 'request_id': 'req-4c4132bc-1dac-410c-b56f-9ebeae5d73c0'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:52.566817 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-4c4132bc-1dac-410c-b56f-9ebeae5d73c0 admin admin] The token cache is being invalidate because project d7c652a8e00241a68c25698bca5e7ffe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 17:02:52.567100 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-4c4132bc-1dac-410c-b56f-9ebeae5d73c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:52.567804 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-4c4132bc-1dac-410c-b56f-9ebeae5d73c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:52.569360 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1387/2783] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 17:02:52 2022] DELETE /identity/v3/projects/d7c652a8e00241a68c25698bca5e7ffe => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 17:02:52.575050 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d932c0f-1cb2-4aa8-879c-2adabc42421f None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:52.575384 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d932c0f-1cb2-4aa8-879c-2adabc42421f None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:52.575792 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d932c0f-1cb2-4aa8-879c-2adabc42421f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:52.594175 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-0d932c0f-1cb2-4aa8-879c-2adabc42421f None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 17:02:52.595375 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0d932c0f-1cb2-4aa8-879c-2adabc42421f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:02:52.653074 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1397/2784] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 17:02:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 17:02:52.662717 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee0452-c7fd-4259-82be-a1e45642daac None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:52.663045 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee0452-c7fd-4259-82be-a1e45642daac None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:52.663340 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee0452-c7fd-4259-82be-a1e45642daac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:52.682750 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-89ee0452-c7fd-4259-82be-a1e45642daac None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 17:02:52.684081 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-89ee0452-c7fd-4259-82be-a1e45642daac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:02:52.692728 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1388/2785] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 17:02:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 17:02:52.697195 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d932c0f-1cb2-4aa8-879c-2adabc42421f None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:02:52.706995 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d932c0f-1cb2-4aa8-879c-2adabc42421f None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:02:52.712414 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd551e66-980a-4cda-a1fa-8b61b6e702a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:02:52.713077 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd551e66-980a-4cda-a1fa-8b61b6e702a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:52.713366 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd551e66-980a-4cda-a1fa-8b61b6e702a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:52.713643 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd551e66-980a-4cda-a1fa-8b61b6e702a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:52.714372 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd551e66-980a-4cda-a1fa-8b61b6e702a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 17:02:52.714681 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd551e66-980a-4cda-a1fa-8b61b6e702a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:02:52.716319 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd551e66-980a-4cda-a1fa-8b61b6e702a3 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:02:52.727790 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1398/2786] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Apr 11 17:02:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 17:02:52.733281 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ee0452-c7fd-4259-82be-a1e45642daac None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:02:52.743923 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ee0452-c7fd-4259-82be-a1e45642daac None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:02:52.749145 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fcca1c-6cc8-44eb-9572-b317d4fbef51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:02:52.749816 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fcca1c-6cc8-44eb-9572-b317d4fbef51 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:52.750111 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fcca1c-6cc8-44eb-9572-b317d4fbef51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:52.750393 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fcca1c-6cc8-44eb-9572-b317d4fbef51 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:52.751090 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fcca1c-6cc8-44eb-9572-b317d4fbef51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:02:52.753055 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fcca1c-6cc8-44eb-9572-b317d4fbef51 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:02:52.851304 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1389/2787] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 17:02:52 2022] POST /identity/v3/projects => generated 385 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 17:02:52.855455 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd551e66-980a-4cda-a1fa-8b61b6e702a3 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:02:52.866106 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd551e66-980a-4cda-a1fa-8b61b6e702a3 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:02:52.921636 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefb434f-53f3-4747-8844-620f756403ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:02:52.922310 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb434f-53f3-4747-8844-620f756403ed admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:52.922600 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb434f-53f3-4747-8844-620f756403ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:52.922884 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb434f-53f3-4747-8844-620f756403ed admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:52.923621 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefb434f-53f3-4747-8844-620f756403ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:02:52.925525 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefb434f-53f3-4747-8844-620f756403ed admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:02:53.015661 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1399/2788] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 17:02:52 2022] POST /identity/v3/users => generated 293 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 17:02:53.019939 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fcca1c-6cc8-44eb-9572-b317d4fbef51 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:02:53.031302 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fcca1c-6cc8-44eb-9572-b317d4fbef51 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:02:53.036693 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5277bff7-4676-4dbd-88ee-59388fdc23da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:02:53.037488 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277bff7-4676-4dbd-88ee-59388fdc23da admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:53.037770 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277bff7-4676-4dbd-88ee-59388fdc23da admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:53.038049 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277bff7-4676-4dbd-88ee-59388fdc23da admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:53.038784 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5277bff7-4676-4dbd-88ee-59388fdc23da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:02:53.040396 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5277bff7-4676-4dbd-88ee-59388fdc23da admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:02:53.050535 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1390/2789] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 17:02:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 17:02:53.054943 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefb434f-53f3-4747-8844-620f756403ed admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:02:53.065826 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefb434f-53f3-4747-8844-620f756403ed admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:02:53.071161 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902ee5e1-e308-4a3b-9b5f-f456b26e06f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:02:53.071866 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ee5e1-e308-4a3b-9b5f-f456b26e06f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:53.072268 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ee5e1-e308-4a3b-9b5f-f456b26e06f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:53.072555 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ee5e1-e308-4a3b-9b5f-f456b26e06f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:53.073399 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902ee5e1-e308-4a3b-9b5f-f456b26e06f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:02:53.074995 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902ee5e1-e308-4a3b-9b5f-f456b26e06f5 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:02:53.086204 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1400/2790] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 17:02:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 17:02:53.090630 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5277bff7-4676-4dbd-88ee-59388fdc23da admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:02:53.101448 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5277bff7-4676-4dbd-88ee-59388fdc23da admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:02:53.107495 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebae4b5e-f495-4896-ab48-7e12048c0536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:02:53.108415 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae4b5e-f495-4896-ab48-7e12048c0536 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:53.108701 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae4b5e-f495-4896-ab48-7e12048c0536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:53.108973 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae4b5e-f495-4896-ab48-7e12048c0536 admin admin] PATH_INFO: `/v3/projects/81d592a72e6f4e3a8555bd82765c85f9/users/f8a1e19d5f1d4ed8885b813c1e05f5f3/roles/0d41da7bec094450b5bff4e4831be52c` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:53.124360 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebae4b5e-f495-4896-ab48-7e12048c0536 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81d592a72e6f4e3a8555bd82765c85f9, user_id=f8a1e19d5f1d4ed8885b813c1e05f5f3, role_id=0d41da7bec094450b5bff4e4831be52c)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:02:53.127036 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebae4b5e-f495-4896-ab48-7e12048c0536 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:02:53.233480 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1391/2791] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 17:02:53 2022] PUT /identity/v3/projects/81d592a72e6f4e3a8555bd82765c85f9/users/f8a1e19d5f1d4ed8885b813c1e05f5f3/roles/0d41da7bec094450b5bff4e4831be52c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 17:02:53.239612 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce7abd-7c12-41e9-9ae3-04da8f30297a None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:53.240627 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce7abd-7c12-41e9-9ae3-04da8f30297a None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:53.240627 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce7abd-7c12-41e9-9ae3-04da8f30297a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:53.258671 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-09ce7abd-7c12-41e9-9ae3-04da8f30297a None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 17:02:53.260006 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-09ce7abd-7c12-41e9-9ae3-04da8f30297a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:02:53.321403 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1401/2792] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 17:02:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 17:02:53.331066 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebae4b5e-f495-4896-ab48-7e12048c0536 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:02:53.332911 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-ebae4b5e-f495-4896-ab48-7e12048c0536 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:02:53.389776 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebae4b5e-f495-4896-ab48-7e12048c0536 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:02:53.393729 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e3e144-c2b9-4300-9489-7a062cc2a631 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:02:53.394378 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3e144-c2b9-4300-9489-7a062cc2a631 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:53.394809 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3e144-c2b9-4300-9489-7a062cc2a631 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:53.395090 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3e144-c2b9-4300-9489-7a062cc2a631 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:53.405187 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e3e144-c2b9-4300-9489-7a062cc2a631 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:02:53.406869 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e3e144-c2b9-4300-9489-7a062cc2a631 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:02:53.417084 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1392/2793] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 17:02:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 17:02:58.933192 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9322be69-5736-4e74-aebe-3b2ff05190de None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:58.933655 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9322be69-5736-4e74-aebe-3b2ff05190de None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:58.933820 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9322be69-5736-4e74-aebe-3b2ff05190de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:58.962942 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-9322be69-5736-4e74-aebe-3b2ff05190de None None] MFA Rules not processed for user `f8a1e19d5f1d4ed8885b813c1e05f5f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 17:02:58.964205 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-9322be69-5736-4e74-aebe-3b2ff05190de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:02:59.033111 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1402/2794] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 17:02:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 17:02:59.044771 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e3e144-c2b9-4300-9489-7a062cc2a631 service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:02:59.046763 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-a9e3e144-c2b9-4300-9489-7a062cc2a631 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:02:59.119319 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e3e144-c2b9-4300-9489-7a062cc2a631 service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:02:59.125003 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee702a0e-1fce-4835-a2f0-211c7a0df864 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1be2652c984a4283aeee0b937f0555e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:02:59.125656 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee702a0e-1fce-4835-a2f0-211c7a0df864 service nova] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:59.125942 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee702a0e-1fce-4835-a2f0-211c7a0df864 service nova] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:59.126224 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee702a0e-1fce-4835-a2f0-211c7a0df864 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:59.135019 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee702a0e-1fce-4835-a2f0-211c7a0df864 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:02:59.136710 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee702a0e-1fce-4835-a2f0-211c7a0df864 service nova] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:02:59.146263 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1393/2795] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 17:02:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 17:03:01.829887 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9168912d-0353-4ff2-937f-93fe016a9b57 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:03:01.830454 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9168912d-0353-4ff2-937f-93fe016a9b57 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:03:01.830454 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9168912d-0353-4ff2-937f-93fe016a9b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:03:01.848974 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-9168912d-0353-4ff2-937f-93fe016a9b57 None None] MFA Rules not processed for user `f8a1e19d5f1d4ed8885b813c1e05f5f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 17:03:01.850196 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-9168912d-0353-4ff2-937f-93fe016a9b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:03:01.857408 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1403/2796] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 17:03:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 17:03:52.226471 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee702a0e-1fce-4835-a2f0-211c7a0df864 service nova] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:03:52.236377 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee702a0e-1fce-4835-a2f0-211c7a0df864 service nova] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:03:52.240220 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38b8248-219c-4816-86b5-888b8a76e853 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:03:52.240875 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b8248-219c-4816-86b5-888b8a76e853 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:03:52.241159 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b8248-219c-4816-86b5-888b8a76e853 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:03:52.241443 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b8248-219c-4816-86b5-888b8a76e853 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:03:52.243249 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-a38b8248-219c-4816-86b5-888b8a76e853 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:03:52.258273 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38b8248-219c-4816-86b5-888b8a76e853 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:03:52.259956 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38b8248-219c-4816-86b5-888b8a76e853 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:03:52.272681 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1394/2797] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 17:03:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 17:03:53.453297 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9168912d-0353-4ff2-937f-93fe016a9b57 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:03:53.454767 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-9168912d-0353-4ff2-937f-93fe016a9b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:03:53.467193 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9168912d-0353-4ff2-937f-93fe016a9b57 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:03:53.470851 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddeaca3-eef2-4a62-a586-14b8a09b8ae4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:03:53.472547 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddeaca3-eef2-4a62-a586-14b8a09b8ae4 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:03:53.472836 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddeaca3-eef2-4a62-a586-14b8a09b8ae4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:03:53.473112 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddeaca3-eef2-4a62-a586-14b8a09b8ae4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:03:53.474908 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-9ddeaca3-eef2-4a62-a586-14b8a09b8ae4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:03:53.488863 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddeaca3-eef2-4a62-a586-14b8a09b8ae4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:03:53.490297 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddeaca3-eef2-4a62-a586-14b8a09b8ae4 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:03:53.502013 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1404/2798] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 17:03:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 17:03:59.337595 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38b8248-219c-4816-86b5-888b8a76e853 service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:03:59.346674 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38b8248-219c-4816-86b5-888b8a76e853 service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:03:59.350360 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c01b0cc-8871-4fb7-b0be-e00a3f62cabb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:03:59.351034 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c01b0cc-8871-4fb7-b0be-e00a3f62cabb service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:03:59.351339 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c01b0cc-8871-4fb7-b0be-e00a3f62cabb service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:03:59.351842 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c01b0cc-8871-4fb7-b0be-e00a3f62cabb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:03:59.353689 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-1c01b0cc-8871-4fb7-b0be-e00a3f62cabb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:03:59.365704 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c01b0cc-8871-4fb7-b0be-e00a3f62cabb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:03:59.367188 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c01b0cc-8871-4fb7-b0be-e00a3f62cabb service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:03:59.376573 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1395/2799] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 17:03:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 17:04:05.215858 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddeaca3-eef2-4a62-a586-14b8a09b8ae4 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:04:05.225342 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddeaca3-eef2-4a62-a586-14b8a09b8ae4 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:04:05.229078 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa297924-b72f-4bd8-83b3-8be472d937b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:04:05.229733 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa297924-b72f-4bd8-83b3-8be472d937b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:04:05.230019 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa297924-b72f-4bd8-83b3-8be472d937b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:04:05.230298 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa297924-b72f-4bd8-83b3-8be472d937b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:04:05.232294 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-fa297924-b72f-4bd8-83b3-8be472d937b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:04:05.244430 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa297924-b72f-4bd8-83b3-8be472d937b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:04:05.245855 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa297924-b72f-4bd8-83b3-8be472d937b8 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:04:05.256293 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1405/2800] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 17:04:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 17:04:12.940411 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c01b0cc-8871-4fb7-b0be-e00a3f62cabb service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:04:12.942500 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-1c01b0cc-8871-4fb7-b0be-e00a3f62cabb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:04:12.957689 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c01b0cc-8871-4fb7-b0be-e00a3f62cabb service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:04:12.962428 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85db7690-32a6-4222-94fb-4dc2271a6eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:04:12.963303 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db7690-32a6-4222-94fb-4dc2271a6eb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:04:12.963624 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db7690-32a6-4222-94fb-4dc2271a6eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:04:12.963903 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db7690-32a6-4222-94fb-4dc2271a6eb4 admin admin] PATH_INFO: `/v3/users/25e7976dd30c4c2688a681474b766461` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:04:12.965093 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85db7690-32a6-4222-94fb-4dc2271a6eb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25e7976dd30c4c2688a681474b766461)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:04:12.967099 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85db7690-32a6-4222-94fb-4dc2271a6eb4 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:04:13.150105 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-85db7690-32a6-4222-94fb-4dc2271a6eb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25e7976dd30c4c2688a681474b766461'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:04:13.218936 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-85db7690-32a6-4222-94fb-4dc2271a6eb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25e7976dd30c4c2688a681474b766461'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:04:13.226272 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-85db7690-32a6-4222-94fb-4dc2271a6eb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25e7976dd30c4c2688a681474b766461'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:04:13.226950 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-85db7690-32a6-4222-94fb-4dc2271a6eb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25e7976dd30c4c2688a681474b766461'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:04:13.239368 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-85db7690-32a6-4222-94fb-4dc2271a6eb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25e7976dd30c4c2688a681474b766461'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:04:13.245337 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1396/2801] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 17:04:12 2022] DELETE /identity/v3/users/25e7976dd30c4c2688a681474b766461 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 17:04:13.466255 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa297924-b72f-4bd8-83b3-8be472d937b8 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:04:13.481036 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa297924-b72f-4bd8-83b3-8be472d937b8 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:04:13.538129 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8518570-da96-4167-b62b-eac7aab3fcda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:04:13.539023 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8518570-da96-4167-b62b-eac7aab3fcda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:04:13.539309 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8518570-da96-4167-b62b-eac7aab3fcda admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:04:13.539657 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8518570-da96-4167-b62b-eac7aab3fcda admin admin] PATH_INFO: `/v3/projects/8a9151e87a0144caa9be07aa21c76b5b` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:04:13.540851 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8518570-da96-4167-b62b-eac7aab3fcda admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a9151e87a0144caa9be07aa21c76b5b)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:04:13.542734 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8518570-da96-4167-b62b-eac7aab3fcda admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:04:13.639090 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c8518570-da96-4167-b62b-eac7aab3fcda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a9151e87a0144caa9be07aa21c76b5b', 'request_id': 'req-c8518570-da96-4167-b62b-eac7aab3fcda'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:04:13.645472 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c8518570-da96-4167-b62b-eac7aab3fcda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a9151e87a0144caa9be07aa21c76b5b', 'request_id': 'req-c8518570-da96-4167-b62b-eac7aab3fcda'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:04:13.744934 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c8518570-da96-4167-b62b-eac7aab3fcda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a9151e87a0144caa9be07aa21c76b5b', 'request_id': 'req-c8518570-da96-4167-b62b-eac7aab3fcda'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:04:13.756626 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c8518570-da96-4167-b62b-eac7aab3fcda admin admin] The token cache is being invalidate because project 8a9151e87a0144caa9be07aa21c76b5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 17:04:13.756915 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c8518570-da96-4167-b62b-eac7aab3fcda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:04:13.757551 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c8518570-da96-4167-b62b-eac7aab3fcda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:04:13.759264 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1406/2802] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 17:04:13 2022] DELETE /identity/v3/projects/8a9151e87a0144caa9be07aa21c76b5b => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 17:04:13.763330 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85db7690-32a6-4222-94fb-4dc2271a6eb4 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:04:13.764862 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-85db7690-32a6-4222-94fb-4dc2271a6eb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:04:13.778842 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85db7690-32a6-4222-94fb-4dc2271a6eb4 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:04:13.834435 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6cc544-c8cd-4abc-b1c9-54f1186011f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:04:13.835303 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6cc544-c8cd-4abc-b1c9-54f1186011f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:04:13.835609 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6cc544-c8cd-4abc-b1c9-54f1186011f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:04:13.835883 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6cc544-c8cd-4abc-b1c9-54f1186011f0 admin admin] PATH_INFO: `/v3/users/6e50b7bf7ce44174bd4f35c3b46ef2be` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:04:13.837070 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6cc544-c8cd-4abc-b1c9-54f1186011f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e50b7bf7ce44174bd4f35c3b46ef2be)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:04:13.838967 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6cc544-c8cd-4abc-b1c9-54f1186011f0 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:04:13.999487 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-eb6cc544-c8cd-4abc-b1c9-54f1186011f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e50b7bf7ce44174bd4f35c3b46ef2be'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:04:14.058757 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-eb6cc544-c8cd-4abc-b1c9-54f1186011f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e50b7bf7ce44174bd4f35c3b46ef2be'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:04:14.066578 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-eb6cc544-c8cd-4abc-b1c9-54f1186011f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e50b7bf7ce44174bd4f35c3b46ef2be'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:04:14.067258 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-eb6cc544-c8cd-4abc-b1c9-54f1186011f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e50b7bf7ce44174bd4f35c3b46ef2be'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:04:14.078957 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-eb6cc544-c8cd-4abc-b1c9-54f1186011f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e50b7bf7ce44174bd4f35c3b46ef2be'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:04:14.085238 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1397/2803] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 17:04:13 2022] DELETE /identity/v3/users/6e50b7bf7ce44174bd4f35c3b46ef2be => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 17:04:14.338187 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8518570-da96-4167-b62b-eac7aab3fcda admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:04:14.348437 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-c8518570-da96-4167-b62b-eac7aab3fcda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:04:14.359011 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8518570-da96-4167-b62b-eac7aab3fcda admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:04:14.419505 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f442631-b0ec-41e2-b7d8-799baa0e8aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:04:14.420408 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f442631-b0ec-41e2-b7d8-799baa0e8aa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:04:14.420695 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f442631-b0ec-41e2-b7d8-799baa0e8aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:04:14.420970 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f442631-b0ec-41e2-b7d8-799baa0e8aa5 admin admin] PATH_INFO: `/v3/projects/62a9f569ed5743f9be16af92d7f7e194` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:04:14.422565 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f442631-b0ec-41e2-b7d8-799baa0e8aa5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62a9f569ed5743f9be16af92d7f7e194)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:04:14.424885 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f442631-b0ec-41e2-b7d8-799baa0e8aa5 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:04:14.530051 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0f442631-b0ec-41e2-b7d8-799baa0e8aa5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62a9f569ed5743f9be16af92d7f7e194', 'request_id': 'req-0f442631-b0ec-41e2-b7d8-799baa0e8aa5'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:04:14.536220 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0f442631-b0ec-41e2-b7d8-799baa0e8aa5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62a9f569ed5743f9be16af92d7f7e194', 'request_id': 'req-0f442631-b0ec-41e2-b7d8-799baa0e8aa5'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:04:14.596848 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0f442631-b0ec-41e2-b7d8-799baa0e8aa5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62a9f569ed5743f9be16af92d7f7e194', 'request_id': 'req-0f442631-b0ec-41e2-b7d8-799baa0e8aa5'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:04:14.608225 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0f442631-b0ec-41e2-b7d8-799baa0e8aa5 admin admin] The token cache is being invalidate because project 62a9f569ed5743f9be16af92d7f7e194 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 17:04:14.608514 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0f442631-b0ec-41e2-b7d8-799baa0e8aa5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:04:14.609164 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0f442631-b0ec-41e2-b7d8-799baa0e8aa5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:04:14.610697 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1407/2804] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 17:04:14 2022] DELETE /identity/v3/projects/62a9f569ed5743f9be16af92d7f7e194 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 17:04:47.763619 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f3d187-47e3-4b8f-bace-571c98e57312 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:04:47.764178 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f3d187-47e3-4b8f-bace-571c98e57312 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:04:47.764178 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f3d187-47e3-4b8f-bace-571c98e57312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:04:47.783743 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-c9f3d187-47e3-4b8f-bace-571c98e57312 None None] MFA Rules not processed for user `f8a1e19d5f1d4ed8885b813c1e05f5f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 17:04:47.784973 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-c9f3d187-47e3-4b8f-bace-571c98e57312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:04:47.841285 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1398/2805] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 17:04:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 17:04:48.552447 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f442631-b0ec-41e2-b7d8-799baa0e8aa5 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:04:48.553868 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0f442631-b0ec-41e2-b7d8-799baa0e8aa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:04:48.642694 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f442631-b0ec-41e2-b7d8-799baa0e8aa5 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:04:48.647768 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b38aad-27bc-4945-baa0-08669c3f949f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6589debd41bf496085c7339ab5409666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:04:48.648415 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b38aad-27bc-4945-baa0-08669c3f949f service placement] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:04:48.648700 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b38aad-27bc-4945-baa0-08669c3f949f service placement] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:04:48.648978 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b38aad-27bc-4945-baa0-08669c3f949f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:04:48.650722 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-c0b38aad-27bc-4945-baa0-08669c3f949f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:04:48.662247 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b38aad-27bc-4945-baa0-08669c3f949f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:04:48.663828 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b38aad-27bc-4945-baa0-08669c3f949f service placement] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:04:48.673594 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1408/2806] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 17:04:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 17:06:20.994152 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f3d187-47e3-4b8f-bace-571c98e57312 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:06:21.000348 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-c9f3d187-47e3-4b8f-bace-571c98e57312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:06:21.128047 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f3d187-47e3-4b8f-bace-571c98e57312 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:06:21.134154 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f1fa3a-cd05-4847-9a1c-d3962da02373 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1be2652c984a4283aeee0b937f0555e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:06:21.135240 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1fa3a-cd05-4847-9a1c-d3962da02373 service nova] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:06:21.135833 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1fa3a-cd05-4847-9a1c-d3962da02373 service nova] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:06:21.136365 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1fa3a-cd05-4847-9a1c-d3962da02373 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:06:21.140351 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-f2f1fa3a-cd05-4847-9a1c-d3962da02373 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:06:21.159930 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f1fa3a-cd05-4847-9a1c-d3962da02373 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:06:21.161684 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f1fa3a-cd05-4847-9a1c-d3962da02373 service nova] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:06:21.175297 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1399/2807] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 17:06:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 17:06:29.734719 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b38aad-27bc-4945-baa0-08669c3f949f service placement] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:06:29.786788 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b38aad-27bc-4945-baa0-08669c3f949f service placement] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:06:29.791994 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e6d590-57b5-4090-9bfd-affddd1a1a3f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6589debd41bf496085c7339ab5409666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:06:29.792642 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6d590-57b5-4090-9bfd-affddd1a1a3f service placement] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:06:29.792922 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6d590-57b5-4090-9bfd-affddd1a1a3f service placement] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:06:29.793196 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6d590-57b5-4090-9bfd-affddd1a1a3f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:06:29.794977 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a6e6d590-57b5-4090-9bfd-affddd1a1a3f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:06:29.818836 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e6d590-57b5-4090-9bfd-affddd1a1a3f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:06:29.822393 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e6d590-57b5-4090-9bfd-affddd1a1a3f service placement] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:06:29.830677 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1409/2808] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 17:06:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 17:06:34.201400 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea034b-8aac-43d7-b0ba-0cfb27633db5 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:06:34.201944 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea034b-8aac-43d7-b0ba-0cfb27633db5 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:06:34.201944 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea034b-8aac-43d7-b0ba-0cfb27633db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:06:34.219644 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-61ea034b-8aac-43d7-b0ba-0cfb27633db5 None None] MFA Rules not processed for user `f8a1e19d5f1d4ed8885b813c1e05f5f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 17:06:34.220854 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-61ea034b-8aac-43d7-b0ba-0cfb27633db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:06:34.227727 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1400/2809] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 17:06:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 17:06:34.527185 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e6d590-57b5-4090-9bfd-affddd1a1a3f service placement] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:06:34.528742 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a6e6d590-57b5-4090-9bfd-affddd1a1a3f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:06:34.604230 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e6d590-57b5-4090-9bfd-affddd1a1a3f service placement] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:06:34.607877 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fac5705-94ef-4b84-99d7-b7715ef8b453 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:06:34.608526 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac5705-94ef-4b84-99d7-b7715ef8b453 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:06:34.608811 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac5705-94ef-4b84-99d7-b7715ef8b453 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:06:34.609089 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac5705-94ef-4b84-99d7-b7715ef8b453 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:06:34.610837 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0fac5705-94ef-4b84-99d7-b7715ef8b453 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:06:34.620837 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fac5705-94ef-4b84-99d7-b7715ef8b453 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:06:34.622246 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fac5705-94ef-4b84-99d7-b7715ef8b453 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:06:34.631043 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1410/2810] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 17:06:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 17:06:45.736172 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea034b-8aac-43d7-b0ba-0cfb27633db5 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:06:45.749480 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea034b-8aac-43d7-b0ba-0cfb27633db5 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:06:45.754996 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d6dd2f-c2b4-4e2a-8a5b-6312d85cf741 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1be2652c984a4283aeee0b937f0555e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:06:45.755671 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d6dd2f-c2b4-4e2a-8a5b-6312d85cf741 service nova] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:06:45.756134 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d6dd2f-c2b4-4e2a-8a5b-6312d85cf741 service nova] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:06:45.756411 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d6dd2f-c2b4-4e2a-8a5b-6312d85cf741 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:06:45.758208 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-d0d6dd2f-c2b4-4e2a-8a5b-6312d85cf741 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:06:45.770375 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d6dd2f-c2b4-4e2a-8a5b-6312d85cf741 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:06:45.772703 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d6dd2f-c2b4-4e2a-8a5b-6312d85cf741 service nova] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:06:45.789078 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1401/2811] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 17:06:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 17:08:02.457304 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fac5705-94ef-4b84-99d7-b7715ef8b453 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:08:02.458887 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0fac5705-94ef-4b84-99d7-b7715ef8b453 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:08:02.476704 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fac5705-94ef-4b84-99d7-b7715ef8b453 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:08:02.483269 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc0344-8ec0-42e7-99ef-d20cff054b23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1be2652c984a4283aeee0b937f0555e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:08:02.484106 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc0344-8ec0-42e7-99ef-d20cff054b23 service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:08:02.484485 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc0344-8ec0-42e7-99ef-d20cff054b23 service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:08:02.484858 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc0344-8ec0-42e7-99ef-d20cff054b23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:08:02.486986 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-cbfc0344-8ec0-42e7-99ef-d20cff054b23 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:08:02.499043 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfc0344-8ec0-42e7-99ef-d20cff054b23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:08:02.500643 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfc0344-8ec0-42e7-99ef-d20cff054b23 service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:08:02.509851 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1411/2812] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 17:08:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 17:08:22.736120 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b448e6-3a1b-4376-b511-9eaacc3224f4 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:08:22.736700 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b448e6-3a1b-4376-b511-9eaacc3224f4 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:08:22.736700 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b448e6-3a1b-4376-b511-9eaacc3224f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:08:22.754779 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-59b448e6-3a1b-4376-b511-9eaacc3224f4 None None] MFA Rules not processed for user `f8a1e19d5f1d4ed8885b813c1e05f5f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 17:08:22.756037 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-59b448e6-3a1b-4376-b511-9eaacc3224f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:08:22.764292 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1402/2813] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 17:08:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 17:08:23.076967 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc0344-8ec0-42e7-99ef-d20cff054b23 service nova] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:08:23.079065 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-cbfc0344-8ec0-42e7-99ef-d20cff054b23 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:08:23.099822 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc0344-8ec0-42e7-99ef-d20cff054b23 service nova] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:08:23.104699 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c174456-6e87-4dfb-b86f-f86f22826339 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:08:23.105351 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c174456-6e87-4dfb-b86f-f86f22826339 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:08:23.105631 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c174456-6e87-4dfb-b86f-f86f22826339 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:08:23.105901 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c174456-6e87-4dfb-b86f-f86f22826339 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:08:23.107774 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-8c174456-6e87-4dfb-b86f-f86f22826339 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:08:23.117586 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c174456-6e87-4dfb-b86f-f86f22826339 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:08:23.118983 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c174456-6e87-4dfb-b86f-f86f22826339 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:08:23.131839 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1412/2814] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 17:08:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 17:08:36.638699 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b448e6-3a1b-4376-b511-9eaacc3224f4 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:08:36.659567 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b448e6-3a1b-4376-b511-9eaacc3224f4 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:08:36.665378 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec62b849-49f5-4ee5-b4fd-2892e43a15c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1be2652c984a4283aeee0b937f0555e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:08:36.666287 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62b849-49f5-4ee5-b4fd-2892e43a15c7 service nova] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:08:36.666745 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62b849-49f5-4ee5-b4fd-2892e43a15c7 service nova] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:08:36.667203 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62b849-49f5-4ee5-b4fd-2892e43a15c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:08:36.669310 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-ec62b849-49f5-4ee5-b4fd-2892e43a15c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:08:36.682012 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec62b849-49f5-4ee5-b4fd-2892e43a15c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:08:36.684183 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec62b849-49f5-4ee5-b4fd-2892e43a15c7 service nova] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:08:36.696140 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1403/2815] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 17:08:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 17:09:34.691766 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c174456-6e87-4dfb-b86f-f86f22826339 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:09:34.700619 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c174456-6e87-4dfb-b86f-f86f22826339 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:09:34.704383 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6560a37a-d355-48f3-bdfa-f2ff113889e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:09:34.705033 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560a37a-d355-48f3-bdfa-f2ff113889e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:09:34.705321 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560a37a-d355-48f3-bdfa-f2ff113889e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:09:34.705601 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560a37a-d355-48f3-bdfa-f2ff113889e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:09:34.707485 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-6560a37a-d355-48f3-bdfa-f2ff113889e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:09:34.717551 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6560a37a-d355-48f3-bdfa-f2ff113889e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:09:34.719133 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6560a37a-d355-48f3-bdfa-f2ff113889e2 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:09:34.727410 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1413/2816] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 17:09:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 17:09:51.192575 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec62b849-49f5-4ee5-b4fd-2892e43a15c7 service nova] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:09:51.194142 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-ec62b849-49f5-4ee5-b4fd-2892e43a15c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:09:51.252249 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec62b849-49f5-4ee5-b4fd-2892e43a15c7 service nova] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:09:51.257683 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2520820-1754-4f9e-aecb-d69e31baa131 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '950b5b5f690d41509ead753065a0b793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:09:51.258335 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2520820-1754-4f9e-aecb-d69e31baa131 service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:09:51.258616 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2520820-1754-4f9e-aecb-d69e31baa131 service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:09:51.258890 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2520820-1754-4f9e-aecb-d69e31baa131 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:09:51.260725 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-b2520820-1754-4f9e-aecb-d69e31baa131 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:09:51.290330 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2520820-1754-4f9e-aecb-d69e31baa131 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:09:51.291826 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2520820-1754-4f9e-aecb-d69e31baa131 service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:09:51.313007 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1404/2817] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 17:09:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 17:09:59.683971 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6560a37a-d355-48f3-bdfa-f2ff113889e2 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:09:59.695241 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6560a37a-d355-48f3-bdfa-f2ff113889e2 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:09:59.699826 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c947829-c68f-412e-8926-ae9667e64d1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '950b5b5f690d41509ead753065a0b793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:09:59.700640 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c947829-c68f-412e-8926-ae9667e64d1e service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:09:59.701518 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c947829-c68f-412e-8926-ae9667e64d1e service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:09:59.701896 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c947829-c68f-412e-8926-ae9667e64d1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:09:59.704098 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-6c947829-c68f-412e-8926-ae9667e64d1e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:09:59.718398 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c947829-c68f-412e-8926-ae9667e64d1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:09:59.719849 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c947829-c68f-412e-8926-ae9667e64d1e service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:09:59.731237 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1414/2818] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 17:09:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 17:10:11.514229 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2520820-1754-4f9e-aecb-d69e31baa131 service cinder] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:10:11.524209 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2520820-1754-4f9e-aecb-d69e31baa131 service cinder] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:10:11.528279 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe17b8-b59e-4570-8f27-af2636c2ba9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:10:11.528945 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe17b8-b59e-4570-8f27-af2636c2ba9f service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:10:11.529228 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe17b8-b59e-4570-8f27-af2636c2ba9f service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:10:11.529531 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe17b8-b59e-4570-8f27-af2636c2ba9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:10:11.531369 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-6cbe17b8-b59e-4570-8f27-af2636c2ba9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:10:11.634476 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbe17b8-b59e-4570-8f27-af2636c2ba9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:10:11.636106 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbe17b8-b59e-4570-8f27-af2636c2ba9f service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:10:11.663276 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1405/2819] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 17:10:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 17:10:15.871498 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c947829-c68f-412e-8926-ae9667e64d1e service cinder] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:10:15.873157 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-6c947829-c68f-412e-8926-ae9667e64d1e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:10:15.887295 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c947829-c68f-412e-8926-ae9667e64d1e service cinder] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:10:15.892106 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5550c568-8126-49eb-85d0-310001012c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:10:15.893508 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550c568-8126-49eb-85d0-310001012c70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:10:15.893979 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550c568-8126-49eb-85d0-310001012c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:10:15.894470 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550c568-8126-49eb-85d0-310001012c70 admin admin] PATH_INFO: `/v3/users/f8a1e19d5f1d4ed8885b813c1e05f5f3` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:10:15.896000 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5550c568-8126-49eb-85d0-310001012c70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8a1e19d5f1d4ed8885b813c1e05f5f3)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:10:15.897908 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5550c568-8126-49eb-85d0-310001012c70 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:10:16.121993 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-5550c568-8126-49eb-85d0-310001012c70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8a1e19d5f1d4ed8885b813c1e05f5f3'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:10:16.122599 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-5550c568-8126-49eb-85d0-310001012c70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8a1e19d5f1d4ed8885b813c1e05f5f3'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:10:16.200257 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-5550c568-8126-49eb-85d0-310001012c70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8a1e19d5f1d4ed8885b813c1e05f5f3'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:10:16.209338 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-5550c568-8126-49eb-85d0-310001012c70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8a1e19d5f1d4ed8885b813c1e05f5f3'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:10:16.223914 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-5550c568-8126-49eb-85d0-310001012c70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8a1e19d5f1d4ed8885b813c1e05f5f3'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:10:16.230299 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1415/2820] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 17:10:15 2022] DELETE /identity/v3/users/f8a1e19d5f1d4ed8885b813c1e05f5f3 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 17:10:16.585550 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe17b8-b59e-4570-8f27-af2636c2ba9f service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:10:16.596061 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe17b8-b59e-4570-8f27-af2636c2ba9f service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:10:16.655844 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac8a98e-74c6-4d41-b160-3d079316a96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:10:16.656622 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac8a98e-74c6-4d41-b160-3d079316a96a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:10:16.656903 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac8a98e-74c6-4d41-b160-3d079316a96a admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:10:16.657174 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac8a98e-74c6-4d41-b160-3d079316a96a admin admin] PATH_INFO: `/v3/projects/81d592a72e6f4e3a8555bd82765c85f9` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:10:16.658341 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac8a98e-74c6-4d41-b160-3d079316a96a admin admin] RBAC: Authorizing `identity:delete_project(project_id=81d592a72e6f4e3a8555bd82765c85f9)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:10:16.660912 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac8a98e-74c6-4d41-b160-3d079316a96a admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:10:16.796821 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-6ac8a98e-74c6-4d41-b160-3d079316a96a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81d592a72e6f4e3a8555bd82765c85f9', 'request_id': 'req-6ac8a98e-74c6-4d41-b160-3d079316a96a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:10:16.874765 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-6ac8a98e-74c6-4d41-b160-3d079316a96a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81d592a72e6f4e3a8555bd82765c85f9', 'request_id': 'req-6ac8a98e-74c6-4d41-b160-3d079316a96a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:10:16.882640 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-6ac8a98e-74c6-4d41-b160-3d079316a96a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81d592a72e6f4e3a8555bd82765c85f9', 'request_id': 'req-6ac8a98e-74c6-4d41-b160-3d079316a96a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:10:16.895089 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-6ac8a98e-74c6-4d41-b160-3d079316a96a admin admin] The token cache is being invalidate because project 81d592a72e6f4e3a8555bd82765c85f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 17:10:16.895388 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-6ac8a98e-74c6-4d41-b160-3d079316a96a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:10:16.896112 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-6ac8a98e-74c6-4d41-b160-3d079316a96a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:10:16.897708 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1406/2821] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 17:10:16 2022] DELETE /identity/v3/projects/81d592a72e6f4e3a8555bd82765c85f9 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 17:10:16.902870 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09669c0-9f0f-451a-8dc4-97093367132c None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:10:16.903404 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09669c0-9f0f-451a-8dc4-97093367132c None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:10:16.903509 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09669c0-9f0f-451a-8dc4-97093367132c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:10:16.962129 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-b09669c0-9f0f-451a-8dc4-97093367132c None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 17:10:16.963254 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b09669c0-9f0f-451a-8dc4-97093367132c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:10:17.022512 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1416/2822] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 17:10:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 17:10:17.030908 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b1910d-961b-474f-9c91-4d5af8c94553 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:10:17.031198 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b1910d-961b-474f-9c91-4d5af8c94553 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:10:17.031480 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b1910d-961b-474f-9c91-4d5af8c94553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:10:17.050672 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-15b1910d-961b-474f-9c91-4d5af8c94553 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 17:10:17.051921 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-15b1910d-961b-474f-9c91-4d5af8c94553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:10:17.059770 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1407/2823] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 17:10:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 17:10:17.064037 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09669c0-9f0f-451a-8dc4-97093367132c None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:10:17.074354 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09669c0-9f0f-451a-8dc4-97093367132c None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:10:17.078849 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04e2044-a6ad-4bf8-a298-b0e805407ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:10:17.079505 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04e2044-a6ad-4bf8-a298-b0e805407ea4 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:10:17.079819 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04e2044-a6ad-4bf8-a298-b0e805407ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:10:17.080096 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04e2044-a6ad-4bf8-a298-b0e805407ea4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:10:17.080890 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04e2044-a6ad-4bf8-a298-b0e805407ea4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 17:10:17.081267 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04e2044-a6ad-4bf8-a298-b0e805407ea4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:10:17.082929 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04e2044-a6ad-4bf8-a298-b0e805407ea4 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:10:17.094170 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1417/2824] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Apr 11 17:10:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 17:10:17.098517 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b1910d-961b-474f-9c91-4d5af8c94553 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:10:17.108092 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b1910d-961b-474f-9c91-4d5af8c94553 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:10:17.114169 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8869664-cbf5-416f-a93c-74e30542a597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:10:17.114856 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8869664-cbf5-416f-a93c-74e30542a597 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:10:17.115143 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8869664-cbf5-416f-a93c-74e30542a597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:10:17.115424 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8869664-cbf5-416f-a93c-74e30542a597 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:10:17.116166 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8869664-cbf5-416f-a93c-74e30542a597 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:10:17.118078 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8869664-cbf5-416f-a93c-74e30542a597 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:10:17.202141 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1408/2825] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 17:10:17 2022] POST /identity/v3/projects => generated 365 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 17:10:17.206701 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04e2044-a6ad-4bf8-a298-b0e805407ea4 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:10:17.217370 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04e2044-a6ad-4bf8-a298-b0e805407ea4 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:10:17.277123 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eec385-e788-4fd5-a9dc-906c06fa93ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:10:17.277805 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eec385-e788-4fd5-a9dc-906c06fa93ba admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:10:17.278096 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eec385-e788-4fd5-a9dc-906c06fa93ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:10:17.278376 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eec385-e788-4fd5-a9dc-906c06fa93ba admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:10:17.279069 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eec385-e788-4fd5-a9dc-906c06fa93ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:10:17.281018 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eec385-e788-4fd5-a9dc-906c06fa93ba admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:10:17.401996 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1418/2826] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 17:10:17 2022] POST /identity/v3/users => generated 283 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 17:10:17.406245 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8869664-cbf5-416f-a93c-74e30542a597 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:10:17.417564 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8869664-cbf5-416f-a93c-74e30542a597 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:10:17.422478 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6cbe79-3130-44e1-b536-0ed65e5a80c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:10:17.423153 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6cbe79-3130-44e1-b536-0ed65e5a80c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:10:17.423438 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6cbe79-3130-44e1-b536-0ed65e5a80c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:10:17.423739 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6cbe79-3130-44e1-b536-0ed65e5a80c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:10:17.424694 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6cbe79-3130-44e1-b536-0ed65e5a80c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:10:17.426502 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6cbe79-3130-44e1-b536-0ed65e5a80c5 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:10:17.437433 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1409/2827] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 17:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 17:10:17.442147 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eec385-e788-4fd5-a9dc-906c06fa93ba admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:10:17.451900 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eec385-e788-4fd5-a9dc-906c06fa93ba admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:10:17.457024 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643d0892-dc75-48ad-8889-407426618d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:10:17.457717 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d0892-dc75-48ad-8889-407426618d07 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:10:17.457998 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d0892-dc75-48ad-8889-407426618d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:10:17.458270 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d0892-dc75-48ad-8889-407426618d07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:10:17.458990 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643d0892-dc75-48ad-8889-407426618d07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:10:17.460590 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643d0892-dc75-48ad-8889-407426618d07 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:10:17.473836 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1419/2828] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 17:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 17:10:17.476879 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6cbe79-3130-44e1-b536-0ed65e5a80c5 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:10:17.486801 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6cbe79-3130-44e1-b536-0ed65e5a80c5 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:10:17.491778 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8ae689-c9ea-45f1-846d-a79a6d43533e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:10:17.492660 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ae689-c9ea-45f1-846d-a79a6d43533e admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:10:17.492946 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ae689-c9ea-45f1-846d-a79a6d43533e admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:10:17.493226 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ae689-c9ea-45f1-846d-a79a6d43533e admin admin] PATH_INFO: `/v3/projects/f05dc84a3b4c4ee6bf4ef865bd0ee2b2/users/2f7a5421a69a4349a80119446ad6568c/roles/0d41da7bec094450b5bff4e4831be52c` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:10:17.509689 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8ae689-c9ea-45f1-846d-a79a6d43533e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f05dc84a3b4c4ee6bf4ef865bd0ee2b2, user_id=2f7a5421a69a4349a80119446ad6568c, role_id=0d41da7bec094450b5bff4e4831be52c)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:10:17.512439 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8ae689-c9ea-45f1-846d-a79a6d43533e admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:10:17.673314 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1410/2829] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 17:10:17 2022] PUT /identity/v3/projects/f05dc84a3b4c4ee6bf4ef865bd0ee2b2/users/2f7a5421a69a4349a80119446ad6568c/roles/0d41da7bec094450b5bff4e4831be52c => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 17:10:17.683452 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fab75c-65da-46eb-a74b-dc048081378b None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:10:17.683784 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fab75c-65da-46eb-a74b-dc048081378b None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:10:17.684071 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fab75c-65da-46eb-a74b-dc048081378b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:10:17.714411 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-69fab75c-65da-46eb-a74b-dc048081378b None None] MFA Rules not processed for user `2f7a5421a69a4349a80119446ad6568c`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 17:10:17.715685 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-69fab75c-65da-46eb-a74b-dc048081378b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:10:17.777792 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1420/2830] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 17:10:17 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 17:10:17.788982 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8ae689-c9ea-45f1-846d-a79a6d43533e admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:10:17.790712 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-7c8ae689-c9ea-45f1-846d-a79a6d43533e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:10:17.853211 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8ae689-c9ea-45f1-846d-a79a6d43533e admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:10:17.857137 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e6437-68eb-431c-bcdd-7baac216f318 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '950b5b5f690d41509ead753065a0b793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:10:17.857878 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e6437-68eb-431c-bcdd-7baac216f318 service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:10:17.858163 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e6437-68eb-431c-bcdd-7baac216f318 service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:10:17.858441 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e6437-68eb-431c-bcdd-7baac216f318 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:10:17.867362 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8e6437-68eb-431c-bcdd-7baac216f318 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:10:17.868822 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8e6437-68eb-431c-bcdd-7baac216f318 service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:10:17.877523 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1411/2831] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 17:10:17 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 17:10:28.461560 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fab75c-65da-46eb-a74b-dc048081378b None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:10:28.529723 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fab75c-65da-46eb-a74b-dc048081378b None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:10:28.534797 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c19ff-f3b4-4a7f-bff9-431bd31d1e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:10:28.535890 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c19ff-f3b4-4a7f-bff9-431bd31d1e6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:10:28.536182 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c19ff-f3b4-4a7f-bff9-431bd31d1e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:10:28.536525 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c19ff-f3b4-4a7f-bff9-431bd31d1e6e admin admin] PATH_INFO: `/v3/users/2f7a5421a69a4349a80119446ad6568c` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:10:28.537954 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2c19ff-f3b4-4a7f-bff9-431bd31d1e6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f7a5421a69a4349a80119446ad6568c)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:10:28.540327 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2c19ff-f3b4-4a7f-bff9-431bd31d1e6e admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:10:28.762244 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1a2c19ff-f3b4-4a7f-bff9-431bd31d1e6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f7a5421a69a4349a80119446ad6568c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:10:28.762913 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1a2c19ff-f3b4-4a7f-bff9-431bd31d1e6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f7a5421a69a4349a80119446ad6568c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:10:28.840306 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1a2c19ff-f3b4-4a7f-bff9-431bd31d1e6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f7a5421a69a4349a80119446ad6568c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:10:28.847790 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1a2c19ff-f3b4-4a7f-bff9-431bd31d1e6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f7a5421a69a4349a80119446ad6568c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:10:28.859983 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1a2c19ff-f3b4-4a7f-bff9-431bd31d1e6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f7a5421a69a4349a80119446ad6568c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:10:28.865818 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1421/2832] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 17:10:28 2022] DELETE /identity/v3/users/2f7a5421a69a4349a80119446ad6568c => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 17:10:28.871004 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf35d07-3d8c-448f-ab2c-f34d2b77a80e None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:10:28.871499 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf35d07-3d8c-448f-ab2c-f34d2b77a80e None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:10:28.871631 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf35d07-3d8c-448f-ab2c-f34d2b77a80e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:10:28.888975 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-dcf35d07-3d8c-448f-ab2c-f34d2b77a80e None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 17:10:28.890195 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-dcf35d07-3d8c-448f-ab2c-f34d2b77a80e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:10:28.948017 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1412/2833] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 17:10:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 17:10:28.957855 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c19ff-f3b4-4a7f-bff9-431bd31d1e6e admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:10:28.959395 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-1a2c19ff-f3b4-4a7f-bff9-431bd31d1e6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:10:29.021153 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c19ff-f3b4-4a7f-bff9-431bd31d1e6e admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:10:29.025456 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096cb289-686d-4765-9d7b-fc2895c4cf81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:10:29.026133 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096cb289-686d-4765-9d7b-fc2895c4cf81 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:10:29.026413 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096cb289-686d-4765-9d7b-fc2895c4cf81 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:10:29.026713 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096cb289-686d-4765-9d7b-fc2895c4cf81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:10:29.036135 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096cb289-686d-4765-9d7b-fc2895c4cf81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:10:29.037553 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096cb289-686d-4765-9d7b-fc2895c4cf81 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:10:29.048211 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1422/2834] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 17:10:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 17:10:29.481746 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf35d07-3d8c-448f-ab2c-f34d2b77a80e None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:10:29.481746 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-dcf35d07-3d8c-448f-ab2c-f34d2b77a80e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:10:29.489902 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf35d07-3d8c-448f-ab2c-f34d2b77a80e None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:10:29.494838 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feef6b3d-474a-43c8-b2dd-a0005c25631d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:10:29.495918 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef6b3d-474a-43c8-b2dd-a0005c25631d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:10:29.496351 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef6b3d-474a-43c8-b2dd-a0005c25631d admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:10:29.496639 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef6b3d-474a-43c8-b2dd-a0005c25631d admin admin] PATH_INFO: `/v3/projects/f05dc84a3b4c4ee6bf4ef865bd0ee2b2` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:10:29.497898 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feef6b3d-474a-43c8-b2dd-a0005c25631d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f05dc84a3b4c4ee6bf4ef865bd0ee2b2)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:10:29.499912 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feef6b3d-474a-43c8-b2dd-a0005c25631d admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:10:29.630254 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-feef6b3d-474a-43c8-b2dd-a0005c25631d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f05dc84a3b4c4ee6bf4ef865bd0ee2b2', 'request_id': 'req-feef6b3d-474a-43c8-b2dd-a0005c25631d'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:10:29.725965 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-feef6b3d-474a-43c8-b2dd-a0005c25631d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f05dc84a3b4c4ee6bf4ef865bd0ee2b2', 'request_id': 'req-feef6b3d-474a-43c8-b2dd-a0005c25631d'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:10:29.732146 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-feef6b3d-474a-43c8-b2dd-a0005c25631d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f05dc84a3b4c4ee6bf4ef865bd0ee2b2', 'request_id': 'req-feef6b3d-474a-43c8-b2dd-a0005c25631d'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:10:29.745741 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-feef6b3d-474a-43c8-b2dd-a0005c25631d admin admin] The token cache is being invalidate because project f05dc84a3b4c4ee6bf4ef865bd0ee2b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 17:10:29.746278 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-feef6b3d-474a-43c8-b2dd-a0005c25631d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:10:29.746933 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-feef6b3d-474a-43c8-b2dd-a0005c25631d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:10:29.748508 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1413/2835] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 17:10:29 2022] DELETE /identity/v3/projects/f05dc84a3b4c4ee6bf4ef865bd0ee2b2 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 17:10:29.754237 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f7b77-b3c6-4a63-b03e-7f5eb1ac8558 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:10:29.754749 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f7b77-b3c6-4a63-b03e-7f5eb1ac8558 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:10:29.754971 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f7b77-b3c6-4a63-b03e-7f5eb1ac8558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:10:29.775354 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-723f7b77-b3c6-4a63-b03e-7f5eb1ac8558 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 17:10:29.776874 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-723f7b77-b3c6-4a63-b03e-7f5eb1ac8558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:10:29.846891 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1423/2836] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 17:10:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 17:10:29.855280 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f89603-5347-4a64-ace7-f8526deb0c25 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:10:29.855773 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f89603-5347-4a64-ace7-f8526deb0c25 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:10:29.856089 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f89603-5347-4a64-ace7-f8526deb0c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:10:29.878590 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-b5f89603-5347-4a64-ace7-f8526deb0c25 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 17:10:29.879850 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-b5f89603-5347-4a64-ace7-f8526deb0c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:10:29.889801 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1414/2837] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 17:10:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 17:10:29.894075 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723f7b77-b3c6-4a63-b03e-7f5eb1ac8558 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:10:29.904265 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723f7b77-b3c6-4a63-b03e-7f5eb1ac8558 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:10:29.908915 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8e1e2f-f7b9-43ba-ac75-3ec294968c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:10:29.909575 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8e1e2f-f7b9-43ba-ac75-3ec294968c2e admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:10:29.909856 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8e1e2f-f7b9-43ba-ac75-3ec294968c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:10:29.910137 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8e1e2f-f7b9-43ba-ac75-3ec294968c2e admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:10:29.910866 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8e1e2f-f7b9-43ba-ac75-3ec294968c2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 17:10:29.911174 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8e1e2f-f7b9-43ba-ac75-3ec294968c2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:10:29.912805 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8e1e2f-f7b9-43ba-ac75-3ec294968c2e admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:10:29.924654 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1424/2838] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Apr 11 17:10:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 17:10:29.928924 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f89603-5347-4a64-ace7-f8526deb0c25 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:10:29.940648 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f89603-5347-4a64-ace7-f8526deb0c25 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:10:29.946366 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1102876b-6439-45d2-ada1-11fb0e259c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:10:29.947250 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102876b-6439-45d2-ada1-11fb0e259c28 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:10:29.948198 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102876b-6439-45d2-ada1-11fb0e259c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:10:29.948561 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102876b-6439-45d2-ada1-11fb0e259c28 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:10:29.949235 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1102876b-6439-45d2-ada1-11fb0e259c28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:10:29.951824 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1102876b-6439-45d2-ada1-11fb0e259c28 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:10:30.070400 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1415/2839] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 17:10:29 2022] POST /identity/v3/projects => generated 403 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 17:10:30.075449 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8e1e2f-f7b9-43ba-ac75-3ec294968c2e admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:10:30.085531 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8e1e2f-f7b9-43ba-ac75-3ec294968c2e admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:10:30.141173 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6a46c-fec9-4323-8b86-7a277e02bc7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:10:30.142153 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6a46c-fec9-4323-8b86-7a277e02bc7b admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:10:30.142574 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6a46c-fec9-4323-8b86-7a277e02bc7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:10:30.142987 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6a46c-fec9-4323-8b86-7a277e02bc7b admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:10:30.144093 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe6a46c-fec9-4323-8b86-7a277e02bc7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:10:30.147459 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe6a46c-fec9-4323-8b86-7a277e02bc7b admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:10:30.257690 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1425/2840] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 17:10:30 2022] POST /identity/v3/users => generated 302 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 17:10:30.262513 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1102876b-6439-45d2-ada1-11fb0e259c28 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:10:30.273286 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1102876b-6439-45d2-ada1-11fb0e259c28 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:10:30.279160 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23880e4b-91d0-4194-85de-6bf2859c6d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:10:30.279857 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23880e4b-91d0-4194-85de-6bf2859c6d7d admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:10:30.280170 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23880e4b-91d0-4194-85de-6bf2859c6d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:10:30.280446 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23880e4b-91d0-4194-85de-6bf2859c6d7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:10:30.281179 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23880e4b-91d0-4194-85de-6bf2859c6d7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:10:30.283031 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23880e4b-91d0-4194-85de-6bf2859c6d7d admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:10:30.293793 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1416/2841] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 17:10:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 17:10:30.297890 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6a46c-fec9-4323-8b86-7a277e02bc7b admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:10:30.308471 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6a46c-fec9-4323-8b86-7a277e02bc7b admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:10:30.313992 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2038055-5ad0-45a2-bf3f-e2d7add2b55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:10:30.314670 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2038055-5ad0-45a2-bf3f-e2d7add2b55b admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:10:30.314951 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2038055-5ad0-45a2-bf3f-e2d7add2b55b admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:10:30.315247 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2038055-5ad0-45a2-bf3f-e2d7add2b55b admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:10:30.316087 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2038055-5ad0-45a2-bf3f-e2d7add2b55b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:10:30.317704 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2038055-5ad0-45a2-bf3f-e2d7add2b55b admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:10:30.328417 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1426/2842] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 17:10:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 17:10:30.334367 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23880e4b-91d0-4194-85de-6bf2859c6d7d admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:10:30.348847 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23880e4b-91d0-4194-85de-6bf2859c6d7d admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:10:30.353484 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638e98c5-8a9c-481f-9daa-b1ce2e98f3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:10:30.355238 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e98c5-8a9c-481f-9daa-b1ce2e98f3d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:10:30.355550 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e98c5-8a9c-481f-9daa-b1ce2e98f3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:10:30.355832 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e98c5-8a9c-481f-9daa-b1ce2e98f3d3 admin admin] PATH_INFO: `/v3/projects/f17d075b53e24df3955a0579fc2a9db0/users/69e50f0d228b4a69a9d6a237adea0bf6/roles/0d41da7bec094450b5bff4e4831be52c` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:10:30.372330 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638e98c5-8a9c-481f-9daa-b1ce2e98f3d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f17d075b53e24df3955a0579fc2a9db0, user_id=69e50f0d228b4a69a9d6a237adea0bf6, role_id=0d41da7bec094450b5bff4e4831be52c)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:10:30.374974 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638e98c5-8a9c-481f-9daa-b1ce2e98f3d3 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:10:30.457578 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1417/2843] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 17:10:30 2022] PUT /identity/v3/projects/f17d075b53e24df3955a0579fc2a9db0/users/69e50f0d228b4a69a9d6a237adea0bf6/roles/0d41da7bec094450b5bff4e4831be52c => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 17:10:30.468693 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc188b2f-9dd9-465f-9a80-bdd117a1c543 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:10:30.469042 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc188b2f-9dd9-465f-9a80-bdd117a1c543 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:10:30.469364 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc188b2f-9dd9-465f-9a80-bdd117a1c543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:10:30.497191 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-bc188b2f-9dd9-465f-9a80-bdd117a1c543 None None] MFA Rules not processed for user `69e50f0d228b4a69a9d6a237adea0bf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 17:10:30.498886 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-bc188b2f-9dd9-465f-9a80-bdd117a1c543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:10:30.568907 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1427/2844] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 17:10:30 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 17:10:30.573528 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638e98c5-8a9c-481f-9daa-b1ce2e98f3d3 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:10:30.635838 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638e98c5-8a9c-481f-9daa-b1ce2e98f3d3 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:10:30.641003 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64975dff-9730-4e77-8ffd-410fdd16e7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:10:30.641671 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64975dff-9730-4e77-8ffd-410fdd16e7d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:10:30.641956 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64975dff-9730-4e77-8ffd-410fdd16e7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:10:30.642236 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64975dff-9730-4e77-8ffd-410fdd16e7d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:10:30.642938 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64975dff-9730-4e77-8ffd-410fdd16e7d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:10:30.645184 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64975dff-9730-4e77-8ffd-410fdd16e7d2 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:10:30.756213 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1418/2845] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 17:10:30 2022] POST /identity/v3/projects => generated 403 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 17:10:30.760404 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc188b2f-9dd9-465f-9a80-bdd117a1c543 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:10:30.772195 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc188b2f-9dd9-465f-9a80-bdd117a1c543 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:10:30.829186 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fe5063-1d4d-4cfc-b1b8-d5998315326e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:10:30.829855 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe5063-1d4d-4cfc-b1b8-d5998315326e admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:10:30.830137 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe5063-1d4d-4cfc-b1b8-d5998315326e admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:10:30.830411 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe5063-1d4d-4cfc-b1b8-d5998315326e admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:10:30.831102 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fe5063-1d4d-4cfc-b1b8-d5998315326e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:10:30.833018 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fe5063-1d4d-4cfc-b1b8-d5998315326e admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:10:30.915379 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1428/2846] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 17:10:30 2022] POST /identity/v3/users => generated 308 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 17:10:30.921485 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64975dff-9730-4e77-8ffd-410fdd16e7d2 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:10:30.932950 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64975dff-9730-4e77-8ffd-410fdd16e7d2 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:10:30.938141 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55c722a-7963-48a8-9f26-4e443235b707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:10:30.938807 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c722a-7963-48a8-9f26-4e443235b707 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:10:30.939091 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c722a-7963-48a8-9f26-4e443235b707 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:10:30.939367 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c722a-7963-48a8-9f26-4e443235b707 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:10:30.940256 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55c722a-7963-48a8-9f26-4e443235b707 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:10:30.941852 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55c722a-7963-48a8-9f26-4e443235b707 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:10:30.953949 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1419/2847] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 17:10:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 17:10:30.958119 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fe5063-1d4d-4cfc-b1b8-d5998315326e admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:10:30.968687 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fe5063-1d4d-4cfc-b1b8-d5998315326e admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:10:30.973242 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c463407-4b53-426d-9cf7-8ace014b1d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:10:30.974133 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c463407-4b53-426d-9cf7-8ace014b1d20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:10:30.974416 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c463407-4b53-426d-9cf7-8ace014b1d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:10:30.974697 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c463407-4b53-426d-9cf7-8ace014b1d20 admin admin] PATH_INFO: `/v3/projects/1238135e1e034f8da896421197d01e91/users/2143b52c68f24a2d8e0502e9cf4b3fa8/roles/702e5e78b5d744529384b96a390ae92f` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:10:30.989082 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c463407-4b53-426d-9cf7-8ace014b1d20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1238135e1e034f8da896421197d01e91, user_id=2143b52c68f24a2d8e0502e9cf4b3fa8, role_id=702e5e78b5d744529384b96a390ae92f)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:10:30.991745 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c463407-4b53-426d-9cf7-8ace014b1d20 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:10:31.080023 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1429/2848] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 17:10:30 2022] PUT /identity/v3/projects/1238135e1e034f8da896421197d01e91/users/2143b52c68f24a2d8e0502e9cf4b3fa8/roles/702e5e78b5d744529384b96a390ae92f => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 17:10:31.084050 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55c722a-7963-48a8-9f26-4e443235b707 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:10:31.094071 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55c722a-7963-48a8-9f26-4e443235b707 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:10:31.151080 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ff73f5-437e-4c13-839f-daa3318b1df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:10:31.151779 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff73f5-437e-4c13-839f-daa3318b1df3 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:10:31.152065 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff73f5-437e-4c13-839f-daa3318b1df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:10:31.152343 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff73f5-437e-4c13-839f-daa3318b1df3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:10:31.153071 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ff73f5-437e-4c13-839f-daa3318b1df3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:10:31.154778 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ff73f5-437e-4c13-839f-daa3318b1df3 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:10:31.164431 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1420/2849] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 17:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 17:10:31.168854 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c463407-4b53-426d-9cf7-8ace014b1d20 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:10:31.178884 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c463407-4b53-426d-9cf7-8ace014b1d20 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:10:31.184121 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7f5e99-81f7-47d0-9129-01010832e423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:10:31.185173 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f5e99-81f7-47d0-9129-01010832e423 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:10:31.185456 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f5e99-81f7-47d0-9129-01010832e423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:10:31.185736 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f5e99-81f7-47d0-9129-01010832e423 admin admin] PATH_INFO: `/v3/projects/1238135e1e034f8da896421197d01e91/users/2143b52c68f24a2d8e0502e9cf4b3fa8/roles/702e5e78b5d744529384b96a390ae92f` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:10:31.187757 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7f5e99-81f7-47d0-9129-01010832e423 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1238135e1e034f8da896421197d01e91, user_id=2143b52c68f24a2d8e0502e9cf4b3fa8, role_id=702e5e78b5d744529384b96a390ae92f)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:10:31.190392 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7f5e99-81f7-47d0-9129-01010832e423 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:10:31.201595 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1430/2850] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 17:10:31 2022] PUT /identity/v3/projects/1238135e1e034f8da896421197d01e91/users/2143b52c68f24a2d8e0502e9cf4b3fa8/roles/702e5e78b5d744529384b96a390ae92f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 17:10:31.211795 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc92e3-c52f-4ee5-b962-0ea02df9b05d None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:10:31.212086 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc92e3-c52f-4ee5-b962-0ea02df9b05d None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:10:31.212393 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc92e3-c52f-4ee5-b962-0ea02df9b05d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:10:31.240127 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-cecc92e3-c52f-4ee5-b962-0ea02df9b05d None None] MFA Rules not processed for user `2143b52c68f24a2d8e0502e9cf4b3fa8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 17:10:31.241474 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-cecc92e3-c52f-4ee5-b962-0ea02df9b05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:10:31.310166 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1421/2851] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 17:10:31 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 17:10:31.326739 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7f5e99-81f7-47d0-9129-01010832e423 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:10:31.328490 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-3d7f5e99-81f7-47d0-9129-01010832e423 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:10:31.384747 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7f5e99-81f7-47d0-9129-01010832e423 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:10:31.388989 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db03a0e-278f-4e4c-a630-0a93052a140b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '950b5b5f690d41509ead753065a0b793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:10:31.389636 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db03a0e-278f-4e4c-a630-0a93052a140b service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:10:31.389920 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db03a0e-278f-4e4c-a630-0a93052a140b service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:10:31.390198 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db03a0e-278f-4e4c-a630-0a93052a140b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:10:31.399409 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db03a0e-278f-4e4c-a630-0a93052a140b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:10:31.400885 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db03a0e-278f-4e4c-a630-0a93052a140b service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:10:31.410770 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1431/2852] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 17:10:31 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 17:10:31.546512 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecc92e3-c52f-4ee5-b962-0ea02df9b05d None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:10:31.609187 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecc92e3-c52f-4ee5-b962-0ea02df9b05d None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:10:31.613694 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d39ad1-40d8-40b9-99d3-65c5716bbacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:10:31.614560 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d39ad1-40d8-40b9-99d3-65c5716bbacb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:10:31.614845 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d39ad1-40d8-40b9-99d3-65c5716bbacb admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:10:31.615121 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d39ad1-40d8-40b9-99d3-65c5716bbacb admin admin] PATH_INFO: `/v3/users/69e50f0d228b4a69a9d6a237adea0bf6` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:10:31.616346 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d39ad1-40d8-40b9-99d3-65c5716bbacb admin admin] RBAC: Authorizing `identity:delete_user(user_id=69e50f0d228b4a69a9d6a237adea0bf6)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:10:31.618248 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d39ad1-40d8-40b9-99d3-65c5716bbacb admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:10:31.825838 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f6d39ad1-40d8-40b9-99d3-65c5716bbacb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69e50f0d228b4a69a9d6a237adea0bf6'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:10:31.885409 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f6d39ad1-40d8-40b9-99d3-65c5716bbacb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69e50f0d228b4a69a9d6a237adea0bf6'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:10:31.893607 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f6d39ad1-40d8-40b9-99d3-65c5716bbacb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69e50f0d228b4a69a9d6a237adea0bf6'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:10:31.894355 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f6d39ad1-40d8-40b9-99d3-65c5716bbacb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69e50f0d228b4a69a9d6a237adea0bf6'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:10:31.906575 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f6d39ad1-40d8-40b9-99d3-65c5716bbacb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69e50f0d228b4a69a9d6a237adea0bf6'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:10:31.912484 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1422/2853] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 17:10:31 2022] DELETE /identity/v3/users/69e50f0d228b4a69a9d6a237adea0bf6 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 17:10:31.917133 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3116d2-720d-45da-8ccc-0b0d22bb16b8 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:10:31.917625 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3116d2-720d-45da-8ccc-0b0d22bb16b8 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:10:31.917727 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3116d2-720d-45da-8ccc-0b0d22bb16b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:10:31.935501 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-1c3116d2-720d-45da-8ccc-0b0d22bb16b8 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 17:10:31.936756 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-1c3116d2-720d-45da-8ccc-0b0d22bb16b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:10:31.998089 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1432/2854] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 17:10:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 17:10:32.009328 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d39ad1-40d8-40b9-99d3-65c5716bbacb admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:10:32.010784 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-f6d39ad1-40d8-40b9-99d3-65c5716bbacb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:10:32.069586 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d39ad1-40d8-40b9-99d3-65c5716bbacb admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:10:32.073216 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fbff40-530c-4e61-8946-f73ae1471ef2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:10:32.073860 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fbff40-530c-4e61-8946-f73ae1471ef2 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:10:32.074136 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fbff40-530c-4e61-8946-f73ae1471ef2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:10:32.074993 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fbff40-530c-4e61-8946-f73ae1471ef2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:10:32.084122 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fbff40-530c-4e61-8946-f73ae1471ef2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:10:32.085510 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fbff40-530c-4e61-8946-f73ae1471ef2 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:10:32.095771 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1423/2855] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 17:10:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 17:10:32.919989 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3116d2-720d-45da-8ccc-0b0d22bb16b8 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:10:32.921459 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-1c3116d2-720d-45da-8ccc-0b0d22bb16b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:10:32.933715 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3116d2-720d-45da-8ccc-0b0d22bb16b8 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:10:32.938679 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0792471-6a84-4ef5-bf58-f8faea1368c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:10:32.939781 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0792471-6a84-4ef5-bf58-f8faea1368c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:10:32.940071 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0792471-6a84-4ef5-bf58-f8faea1368c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:10:32.940355 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0792471-6a84-4ef5-bf58-f8faea1368c0 admin admin] PATH_INFO: `/v3/projects/f17d075b53e24df3955a0579fc2a9db0` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:10:32.941582 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0792471-6a84-4ef5-bf58-f8faea1368c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f17d075b53e24df3955a0579fc2a9db0)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:10:32.943500 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0792471-6a84-4ef5-bf58-f8faea1368c0 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:10:33.054463 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-d0792471-6a84-4ef5-bf58-f8faea1368c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f17d075b53e24df3955a0579fc2a9db0', 'request_id': 'req-d0792471-6a84-4ef5-bf58-f8faea1368c0'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:10:33.059787 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-d0792471-6a84-4ef5-bf58-f8faea1368c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f17d075b53e24df3955a0579fc2a9db0', 'request_id': 'req-d0792471-6a84-4ef5-bf58-f8faea1368c0'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:10:33.140991 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-d0792471-6a84-4ef5-bf58-f8faea1368c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f17d075b53e24df3955a0579fc2a9db0', 'request_id': 'req-d0792471-6a84-4ef5-bf58-f8faea1368c0'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:10:33.153375 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-d0792471-6a84-4ef5-bf58-f8faea1368c0 admin admin] The token cache is being invalidate because project f17d075b53e24df3955a0579fc2a9db0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 17:10:33.157618 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-d0792471-6a84-4ef5-bf58-f8faea1368c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:10:33.157618 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-d0792471-6a84-4ef5-bf58-f8faea1368c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:10:33.157618 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1433/2856] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 17:10:32 2022] DELETE /identity/v3/projects/f17d075b53e24df3955a0579fc2a9db0 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 17:10:33.160114 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fbff40-530c-4e61-8946-f73ae1471ef2 service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:10:33.169879 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fbff40-530c-4e61-8946-f73ae1471ef2 service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:10:33.230841 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66beffc1-06b3-4e0b-860d-12d05e204d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:10:33.231943 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66beffc1-06b3-4e0b-860d-12d05e204d96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:10:33.232229 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66beffc1-06b3-4e0b-860d-12d05e204d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:10:33.232503 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66beffc1-06b3-4e0b-860d-12d05e204d96 admin admin] PATH_INFO: `/v3/users/2143b52c68f24a2d8e0502e9cf4b3fa8` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:10:33.233743 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66beffc1-06b3-4e0b-860d-12d05e204d96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2143b52c68f24a2d8e0502e9cf4b3fa8)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:10:33.235683 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66beffc1-06b3-4e0b-860d-12d05e204d96 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:10:33.497791 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-66beffc1-06b3-4e0b-860d-12d05e204d96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2143b52c68f24a2d8e0502e9cf4b3fa8'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:10:33.588323 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-66beffc1-06b3-4e0b-860d-12d05e204d96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2143b52c68f24a2d8e0502e9cf4b3fa8'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:10:33.595990 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-66beffc1-06b3-4e0b-860d-12d05e204d96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2143b52c68f24a2d8e0502e9cf4b3fa8'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:10:33.596635 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-66beffc1-06b3-4e0b-860d-12d05e204d96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2143b52c68f24a2d8e0502e9cf4b3fa8'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:10:33.608140 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-66beffc1-06b3-4e0b-860d-12d05e204d96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2143b52c68f24a2d8e0502e9cf4b3fa8'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:10:33.614074 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1424/2857] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 17:10:33 2022] DELETE /identity/v3/users/2143b52c68f24a2d8e0502e9cf4b3fa8 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 17:10:34.079496 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0792471-6a84-4ef5-bf58-f8faea1368c0 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:10:34.082274 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-d0792471-6a84-4ef5-bf58-f8faea1368c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:10:34.095350 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0792471-6a84-4ef5-bf58-f8faea1368c0 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:10:34.151853 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25182b59-06ab-4fdd-8cbd-c9d79a23355f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:10:34.153346 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25182b59-06ab-4fdd-8cbd-c9d79a23355f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:10:34.153615 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25182b59-06ab-4fdd-8cbd-c9d79a23355f admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:10:34.153896 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25182b59-06ab-4fdd-8cbd-c9d79a23355f admin admin] PATH_INFO: `/v3/projects/1238135e1e034f8da896421197d01e91` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:10:34.155088 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25182b59-06ab-4fdd-8cbd-c9d79a23355f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1238135e1e034f8da896421197d01e91)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:10:34.156998 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25182b59-06ab-4fdd-8cbd-c9d79a23355f admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:10:34.300805 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-25182b59-06ab-4fdd-8cbd-c9d79a23355f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1238135e1e034f8da896421197d01e91', 'request_id': 'req-25182b59-06ab-4fdd-8cbd-c9d79a23355f'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:10:34.305978 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-25182b59-06ab-4fdd-8cbd-c9d79a23355f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1238135e1e034f8da896421197d01e91', 'request_id': 'req-25182b59-06ab-4fdd-8cbd-c9d79a23355f'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:10:34.394223 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-25182b59-06ab-4fdd-8cbd-c9d79a23355f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1238135e1e034f8da896421197d01e91', 'request_id': 'req-25182b59-06ab-4fdd-8cbd-c9d79a23355f'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:10:34.407020 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-25182b59-06ab-4fdd-8cbd-c9d79a23355f admin admin] The token cache is being invalidate because project 1238135e1e034f8da896421197d01e91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 17:10:34.407306 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-25182b59-06ab-4fdd-8cbd-c9d79a23355f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:10:34.407953 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-25182b59-06ab-4fdd-8cbd-c9d79a23355f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:10:34.409519 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1434/2858] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 17:10:34 2022] DELETE /identity/v3/projects/1238135e1e034f8da896421197d01e91 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 17:10:34.414466 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af96f8-c4bf-4868-a492-31c79d5b21bb None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:10:34.414964 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af96f8-c4bf-4868-a492-31c79d5b21bb None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:10:34.415075 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af96f8-c4bf-4868-a492-31c79d5b21bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:10:34.432897 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-f2af96f8-c4bf-4868-a492-31c79d5b21bb None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 17:10:34.434118 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-f2af96f8-c4bf-4868-a492-31c79d5b21bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:10:34.497218 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1425/2859] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 17:10:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 17:10:34.506224 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a2515-4016-4afc-aab6-8802a305be16 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:10:34.506512 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a2515-4016-4afc-aab6-8802a305be16 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:10:34.506808 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a2515-4016-4afc-aab6-8802a305be16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:10:34.526273 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-399a2515-4016-4afc-aab6-8802a305be16 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 17:10:34.528151 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-399a2515-4016-4afc-aab6-8802a305be16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:10:34.536263 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1435/2860] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 17:10:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 17:10:34.541351 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2af96f8-c4bf-4868-a492-31c79d5b21bb None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:10:34.554777 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2af96f8-c4bf-4868-a492-31c79d5b21bb None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:10:34.560389 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d751501d-676f-4c86-a557-a665e3066d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:10:34.561067 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d751501d-676f-4c86-a557-a665e3066d86 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:10:34.561351 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d751501d-676f-4c86-a557-a665e3066d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:10:34.561631 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d751501d-676f-4c86-a557-a665e3066d86 admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:10:34.562367 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d751501d-676f-4c86-a557-a665e3066d86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 17:10:34.562678 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d751501d-676f-4c86-a557-a665e3066d86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:10:34.564315 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d751501d-676f-4c86-a557-a665e3066d86 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:10:34.576501 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1426/2861] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Apr 11 17:10:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 17:10:34.580845 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399a2515-4016-4afc-aab6-8802a305be16 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:10:34.590464 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399a2515-4016-4afc-aab6-8802a305be16 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:10:34.595086 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee81cb-e329-4a75-9628-05ee85c8c1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:10:34.595765 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee81cb-e329-4a75-9628-05ee85c8c1f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:10:34.596054 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee81cb-e329-4a75-9628-05ee85c8c1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:10:34.596328 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee81cb-e329-4a75-9628-05ee85c8c1f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:10:34.597013 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ee81cb-e329-4a75-9628-05ee85c8c1f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:10:34.598889 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ee81cb-e329-4a75-9628-05ee85c8c1f1 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:10:34.692866 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1436/2862] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 17:10:34 2022] POST /identity/v3/projects => generated 355 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 17:10:34.697062 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d751501d-676f-4c86-a557-a665e3066d86 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:10:34.708275 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d751501d-676f-4c86-a557-a665e3066d86 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:10:34.764122 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328bbb2f-1f93-4f78-b637-41ae24974a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:10:34.764741 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328bbb2f-1f93-4f78-b637-41ae24974a40 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:10:34.765031 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328bbb2f-1f93-4f78-b637-41ae24974a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:10:34.765312 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328bbb2f-1f93-4f78-b637-41ae24974a40 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:10:34.766018 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328bbb2f-1f93-4f78-b637-41ae24974a40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:10:34.767965 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328bbb2f-1f93-4f78-b637-41ae24974a40 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:10:34.901314 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1427/2863] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 17:10:34 2022] POST /identity/v3/users => generated 278 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 17:10:34.905503 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee81cb-e329-4a75-9628-05ee85c8c1f1 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:10:34.915679 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee81cb-e329-4a75-9628-05ee85c8c1f1 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:10:34.920275 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1037f482-925f-4a1d-b62b-e5ee2365de32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:10:34.924568 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037f482-925f-4a1d-b62b-e5ee2365de32 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:10:34.924568 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037f482-925f-4a1d-b62b-e5ee2365de32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:10:34.924568 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037f482-925f-4a1d-b62b-e5ee2365de32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:10:34.924568 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1037f482-925f-4a1d-b62b-e5ee2365de32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:10:34.924568 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1037f482-925f-4a1d-b62b-e5ee2365de32 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:10:34.934528 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1437/2864] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 17:10:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 17:10:34.938631 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328bbb2f-1f93-4f78-b637-41ae24974a40 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:10:34.949704 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328bbb2f-1f93-4f78-b637-41ae24974a40 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:10:34.955031 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba47b1c-73d0-4b56-824e-5a6aeb8fe0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:10:34.955740 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba47b1c-73d0-4b56-824e-5a6aeb8fe0e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:10:34.956030 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba47b1c-73d0-4b56-824e-5a6aeb8fe0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:10:34.956314 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba47b1c-73d0-4b56-824e-5a6aeb8fe0e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:10:34.957044 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba47b1c-73d0-4b56-824e-5a6aeb8fe0e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:10:34.958665 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba47b1c-73d0-4b56-824e-5a6aeb8fe0e7 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:10:34.969441 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1428/2865] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 17:10:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 17:10:34.973671 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1037f482-925f-4a1d-b62b-e5ee2365de32 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:10:34.984063 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1037f482-925f-4a1d-b62b-e5ee2365de32 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:10:34.988647 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4481f6a4-e651-4e72-8835-5a87adb24f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:10:34.989506 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4481f6a4-e651-4e72-8835-5a87adb24f89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:10:34.989787 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4481f6a4-e651-4e72-8835-5a87adb24f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:10:34.990065 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4481f6a4-e651-4e72-8835-5a87adb24f89 admin admin] PATH_INFO: `/v3/projects/59858a78450c479084425c7d3262ee8d/users/6dfcaa5913a6459c93e9c2c2ac564fe0/roles/0d41da7bec094450b5bff4e4831be52c` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:10:35.005036 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4481f6a4-e651-4e72-8835-5a87adb24f89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59858a78450c479084425c7d3262ee8d, user_id=6dfcaa5913a6459c93e9c2c2ac564fe0, role_id=0d41da7bec094450b5bff4e4831be52c)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:10:35.007719 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4481f6a4-e651-4e72-8835-5a87adb24f89 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:10:35.095852 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1438/2866] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 17:10:34 2022] PUT /identity/v3/projects/59858a78450c479084425c7d3262ee8d/users/6dfcaa5913a6459c93e9c2c2ac564fe0/roles/0d41da7bec094450b5bff4e4831be52c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 17:10:35.159976 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dba60d-54e5-46b6-8cd6-07eeb3967a7b None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:10:35.159976 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dba60d-54e5-46b6-8cd6-07eeb3967a7b None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:10:35.159976 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dba60d-54e5-46b6-8cd6-07eeb3967a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:10:35.185623 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-21dba60d-54e5-46b6-8cd6-07eeb3967a7b None None] MFA Rules not processed for user `6dfcaa5913a6459c93e9c2c2ac564fe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 17:10:35.186831 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-21dba60d-54e5-46b6-8cd6-07eeb3967a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:10:35.250280 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1429/2867] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 17:10:35 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 17:10:35.254711 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4481f6a4-e651-4e72-8835-5a87adb24f89 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:10:35.318552 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4481f6a4-e651-4e72-8835-5a87adb24f89 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:10:35.323759 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab07bea-903f-4d6a-82ec-e052e10a0ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:10:35.324443 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab07bea-903f-4d6a-82ec-e052e10a0ef5 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:10:35.324908 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab07bea-903f-4d6a-82ec-e052e10a0ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:10:35.325189 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab07bea-903f-4d6a-82ec-e052e10a0ef5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:10:35.325886 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab07bea-903f-4d6a-82ec-e052e10a0ef5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:10:35.327924 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab07bea-903f-4d6a-82ec-e052e10a0ef5 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:10:35.451195 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1439/2868] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 17:10:35 2022] POST /identity/v3/projects => generated 355 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 17:10:35.455299 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dba60d-54e5-46b6-8cd6-07eeb3967a7b None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:10:35.466124 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dba60d-54e5-46b6-8cd6-07eeb3967a7b None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:10:35.524106 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c6402c-9982-48ac-b117-5aef4bd48832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:10:35.524706 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c6402c-9982-48ac-b117-5aef4bd48832 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:10:35.524989 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c6402c-9982-48ac-b117-5aef4bd48832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:10:35.525269 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c6402c-9982-48ac-b117-5aef4bd48832 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:10:35.525971 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c6402c-9982-48ac-b117-5aef4bd48832 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:10:35.528057 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c6402c-9982-48ac-b117-5aef4bd48832 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:10:35.656391 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1430/2869] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 17:10:35 2022] POST /identity/v3/users => generated 284 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 17:10:35.660278 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab07bea-903f-4d6a-82ec-e052e10a0ef5 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:10:35.671940 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab07bea-903f-4d6a-82ec-e052e10a0ef5 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:10:35.676643 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe7c1c6-72a1-4cc8-bfa8-ee5b8f436be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:10:35.677295 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7c1c6-72a1-4cc8-bfa8-ee5b8f436be3 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:10:35.677577 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7c1c6-72a1-4cc8-bfa8-ee5b8f436be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:10:35.677854 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7c1c6-72a1-4cc8-bfa8-ee5b8f436be3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:10:35.678581 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe7c1c6-72a1-4cc8-bfa8-ee5b8f436be3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:10:35.680198 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe7c1c6-72a1-4cc8-bfa8-ee5b8f436be3 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:10:35.691171 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1440/2870] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 17:10:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 17:10:35.695762 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c6402c-9982-48ac-b117-5aef4bd48832 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:10:35.705979 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c6402c-9982-48ac-b117-5aef4bd48832 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:10:35.710575 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6847f4c5-3933-41b3-ab78-92d30613115f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:10:35.711455 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847f4c5-3933-41b3-ab78-92d30613115f admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:10:35.711767 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847f4c5-3933-41b3-ab78-92d30613115f admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:10:35.712045 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847f4c5-3933-41b3-ab78-92d30613115f admin admin] PATH_INFO: `/v3/projects/a3db767e7b334f83ba6eb877ac806e75/users/708c177662f8424894031a2664fc497a/roles/702e5e78b5d744529384b96a390ae92f` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:10:35.728655 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6847f4c5-3933-41b3-ab78-92d30613115f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3db767e7b334f83ba6eb877ac806e75, user_id=708c177662f8424894031a2664fc497a, role_id=702e5e78b5d744529384b96a390ae92f)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:10:35.732110 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6847f4c5-3933-41b3-ab78-92d30613115f admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:10:35.841230 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1431/2871] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 17:10:35 2022] PUT /identity/v3/projects/a3db767e7b334f83ba6eb877ac806e75/users/708c177662f8424894031a2664fc497a/roles/702e5e78b5d744529384b96a390ae92f => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 17:10:35.845153 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe7c1c6-72a1-4cc8-bfa8-ee5b8f436be3 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:10:35.856468 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe7c1c6-72a1-4cc8-bfa8-ee5b8f436be3 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:10:35.912186 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef8a8ed-2371-47aa-9188-22ce04582567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:10:35.912854 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef8a8ed-2371-47aa-9188-22ce04582567 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:10:35.913142 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef8a8ed-2371-47aa-9188-22ce04582567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:10:35.913423 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef8a8ed-2371-47aa-9188-22ce04582567 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:10:35.914151 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef8a8ed-2371-47aa-9188-22ce04582567 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:10:35.915764 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef8a8ed-2371-47aa-9188-22ce04582567 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:10:35.926537 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1441/2872] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 17:10:35 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 17:10:35.930665 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6847f4c5-3933-41b3-ab78-92d30613115f admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:10:35.940864 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6847f4c5-3933-41b3-ab78-92d30613115f admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:10:35.945485 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f25b9f-dc57-4082-9407-f2a62dc6cd41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:10:35.946366 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f25b9f-dc57-4082-9407-f2a62dc6cd41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:10:35.946652 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f25b9f-dc57-4082-9407-f2a62dc6cd41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:10:35.946927 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f25b9f-dc57-4082-9407-f2a62dc6cd41 admin admin] PATH_INFO: `/v3/projects/a3db767e7b334f83ba6eb877ac806e75/users/708c177662f8424894031a2664fc497a/roles/702e5e78b5d744529384b96a390ae92f` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:10:35.949451 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f25b9f-dc57-4082-9407-f2a62dc6cd41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3db767e7b334f83ba6eb877ac806e75, user_id=708c177662f8424894031a2664fc497a, role_id=702e5e78b5d744529384b96a390ae92f)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:10:35.952215 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f25b9f-dc57-4082-9407-f2a62dc6cd41 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:10:35.962517 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1432/2873] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 17:10:35 2022] PUT /identity/v3/projects/a3db767e7b334f83ba6eb877ac806e75/users/708c177662f8424894031a2664fc497a/roles/702e5e78b5d744529384b96a390ae92f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 17:10:35.973068 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9829a2eb-1741-4dac-8455-4baadfbc9672 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:10:35.973372 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9829a2eb-1741-4dac-8455-4baadfbc9672 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:10:35.973657 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9829a2eb-1741-4dac-8455-4baadfbc9672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:10:36.001630 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-9829a2eb-1741-4dac-8455-4baadfbc9672 None None] MFA Rules not processed for user `708c177662f8424894031a2664fc497a`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 17:10:36.002856 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-9829a2eb-1741-4dac-8455-4baadfbc9672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:10:36.069874 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1442/2874] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 17:10:35 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 17:10:36.081571 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f25b9f-dc57-4082-9407-f2a62dc6cd41 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:10:36.083269 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-a1f25b9f-dc57-4082-9407-f2a62dc6cd41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:10:36.158842 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f25b9f-dc57-4082-9407-f2a62dc6cd41 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:10:36.164736 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6288d50d-7af1-46f9-8ad9-81b3d45210f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '950b5b5f690d41509ead753065a0b793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:10:36.165898 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288d50d-7af1-46f9-8ad9-81b3d45210f1 service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:10:36.166405 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288d50d-7af1-46f9-8ad9-81b3d45210f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:10:36.166913 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288d50d-7af1-46f9-8ad9-81b3d45210f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:10:36.183251 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6288d50d-7af1-46f9-8ad9-81b3d45210f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:10:36.186140 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6288d50d-7af1-46f9-8ad9-81b3d45210f1 service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:10:36.197548 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1433/2875] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 17:10:36 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 17:10:36.447264 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9829a2eb-1741-4dac-8455-4baadfbc9672 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:10:36.458044 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9829a2eb-1741-4dac-8455-4baadfbc9672 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:10:36.461585 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2215e1-ec54-4486-8a53-cd884e8da43c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '950b5b5f690d41509ead753065a0b793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:10:36.462224 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2215e1-ec54-4486-8a53-cd884e8da43c service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:10:36.462512 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2215e1-ec54-4486-8a53-cd884e8da43c service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:10:36.462796 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2215e1-ec54-4486-8a53-cd884e8da43c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:10:36.523487 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2215e1-ec54-4486-8a53-cd884e8da43c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:10:36.524960 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2215e1-ec54-4486-8a53-cd884e8da43c service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:10:36.534074 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1443/2876] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 17:10:36 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 17:10:56.339469 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6288d50d-7af1-46f9-8ad9-81b3d45210f1 service cinder] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:10:56.407864 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6288d50d-7af1-46f9-8ad9-81b3d45210f1 service cinder] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:10:56.412559 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c77314-2a96-4a20-87ba-3e57e414f474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:10:56.413371 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c77314-2a96-4a20-87ba-3e57e414f474 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:10:56.413649 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c77314-2a96-4a20-87ba-3e57e414f474 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:10:56.413928 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c77314-2a96-4a20-87ba-3e57e414f474 admin admin] PATH_INFO: `/v3/users/6dfcaa5913a6459c93e9c2c2ac564fe0` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:10:56.415123 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c77314-2a96-4a20-87ba-3e57e414f474 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6dfcaa5913a6459c93e9c2c2ac564fe0)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:10:56.417114 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c77314-2a96-4a20-87ba-3e57e414f474 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:10:56.654414 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-06c77314-2a96-4a20-87ba-3e57e414f474 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6dfcaa5913a6459c93e9c2c2ac564fe0'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:10:56.736978 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-06c77314-2a96-4a20-87ba-3e57e414f474 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6dfcaa5913a6459c93e9c2c2ac564fe0'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:10:56.745688 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-06c77314-2a96-4a20-87ba-3e57e414f474 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6dfcaa5913a6459c93e9c2c2ac564fe0'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:10:56.746403 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-06c77314-2a96-4a20-87ba-3e57e414f474 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6dfcaa5913a6459c93e9c2c2ac564fe0'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:10:56.762457 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-06c77314-2a96-4a20-87ba-3e57e414f474 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6dfcaa5913a6459c93e9c2c2ac564fe0'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:10:56.768787 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1434/2877] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 17:10:56 2022] DELETE /identity/v3/users/6dfcaa5913a6459c93e9c2c2ac564fe0 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 17:10:56.773611 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8752e-2c23-462a-96ee-1943c569f441 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:10:56.774102 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8752e-2c23-462a-96ee-1943c569f441 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:10:56.774217 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8752e-2c23-462a-96ee-1943c569f441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:10:56.793363 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-35c8752e-2c23-462a-96ee-1943c569f441 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 17:10:56.794580 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-35c8752e-2c23-462a-96ee-1943c569f441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:10:56.852962 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1444/2878] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 17:10:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 17:10:56.863200 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c77314-2a96-4a20-87ba-3e57e414f474 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:10:56.864690 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-06c77314-2a96-4a20-87ba-3e57e414f474 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:10:56.922320 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c77314-2a96-4a20-87ba-3e57e414f474 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:10:56.925905 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af555200-c0a6-4b48-bb5e-d9e9e93063ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:10:56.926551 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af555200-c0a6-4b48-bb5e-d9e9e93063ec service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:10:56.926837 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af555200-c0a6-4b48-bb5e-d9e9e93063ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:10:56.927115 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af555200-c0a6-4b48-bb5e-d9e9e93063ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:10:56.937502 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af555200-c0a6-4b48-bb5e-d9e9e93063ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:10:56.938965 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af555200-c0a6-4b48-bb5e-d9e9e93063ec service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:10:56.948856 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1435/2879] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 17:10:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 17:10:57.436006 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c8752e-2c23-462a-96ee-1943c569f441 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:10:57.437572 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-35c8752e-2c23-462a-96ee-1943c569f441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:10:57.456292 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c8752e-2c23-462a-96ee-1943c569f441 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:10:57.462715 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66bf5f4-0bd8-470a-b8ff-4aaff186e69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:10:57.464884 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66bf5f4-0bd8-470a-b8ff-4aaff186e69c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:10:57.465384 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66bf5f4-0bd8-470a-b8ff-4aaff186e69c admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:10:57.465803 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66bf5f4-0bd8-470a-b8ff-4aaff186e69c admin admin] PATH_INFO: `/v3/projects/59858a78450c479084425c7d3262ee8d` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:10:57.467542 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66bf5f4-0bd8-470a-b8ff-4aaff186e69c admin admin] RBAC: Authorizing `identity:delete_project(project_id=59858a78450c479084425c7d3262ee8d)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:10:57.469692 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66bf5f4-0bd8-470a-b8ff-4aaff186e69c admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:10:57.571798 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e66bf5f4-0bd8-470a-b8ff-4aaff186e69c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59858a78450c479084425c7d3262ee8d', 'request_id': 'req-e66bf5f4-0bd8-470a-b8ff-4aaff186e69c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:10:57.577630 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e66bf5f4-0bd8-470a-b8ff-4aaff186e69c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59858a78450c479084425c7d3262ee8d', 'request_id': 'req-e66bf5f4-0bd8-470a-b8ff-4aaff186e69c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:10:57.651350 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e66bf5f4-0bd8-470a-b8ff-4aaff186e69c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59858a78450c479084425c7d3262ee8d', 'request_id': 'req-e66bf5f4-0bd8-470a-b8ff-4aaff186e69c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:10:57.667667 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e66bf5f4-0bd8-470a-b8ff-4aaff186e69c admin admin] The token cache is being invalidate because project 59858a78450c479084425c7d3262ee8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 17:10:57.667977 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e66bf5f4-0bd8-470a-b8ff-4aaff186e69c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:10:57.668671 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e66bf5f4-0bd8-470a-b8ff-4aaff186e69c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:10:57.670308 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1445/2880] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 17:10:57 2022] DELETE /identity/v3/projects/59858a78450c479084425c7d3262ee8d => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 17:10:57.674686 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af555200-c0a6-4b48-bb5e-d9e9e93063ec service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:10:57.685473 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af555200-c0a6-4b48-bb5e-d9e9e93063ec service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:10:57.753512 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dabfa6-d40a-4c7b-a618-860ce1589dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:10:57.754395 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dabfa6-d40a-4c7b-a618-860ce1589dea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:10:57.754683 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dabfa6-d40a-4c7b-a618-860ce1589dea admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:10:57.754962 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dabfa6-d40a-4c7b-a618-860ce1589dea admin admin] PATH_INFO: `/v3/users/708c177662f8424894031a2664fc497a` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:10:57.756286 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dabfa6-d40a-4c7b-a618-860ce1589dea admin admin] RBAC: Authorizing `identity:delete_user(user_id=708c177662f8424894031a2664fc497a)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:10:57.758255 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dabfa6-d40a-4c7b-a618-860ce1589dea admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:10:57.925638 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-90dabfa6-d40a-4c7b-a618-860ce1589dea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '708c177662f8424894031a2664fc497a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:10:57.997898 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-90dabfa6-d40a-4c7b-a618-860ce1589dea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '708c177662f8424894031a2664fc497a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:10:58.005697 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-90dabfa6-d40a-4c7b-a618-860ce1589dea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '708c177662f8424894031a2664fc497a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:10:58.006443 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-90dabfa6-d40a-4c7b-a618-860ce1589dea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '708c177662f8424894031a2664fc497a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:10:58.020828 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-90dabfa6-d40a-4c7b-a618-860ce1589dea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '708c177662f8424894031a2664fc497a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:10:58.026939 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1436/2881] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 17:10:57 2022] DELETE /identity/v3/users/708c177662f8424894031a2664fc497a => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 17:10:58.458691 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66bf5f4-0bd8-470a-b8ff-4aaff186e69c admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:10:58.460351 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e66bf5f4-0bd8-470a-b8ff-4aaff186e69c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:10:58.480740 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66bf5f4-0bd8-470a-b8ff-4aaff186e69c admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:10:58.552546 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df88a436-0330-4cf0-adec-7522d50f11e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:10:58.553316 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df88a436-0330-4cf0-adec-7522d50f11e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:10:58.553622 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df88a436-0330-4cf0-adec-7522d50f11e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:10:58.553895 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df88a436-0330-4cf0-adec-7522d50f11e5 admin admin] PATH_INFO: `/v3/projects/a3db767e7b334f83ba6eb877ac806e75` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:10:58.555071 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df88a436-0330-4cf0-adec-7522d50f11e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3db767e7b334f83ba6eb877ac806e75)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:10:58.557640 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df88a436-0330-4cf0-adec-7522d50f11e5 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:10:58.664241 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-df88a436-0330-4cf0-adec-7522d50f11e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3db767e7b334f83ba6eb877ac806e75', 'request_id': 'req-df88a436-0330-4cf0-adec-7522d50f11e5'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:10:58.669080 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-df88a436-0330-4cf0-adec-7522d50f11e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3db767e7b334f83ba6eb877ac806e75', 'request_id': 'req-df88a436-0330-4cf0-adec-7522d50f11e5'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:10:58.740138 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-df88a436-0330-4cf0-adec-7522d50f11e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3db767e7b334f83ba6eb877ac806e75', 'request_id': 'req-df88a436-0330-4cf0-adec-7522d50f11e5'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:10:58.752180 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-df88a436-0330-4cf0-adec-7522d50f11e5 admin admin] The token cache is being invalidate because project a3db767e7b334f83ba6eb877ac806e75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 17:10:58.752561 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-df88a436-0330-4cf0-adec-7522d50f11e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:10:58.753303 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-df88a436-0330-4cf0-adec-7522d50f11e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:10:58.754923 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1446/2882] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 17:10:58 2022] DELETE /identity/v3/projects/a3db767e7b334f83ba6eb877ac806e75 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 17:10:58.760363 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f6d9a-e3c4-4006-b759-e184bbd1fc76 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:10:58.761456 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f6d9a-e3c4-4006-b759-e184bbd1fc76 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:10:58.761622 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f6d9a-e3c4-4006-b759-e184bbd1fc76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:10:58.787083 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-345f6d9a-e3c4-4006-b759-e184bbd1fc76 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 17:10:58.789254 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-345f6d9a-e3c4-4006-b759-e184bbd1fc76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:10:58.874370 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1437/2883] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 17:10:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 17:10:58.882846 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c7667-2e64-4b39-b9a6-6946bad50d33 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:10:58.883223 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c7667-2e64-4b39-b9a6-6946bad50d33 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:10:58.883626 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c7667-2e64-4b39-b9a6-6946bad50d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:10:58.903875 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-935c7667-2e64-4b39-b9a6-6946bad50d33 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 17:10:58.905162 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-935c7667-2e64-4b39-b9a6-6946bad50d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:10:58.913783 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1447/2884] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 17:10:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 17:10:58.919202 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f6d9a-e3c4-4006-b759-e184bbd1fc76 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:10:58.929546 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f6d9a-e3c4-4006-b759-e184bbd1fc76 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:10:58.937328 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40918056-c45f-4525-a5c6-aec3e0c2b0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:10:58.938479 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40918056-c45f-4525-a5c6-aec3e0c2b0dc admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:10:58.938954 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40918056-c45f-4525-a5c6-aec3e0c2b0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:10:58.939428 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40918056-c45f-4525-a5c6-aec3e0c2b0dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:10:58.940901 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40918056-c45f-4525-a5c6-aec3e0c2b0dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 17:10:58.941461 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40918056-c45f-4525-a5c6-aec3e0c2b0dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:10:58.944587 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40918056-c45f-4525-a5c6-aec3e0c2b0dc admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:10:58.962717 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1438/2885] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Apr 11 17:10:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 17:10:58.968159 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c7667-2e64-4b39-b9a6-6946bad50d33 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:10:58.977927 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c7667-2e64-4b39-b9a6-6946bad50d33 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:10:58.984191 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14098659-c141-424a-ab38-7a399d3820ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:10:58.984884 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14098659-c141-424a-ab38-7a399d3820ec admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:10:58.985171 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14098659-c141-424a-ab38-7a399d3820ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:10:58.985454 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14098659-c141-424a-ab38-7a399d3820ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:10:58.986271 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14098659-c141-424a-ab38-7a399d3820ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:10:58.988382 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14098659-c141-424a-ab38-7a399d3820ec admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:10:59.076447 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1448/2886] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 17:10:58 2022] POST /identity/v3/projects => generated 371 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 17:10:59.081082 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40918056-c45f-4525-a5c6-aec3e0c2b0dc admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:10:59.092654 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40918056-c45f-4525-a5c6-aec3e0c2b0dc admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:10:59.153622 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa79c925-6e7c-45cf-9289-9dc1010ca18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:10:59.154260 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa79c925-6e7c-45cf-9289-9dc1010ca18f admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:10:59.154544 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa79c925-6e7c-45cf-9289-9dc1010ca18f admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:10:59.154816 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa79c925-6e7c-45cf-9289-9dc1010ca18f admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:10:59.155545 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa79c925-6e7c-45cf-9289-9dc1010ca18f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:10:59.157599 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa79c925-6e7c-45cf-9289-9dc1010ca18f admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:10:59.255428 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1439/2887] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 17:10:59 2022] POST /identity/v3/users => generated 286 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 17:10:59.260205 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14098659-c141-424a-ab38-7a399d3820ec admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:10:59.272892 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14098659-c141-424a-ab38-7a399d3820ec admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:10:59.278570 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab4fd20-ea83-436f-955b-49c42ceab40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:10:59.279273 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4fd20-ea83-436f-955b-49c42ceab40f admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:10:59.279583 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4fd20-ea83-436f-955b-49c42ceab40f admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:10:59.279865 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4fd20-ea83-436f-955b-49c42ceab40f admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:10:59.280622 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab4fd20-ea83-436f-955b-49c42ceab40f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:10:59.283560 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab4fd20-ea83-436f-955b-49c42ceab40f admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:10:59.294233 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1449/2888] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 17:10:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 17:10:59.299973 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa79c925-6e7c-45cf-9289-9dc1010ca18f admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:10:59.312143 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa79c925-6e7c-45cf-9289-9dc1010ca18f admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:10:59.322235 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bbe4d2-4e46-436b-b849-9af52973ec22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:10:59.324076 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bbe4d2-4e46-436b-b849-9af52973ec22 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:10:59.324594 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bbe4d2-4e46-436b-b849-9af52973ec22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:10:59.325105 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bbe4d2-4e46-436b-b849-9af52973ec22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:10:59.326533 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bbe4d2-4e46-436b-b849-9af52973ec22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:10:59.329778 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bbe4d2-4e46-436b-b849-9af52973ec22 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:10:59.345617 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1440/2889] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 17:10:59 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 17:10:59.350679 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab4fd20-ea83-436f-955b-49c42ceab40f admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:10:59.361850 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab4fd20-ea83-436f-955b-49c42ceab40f admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:10:59.367060 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1ae324-484e-46fa-9c62-185c65956b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:10:59.368009 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ae324-484e-46fa-9c62-185c65956b82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:10:59.368297 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ae324-484e-46fa-9c62-185c65956b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:10:59.368596 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ae324-484e-46fa-9c62-185c65956b82 admin admin] PATH_INFO: `/v3/projects/37b6a24a33a7476fa483c3632043f2c1/users/5d685227094547368827a3680c59008a/roles/0d41da7bec094450b5bff4e4831be52c` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:10:59.389869 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1ae324-484e-46fa-9c62-185c65956b82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37b6a24a33a7476fa483c3632043f2c1, user_id=5d685227094547368827a3680c59008a, role_id=0d41da7bec094450b5bff4e4831be52c)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:10:59.395591 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1ae324-484e-46fa-9c62-185c65956b82 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:10:59.480912 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1450/2890] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 17:10:59 2022] PUT /identity/v3/projects/37b6a24a33a7476fa483c3632043f2c1/users/5d685227094547368827a3680c59008a/roles/0d41da7bec094450b5bff4e4831be52c => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 17:10:59.492421 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6475e8-0d31-4713-9946-5ab837521355 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:10:59.492710 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6475e8-0d31-4713-9946-5ab837521355 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:10:59.492990 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6475e8-0d31-4713-9946-5ab837521355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:10:59.523942 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-2b6475e8-0d31-4713-9946-5ab837521355 None None] MFA Rules not processed for user `5d685227094547368827a3680c59008a`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 17:10:59.525370 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-2b6475e8-0d31-4713-9946-5ab837521355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:10:59.594113 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1441/2891] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 17:10:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 17:10:59.605459 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1ae324-484e-46fa-9c62-185c65956b82 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:10:59.607186 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-9f1ae324-484e-46fa-9c62-185c65956b82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:10:59.669243 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1ae324-484e-46fa-9c62-185c65956b82 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:10:59.674287 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d91a4-e381-4cd9-ad70-abee9226850e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '950b5b5f690d41509ead753065a0b793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:10:59.674952 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d91a4-e381-4cd9-ad70-abee9226850e service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:10:59.675238 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d91a4-e381-4cd9-ad70-abee9226850e service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:10:59.675527 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d91a4-e381-4cd9-ad70-abee9226850e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:10:59.685443 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55d91a4-e381-4cd9-ad70-abee9226850e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:10:59.686919 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55d91a4-e381-4cd9-ad70-abee9226850e service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:10:59.696862 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1451/2892] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 17:10:59 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 17:10:59.717084 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6475e8-0d31-4713-9946-5ab837521355 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:10:59.781053 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6475e8-0d31-4713-9946-5ab837521355 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:10:59.787452 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0c53af-da1b-457b-a5b1-a53322aba0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:10:59.788377 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c53af-da1b-457b-a5b1-a53322aba0f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:10:59.788659 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c53af-da1b-457b-a5b1-a53322aba0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:10:59.788961 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c53af-da1b-457b-a5b1-a53322aba0f5 admin admin] PATH_INFO: `/v3/users/5d685227094547368827a3680c59008a` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:10:59.790363 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0c53af-da1b-457b-a5b1-a53322aba0f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d685227094547368827a3680c59008a)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:10:59.792707 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0c53af-da1b-457b-a5b1-a53322aba0f5 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:10:59.972987 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-0e0c53af-da1b-457b-a5b1-a53322aba0f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d685227094547368827a3680c59008a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:11:00.079618 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-0e0c53af-da1b-457b-a5b1-a53322aba0f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d685227094547368827a3680c59008a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:11:00.084541 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-0e0c53af-da1b-457b-a5b1-a53322aba0f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d685227094547368827a3680c59008a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:11:00.085232 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-0e0c53af-da1b-457b-a5b1-a53322aba0f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d685227094547368827a3680c59008a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:11:00.097328 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-0e0c53af-da1b-457b-a5b1-a53322aba0f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d685227094547368827a3680c59008a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:11:00.103378 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1442/2893] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 17:10:59 2022] DELETE /identity/v3/users/5d685227094547368827a3680c59008a => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 17:11:00.108885 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c73b2fb-b53b-4c09-8085-051e1b99929b None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:11:00.109160 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c73b2fb-b53b-4c09-8085-051e1b99929b None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:11:00.109448 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c73b2fb-b53b-4c09-8085-051e1b99929b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:11:00.127736 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-3c73b2fb-b53b-4c09-8085-051e1b99929b None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 17:11:00.128966 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-3c73b2fb-b53b-4c09-8085-051e1b99929b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:11:00.189205 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1452/2894] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 17:11:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 17:11:00.199853 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0c53af-da1b-457b-a5b1-a53322aba0f5 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:11:00.201496 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-0e0c53af-da1b-457b-a5b1-a53322aba0f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:11:00.263977 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0c53af-da1b-457b-a5b1-a53322aba0f5 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:11:00.268288 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a75e79b-1867-4df6-a94f-08663e02e909 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:11:00.269400 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75e79b-1867-4df6-a94f-08663e02e909 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:11:00.269519 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75e79b-1867-4df6-a94f-08663e02e909 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:11:00.269970 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75e79b-1867-4df6-a94f-08663e02e909 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:11:00.280353 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a75e79b-1867-4df6-a94f-08663e02e909 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:11:00.281835 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a75e79b-1867-4df6-a94f-08663e02e909 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:11:00.292586 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1443/2895] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 17:11:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 17:11:00.744148 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c73b2fb-b53b-4c09-8085-051e1b99929b None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:11:00.746493 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-3c73b2fb-b53b-4c09-8085-051e1b99929b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:11:00.758377 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c73b2fb-b53b-4c09-8085-051e1b99929b None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:11:00.763315 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f3a5d1-98ce-4a94-bde5-c0a49fa407e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:11:00.764228 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f3a5d1-98ce-4a94-bde5-c0a49fa407e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:11:00.764510 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f3a5d1-98ce-4a94-bde5-c0a49fa407e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:11:00.764787 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f3a5d1-98ce-4a94-bde5-c0a49fa407e4 admin admin] PATH_INFO: `/v3/projects/37b6a24a33a7476fa483c3632043f2c1` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:11:00.766036 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f3a5d1-98ce-4a94-bde5-c0a49fa407e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37b6a24a33a7476fa483c3632043f2c1)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:11:00.768119 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f3a5d1-98ce-4a94-bde5-c0a49fa407e4 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:11:00.879751 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e3f3a5d1-98ce-4a94-bde5-c0a49fa407e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37b6a24a33a7476fa483c3632043f2c1', 'request_id': 'req-e3f3a5d1-98ce-4a94-bde5-c0a49fa407e4'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:11:00.885180 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e3f3a5d1-98ce-4a94-bde5-c0a49fa407e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37b6a24a33a7476fa483c3632043f2c1', 'request_id': 'req-e3f3a5d1-98ce-4a94-bde5-c0a49fa407e4'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:11:00.980714 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e3f3a5d1-98ce-4a94-bde5-c0a49fa407e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37b6a24a33a7476fa483c3632043f2c1', 'request_id': 'req-e3f3a5d1-98ce-4a94-bde5-c0a49fa407e4'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:11:00.992467 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e3f3a5d1-98ce-4a94-bde5-c0a49fa407e4 admin admin] The token cache is being invalidate because project 37b6a24a33a7476fa483c3632043f2c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 17:11:00.992672 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e3f3a5d1-98ce-4a94-bde5-c0a49fa407e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:11:00.993305 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e3f3a5d1-98ce-4a94-bde5-c0a49fa407e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:11:00.995402 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1453/2896] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 17:11:00 2022] DELETE /identity/v3/projects/37b6a24a33a7476fa483c3632043f2c1 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 17:11:01.000428 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b56c92-f729-4536-b0fc-80b7426176a9 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:11:01.005337 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b56c92-f729-4536-b0fc-80b7426176a9 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:11:01.005337 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b56c92-f729-4536-b0fc-80b7426176a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:11:01.025866 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-89b56c92-f729-4536-b0fc-80b7426176a9 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 17:11:01.027084 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-89b56c92-f729-4536-b0fc-80b7426176a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:11:01.087544 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1444/2897] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 17:11:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 17:11:01.097462 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61762917-0188-4633-b3ff-84c0c7c41815 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:11:01.097746 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61762917-0188-4633-b3ff-84c0c7c41815 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:11:01.098025 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61762917-0188-4633-b3ff-84c0c7c41815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:11:01.117618 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-61762917-0188-4633-b3ff-84c0c7c41815 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 17:11:01.118808 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-61762917-0188-4633-b3ff-84c0c7c41815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:11:01.127008 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1454/2898] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 17:11:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 17:11:01.131197 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b56c92-f729-4536-b0fc-80b7426176a9 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:11:01.141010 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b56c92-f729-4536-b0fc-80b7426176a9 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:11:01.145897 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b25f33-6dd7-4c7c-84fa-9dba9b6cdda4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:11:01.146551 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b25f33-6dd7-4c7c-84fa-9dba9b6cdda4 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:11:01.146833 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b25f33-6dd7-4c7c-84fa-9dba9b6cdda4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:11:01.147108 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b25f33-6dd7-4c7c-84fa-9dba9b6cdda4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:11:01.147896 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b25f33-6dd7-4c7c-84fa-9dba9b6cdda4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 17:11:01.148207 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b25f33-6dd7-4c7c-84fa-9dba9b6cdda4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:11:01.149796 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b25f33-6dd7-4c7c-84fa-9dba9b6cdda4 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:11:01.161862 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1445/2899] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Apr 11 17:11:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 17:11:01.166373 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61762917-0188-4633-b3ff-84c0c7c41815 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:11:01.176217 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61762917-0188-4633-b3ff-84c0c7c41815 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:11:01.180930 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d11c52a-dc48-4228-bfd8-a204daeb74ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:11:01.181605 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11c52a-dc48-4228-bfd8-a204daeb74ff admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:11:01.181887 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11c52a-dc48-4228-bfd8-a204daeb74ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:11:01.182162 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11c52a-dc48-4228-bfd8-a204daeb74ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:11:01.182990 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d11c52a-dc48-4228-bfd8-a204daeb74ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:11:01.184951 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d11c52a-dc48-4228-bfd8-a204daeb74ff admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:11:01.298986 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1455/2900] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 17:11:01 2022] POST /identity/v3/projects => generated 373 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 17:11:01.302916 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b25f33-6dd7-4c7c-84fa-9dba9b6cdda4 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:11:01.312910 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b25f33-6dd7-4c7c-84fa-9dba9b6cdda4 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:11:01.370793 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea950a8-1a43-45f1-acbc-729ef92d3357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:11:01.371471 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea950a8-1a43-45f1-acbc-729ef92d3357 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:11:01.371793 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea950a8-1a43-45f1-acbc-729ef92d3357 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:11:01.372069 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea950a8-1a43-45f1-acbc-729ef92d3357 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:11:01.372768 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea950a8-1a43-45f1-acbc-729ef92d3357 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:11:01.374710 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea950a8-1a43-45f1-acbc-729ef92d3357 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:11:01.491181 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1446/2901] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 17:11:01 2022] POST /identity/v3/users => generated 287 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 17:11:01.495813 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d11c52a-dc48-4228-bfd8-a204daeb74ff admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:11:01.506794 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d11c52a-dc48-4228-bfd8-a204daeb74ff admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:11:01.513126 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741be84c-3d45-4bf7-83ca-2f8f87a592dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:11:01.514856 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741be84c-3d45-4bf7-83ca-2f8f87a592dc admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:11:01.514856 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741be84c-3d45-4bf7-83ca-2f8f87a592dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:11:01.514856 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741be84c-3d45-4bf7-83ca-2f8f87a592dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:11:01.515129 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741be84c-3d45-4bf7-83ca-2f8f87a592dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:11:01.516871 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741be84c-3d45-4bf7-83ca-2f8f87a592dc admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:11:01.529055 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1456/2902] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 17:11:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 17:11:01.533090 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea950a8-1a43-45f1-acbc-729ef92d3357 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:11:01.544387 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea950a8-1a43-45f1-acbc-729ef92d3357 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:11:01.551992 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a0f911-e2fc-42d1-a412-6eab409d18d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:11:01.551992 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0f911-e2fc-42d1-a412-6eab409d18d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:11:01.551992 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0f911-e2fc-42d1-a412-6eab409d18d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:11:01.551992 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0f911-e2fc-42d1-a412-6eab409d18d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:11:01.552464 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a0f911-e2fc-42d1-a412-6eab409d18d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:11:01.552746 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a0f911-e2fc-42d1-a412-6eab409d18d7 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:11:01.562915 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1447/2903] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 17:11:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 17:11:01.567128 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741be84c-3d45-4bf7-83ca-2f8f87a592dc admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:11:01.577529 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741be84c-3d45-4bf7-83ca-2f8f87a592dc admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:11:01.582066 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f5785b-8cdf-480d-b625-bed16024ce3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:11:01.583004 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5785b-8cdf-480d-b625-bed16024ce3f admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:11:01.583282 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5785b-8cdf-480d-b625-bed16024ce3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:11:01.583585 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5785b-8cdf-480d-b625-bed16024ce3f admin admin] PATH_INFO: `/v3/projects/bf1fdb9334a84eaea29d42e18c611025/users/c5f15a7ed42441c99ffe81626922b2c2/roles/0d41da7bec094450b5bff4e4831be52c` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:11:01.599317 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f5785b-8cdf-480d-b625-bed16024ce3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf1fdb9334a84eaea29d42e18c611025, user_id=c5f15a7ed42441c99ffe81626922b2c2, role_id=0d41da7bec094450b5bff4e4831be52c)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:11:01.602095 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f5785b-8cdf-480d-b625-bed16024ce3f admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:11:01.706489 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1457/2904] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 17:11:01 2022] PUT /identity/v3/projects/bf1fdb9334a84eaea29d42e18c611025/users/c5f15a7ed42441c99ffe81626922b2c2/roles/0d41da7bec094450b5bff4e4831be52c => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 17:11:01.718010 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e0d44-e49b-45ae-a119-130e25d182ab None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:11:01.718311 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e0d44-e49b-45ae-a119-130e25d182ab None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:11:01.718593 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e0d44-e49b-45ae-a119-130e25d182ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:11:01.744341 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-820e0d44-e49b-45ae-a119-130e25d182ab None None] MFA Rules not processed for user `c5f15a7ed42441c99ffe81626922b2c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 17:11:01.745558 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-820e0d44-e49b-45ae-a119-130e25d182ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:11:01.809907 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1448/2905] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 17:11:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 17:11:01.814629 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f5785b-8cdf-480d-b625-bed16024ce3f admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:11:01.873451 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f5785b-8cdf-480d-b625-bed16024ce3f admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:11:01.878081 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16316304-1066-42bc-8c28-23563377afdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:11:01.878734 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16316304-1066-42bc-8c28-23563377afdd admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:11:01.879017 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16316304-1066-42bc-8c28-23563377afdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:11:01.879291 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16316304-1066-42bc-8c28-23563377afdd admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:11:01.880017 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16316304-1066-42bc-8c28-23563377afdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:11:01.881893 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16316304-1066-42bc-8c28-23563377afdd admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:11:01.975356 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1458/2906] 10.222.0.43 () {60 vars in 1152 bytes} [Mon Apr 11 17:11:01 2022] POST /identity/v3/projects => generated 375 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 17:11:01.976672 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820e0d44-e49b-45ae-a119-130e25d182ab None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:11:01.987757 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820e0d44-e49b-45ae-a119-130e25d182ab None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:11:02.044749 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab3aa71-876b-4fb1-8bc2-56b97f606ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:11:02.045431 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab3aa71-876b-4fb1-8bc2-56b97f606ec5 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:11:02.045695 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab3aa71-876b-4fb1-8bc2-56b97f606ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:11:02.045974 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab3aa71-876b-4fb1-8bc2-56b97f606ec5 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:11:02.046700 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab3aa71-876b-4fb1-8bc2-56b97f606ec5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:11:02.048639 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab3aa71-876b-4fb1-8bc2-56b97f606ec5 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:11:02.134646 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1449/2907] 10.222.0.43 () {60 vars in 1143 bytes} [Mon Apr 11 17:11:01 2022] POST /identity/v3/users => generated 294 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 17:11:02.138744 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16316304-1066-42bc-8c28-23563377afdd admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:11:02.149663 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16316304-1066-42bc-8c28-23563377afdd admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:11:02.155368 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea71d5a-84ad-4acc-bb11-442238f268bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:11:02.155979 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea71d5a-84ad-4acc-bb11-442238f268bf admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:11:02.156268 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea71d5a-84ad-4acc-bb11-442238f268bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:11:02.156538 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea71d5a-84ad-4acc-bb11-442238f268bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:11:02.157261 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea71d5a-84ad-4acc-bb11-442238f268bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:11:02.158849 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea71d5a-84ad-4acc-bb11-442238f268bf admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:11:02.171230 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1459/2908] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 17:11:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 17:11:02.175617 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab3aa71-876b-4fb1-8bc2-56b97f606ec5 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:11:02.185966 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab3aa71-876b-4fb1-8bc2-56b97f606ec5 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:11:02.190656 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72175ade-c51f-43ce-be57-452fcc4082f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:11:02.191568 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72175ade-c51f-43ce-be57-452fcc4082f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:11:02.191855 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72175ade-c51f-43ce-be57-452fcc4082f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:11:02.192136 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72175ade-c51f-43ce-be57-452fcc4082f5 admin admin] PATH_INFO: `/v3/projects/df5952088f084b2cbef86c3f01c659ef/users/ebcf80e49dd449c1a52c7f1b0799194e/roles/702e5e78b5d744529384b96a390ae92f` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:11:02.208472 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72175ade-c51f-43ce-be57-452fcc4082f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df5952088f084b2cbef86c3f01c659ef, user_id=ebcf80e49dd449c1a52c7f1b0799194e, role_id=702e5e78b5d744529384b96a390ae92f)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:11:02.211140 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72175ade-c51f-43ce-be57-452fcc4082f5 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:11:02.288931 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1450/2909] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 17:11:02 2022] PUT /identity/v3/projects/df5952088f084b2cbef86c3f01c659ef/users/ebcf80e49dd449c1a52c7f1b0799194e/roles/702e5e78b5d744529384b96a390ae92f => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 17:11:02.292964 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea71d5a-84ad-4acc-bb11-442238f268bf admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:11:02.302973 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea71d5a-84ad-4acc-bb11-442238f268bf admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:11:02.357604 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfdcd1b-2456-402a-8329-49ed96b064c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:11:02.358274 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfdcd1b-2456-402a-8329-49ed96b064c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:11:02.358558 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfdcd1b-2456-402a-8329-49ed96b064c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:11:02.358835 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfdcd1b-2456-402a-8329-49ed96b064c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:11:02.359584 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfdcd1b-2456-402a-8329-49ed96b064c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:11:02.361178 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfdcd1b-2456-402a-8329-49ed96b064c2 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:11:02.370645 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1460/2910] 10.222.0.43 () {58 vars in 1121 bytes} [Mon Apr 11 17:11:02 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 17:11:02.375045 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72175ade-c51f-43ce-be57-452fcc4082f5 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:11:02.385290 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72175ade-c51f-43ce-be57-452fcc4082f5 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:11:02.390352 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4950bf5f-5e29-479b-98c4-1f5239a19fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:11:02.391221 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950bf5f-5e29-479b-98c4-1f5239a19fbf admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:11:02.391498 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950bf5f-5e29-479b-98c4-1f5239a19fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:11:02.391800 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950bf5f-5e29-479b-98c4-1f5239a19fbf admin admin] PATH_INFO: `/v3/projects/df5952088f084b2cbef86c3f01c659ef/users/ebcf80e49dd449c1a52c7f1b0799194e/roles/702e5e78b5d744529384b96a390ae92f` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:11:02.394009 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4950bf5f-5e29-479b-98c4-1f5239a19fbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=df5952088f084b2cbef86c3f01c659ef, user_id=ebcf80e49dd449c1a52c7f1b0799194e, role_id=702e5e78b5d744529384b96a390ae92f)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:11:02.396645 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4950bf5f-5e29-479b-98c4-1f5239a19fbf admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:11:02.407729 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1451/2911] 10.222.0.43 () {60 vars in 1482 bytes} [Mon Apr 11 17:11:02 2022] PUT /identity/v3/projects/df5952088f084b2cbef86c3f01c659ef/users/ebcf80e49dd449c1a52c7f1b0799194e/roles/702e5e78b5d744529384b96a390ae92f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 17:11:02.417941 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12662bbe-a3aa-466b-afb7-78e861870bac None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:11:02.418235 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12662bbe-a3aa-466b-afb7-78e861870bac None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:11:02.418602 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12662bbe-a3aa-466b-afb7-78e861870bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:11:02.445874 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-12662bbe-a3aa-466b-afb7-78e861870bac None None] MFA Rules not processed for user `ebcf80e49dd449c1a52c7f1b0799194e`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 17:11:02.447204 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-12662bbe-a3aa-466b-afb7-78e861870bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:11:02.517518 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1461/2912] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 17:11:02 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 17:11:02.529909 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4950bf5f-5e29-479b-98c4-1f5239a19fbf admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:11:02.531657 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-4950bf5f-5e29-479b-98c4-1f5239a19fbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:11:02.588873 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4950bf5f-5e29-479b-98c4-1f5239a19fbf admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:11:02.592642 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e2ad99-b149-4453-a9c3-6cf4e1e7c003 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '950b5b5f690d41509ead753065a0b793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:11:02.593290 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e2ad99-b149-4453-a9c3-6cf4e1e7c003 service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:11:02.593578 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e2ad99-b149-4453-a9c3-6cf4e1e7c003 service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:11:02.593886 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e2ad99-b149-4453-a9c3-6cf4e1e7c003 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:11:02.648962 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e2ad99-b149-4453-a9c3-6cf4e1e7c003 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:11:02.650304 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e2ad99-b149-4453-a9c3-6cf4e1e7c003 service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:11:02.659196 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1452/2913] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 17:11:02 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 17:11:05.990073 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12662bbe-a3aa-466b-afb7-78e861870bac None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:11:06.059179 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12662bbe-a3aa-466b-afb7-78e861870bac None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:11:06.063719 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb916a9-1a7b-44ac-a37d-1e02534c815d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:11:06.064618 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb916a9-1a7b-44ac-a37d-1e02534c815d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:11:06.064897 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb916a9-1a7b-44ac-a37d-1e02534c815d admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:11:06.065171 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb916a9-1a7b-44ac-a37d-1e02534c815d admin admin] PATH_INFO: `/v3/users/c5f15a7ed42441c99ffe81626922b2c2` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:11:06.066383 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb916a9-1a7b-44ac-a37d-1e02534c815d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5f15a7ed42441c99ffe81626922b2c2)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:11:06.068324 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb916a9-1a7b-44ac-a37d-1e02534c815d admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:11:06.310987 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-8fb916a9-1a7b-44ac-a37d-1e02534c815d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5f15a7ed42441c99ffe81626922b2c2'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:11:06.315473 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-8fb916a9-1a7b-44ac-a37d-1e02534c815d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5f15a7ed42441c99ffe81626922b2c2'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:11:06.403330 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-8fb916a9-1a7b-44ac-a37d-1e02534c815d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5f15a7ed42441c99ffe81626922b2c2'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:11:06.411013 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-8fb916a9-1a7b-44ac-a37d-1e02534c815d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5f15a7ed42441c99ffe81626922b2c2'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:11:06.424090 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-8fb916a9-1a7b-44ac-a37d-1e02534c815d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5f15a7ed42441c99ffe81626922b2c2'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:11:06.430132 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1462/2914] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 17:11:05 2022] DELETE /identity/v3/users/c5f15a7ed42441c99ffe81626922b2c2 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 17:11:06.435634 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7a0df-ef24-4aef-b16f-0fd5d09a8215 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:11:06.436176 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7a0df-ef24-4aef-b16f-0fd5d09a8215 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:11:06.436290 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7a0df-ef24-4aef-b16f-0fd5d09a8215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:11:06.454079 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-9ea7a0df-ef24-4aef-b16f-0fd5d09a8215 None None] MFA Rules not processed for user `f5967d9641344da186ff23b8711ba0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 17:11:06.455298 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-9ea7a0df-ef24-4aef-b16f-0fd5d09a8215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:11:06.519419 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1453/2915] 10.222.0.43 () {58 vars in 957 bytes} [Mon Apr 11 17:11:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 17:11:06.529602 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb916a9-1a7b-44ac-a37d-1e02534c815d admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:11:06.531064 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-8fb916a9-1a7b-44ac-a37d-1e02534c815d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:11:06.588054 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb916a9-1a7b-44ac-a37d-1e02534c815d admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:11:06.591811 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097ce512-2fcc-49da-8f50-3b83a2321086 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c213711e794a1ba47ecf46ecb57769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:11:06.592369 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ce512-2fcc-49da-8f50-3b83a2321086 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:11:06.592651 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ce512-2fcc-49da-8f50-3b83a2321086 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:11:06.592930 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ce512-2fcc-49da-8f50-3b83a2321086 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:11:06.601846 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097ce512-2fcc-49da-8f50-3b83a2321086 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:11:06.603287 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097ce512-2fcc-49da-8f50-3b83a2321086 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:11:06.613126 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1463/2916] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 17:11:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 17:11:07.056260 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea7a0df-ef24-4aef-b16f-0fd5d09a8215 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:11:07.056260 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-9ea7a0df-ef24-4aef-b16f-0fd5d09a8215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:11:07.064671 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea7a0df-ef24-4aef-b16f-0fd5d09a8215 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:11:07.071160 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe255f1-ad90-417a-ab5e-43e75e85dae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:11:07.072107 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe255f1-ad90-417a-ab5e-43e75e85dae4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:11:07.072391 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe255f1-ad90-417a-ab5e-43e75e85dae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:11:07.072718 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe255f1-ad90-417a-ab5e-43e75e85dae4 admin admin] PATH_INFO: `/v3/projects/bf1fdb9334a84eaea29d42e18c611025` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:11:07.074515 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe255f1-ad90-417a-ab5e-43e75e85dae4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf1fdb9334a84eaea29d42e18c611025)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:11:07.076530 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe255f1-ad90-417a-ab5e-43e75e85dae4 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:11:07.208106 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-0fe255f1-ad90-417a-ab5e-43e75e85dae4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf1fdb9334a84eaea29d42e18c611025', 'request_id': 'req-0fe255f1-ad90-417a-ab5e-43e75e85dae4'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:11:07.296518 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-0fe255f1-ad90-417a-ab5e-43e75e85dae4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf1fdb9334a84eaea29d42e18c611025', 'request_id': 'req-0fe255f1-ad90-417a-ab5e-43e75e85dae4'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:11:07.302346 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-0fe255f1-ad90-417a-ab5e-43e75e85dae4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf1fdb9334a84eaea29d42e18c611025', 'request_id': 'req-0fe255f1-ad90-417a-ab5e-43e75e85dae4'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:11:07.314785 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-0fe255f1-ad90-417a-ab5e-43e75e85dae4 admin admin] The token cache is being invalidate because project bf1fdb9334a84eaea29d42e18c611025 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 17:11:07.315002 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-0fe255f1-ad90-417a-ab5e-43e75e85dae4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:11:07.315673 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-0fe255f1-ad90-417a-ab5e-43e75e85dae4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:11:07.317219 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1454/2917] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 17:11:07 2022] DELETE /identity/v3/projects/bf1fdb9334a84eaea29d42e18c611025 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 17:11:07.321371 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097ce512-2fcc-49da-8f50-3b83a2321086 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:11:07.331665 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097ce512-2fcc-49da-8f50-3b83a2321086 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:11:07.384843 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b6de03-77e8-4cf2-9431-d6a8436edfe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:11:07.386477 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b6de03-77e8-4cf2-9431-d6a8436edfe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:11:07.386767 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b6de03-77e8-4cf2-9431-d6a8436edfe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:11:07.387161 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b6de03-77e8-4cf2-9431-d6a8436edfe2 admin admin] PATH_INFO: `/v3/users/ebcf80e49dd449c1a52c7f1b0799194e` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:11:07.388418 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b6de03-77e8-4cf2-9431-d6a8436edfe2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebcf80e49dd449c1a52c7f1b0799194e)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:11:07.390326 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b6de03-77e8-4cf2-9431-d6a8436edfe2 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:11:07.663910 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f2b6de03-77e8-4cf2-9431-d6a8436edfe2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebcf80e49dd449c1a52c7f1b0799194e'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:11:07.664562 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f2b6de03-77e8-4cf2-9431-d6a8436edfe2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebcf80e49dd449c1a52c7f1b0799194e'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:11:07.833468 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f2b6de03-77e8-4cf2-9431-d6a8436edfe2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebcf80e49dd449c1a52c7f1b0799194e'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:11:07.841138 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f2b6de03-77e8-4cf2-9431-d6a8436edfe2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebcf80e49dd449c1a52c7f1b0799194e'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:11:07.852669 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f2b6de03-77e8-4cf2-9431-d6a8436edfe2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebcf80e49dd449c1a52c7f1b0799194e'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:11:07.859256 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1464/2918] 10.222.0.43 () {58 vars in 1223 bytes} [Mon Apr 11 17:11:07 2022] DELETE /identity/v3/users/ebcf80e49dd449c1a52c7f1b0799194e => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 17:11:08.306996 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe255f1-ad90-417a-ab5e-43e75e85dae4 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:11:08.309097 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-0fe255f1-ad90-417a-ab5e-43e75e85dae4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:11:08.323161 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe255f1-ad90-417a-ab5e-43e75e85dae4 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:11:08.380702 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2af7e9-7c5f-4ad9-934f-15f11f6a45e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5967d9641344da186ff23b8711ba0d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33d6863ead1548128e611dffc8b01410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:11:08.381573 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2af7e9-7c5f-4ad9-934f-15f11f6a45e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:11:08.381858 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2af7e9-7c5f-4ad9-934f-15f11f6a45e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:11:08.382135 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2af7e9-7c5f-4ad9-934f-15f11f6a45e0 admin admin] PATH_INFO: `/v3/projects/df5952088f084b2cbef86c3f01c659ef` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:11:08.383314 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2af7e9-7c5f-4ad9-934f-15f11f6a45e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df5952088f084b2cbef86c3f01c659ef)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:11:08.385249 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2af7e9-7c5f-4ad9-934f-15f11f6a45e0 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:11:08.536651 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-5a2af7e9-7c5f-4ad9-934f-15f11f6a45e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df5952088f084b2cbef86c3f01c659ef', 'request_id': 'req-5a2af7e9-7c5f-4ad9-934f-15f11f6a45e0'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:11:08.614069 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-5a2af7e9-7c5f-4ad9-934f-15f11f6a45e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df5952088f084b2cbef86c3f01c659ef', 'request_id': 'req-5a2af7e9-7c5f-4ad9-934f-15f11f6a45e0'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:11:08.619964 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-5a2af7e9-7c5f-4ad9-934f-15f11f6a45e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df5952088f084b2cbef86c3f01c659ef', 'request_id': 'req-5a2af7e9-7c5f-4ad9-934f-15f11f6a45e0'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:11:08.630907 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-5a2af7e9-7c5f-4ad9-934f-15f11f6a45e0 admin admin] The token cache is being invalidate because project df5952088f084b2cbef86c3f01c659ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 17:11:08.631188 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-5a2af7e9-7c5f-4ad9-934f-15f11f6a45e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:11:08.631836 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-5a2af7e9-7c5f-4ad9-934f-15f11f6a45e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:11:08.633359 dv-cinder-837163-2-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1455/2919] 10.222.0.43 () {58 vars in 1232 bytes} [Mon Apr 11 17:11:08 2022] DELETE /identity/v3/projects/df5952088f084b2cbef86c3f01c659ef => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 17:11:36.957917 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b6de03-77e8-4cf2-9431-d6a8436edfe2 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:11:36.959661 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-f2b6de03-77e8-4cf2-9431-d6a8436edfe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:11:37.034901 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b6de03-77e8-4cf2-9431-d6a8436edfe2 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:11:37.093495 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d632b5a-dad1-43e1-a8c6-771eaa74e715 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6589debd41bf496085c7339ab5409666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '477b9d41390e455a82e733c4fc6acd6b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:11:37.094542 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d632b5a-dad1-43e1-a8c6-771eaa74e715 service placement] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:11:37.094949 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d632b5a-dad1-43e1-a8c6-771eaa74e715 service placement] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:11:37.095355 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d632b5a-dad1-43e1-a8c6-771eaa74e715 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:11:37.097474 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-9d632b5a-dad1-43e1-a8c6-771eaa74e715 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:11:37.108925 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d632b5a-dad1-43e1-a8c6-771eaa74e715 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:11:37.110597 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d632b5a-dad1-43e1-a8c6-771eaa74e715 service placement] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:11:37.121587 dv-cinder-837163-2-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1465/2920] 10.222.0.43 () {60 vars in 1365 bytes} [Mon Apr 11 17:11:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)